Portable media device with video acceleration capabilities

Abstract
Improved techniques for performing accelerated video presentation on a media device are disclosed. The improved techniques enable smooth, uniform accelerated video presentation by displaying key frames from a video file in a periodic fashion. The rate and direction of accelerated video presentation can be controlled. The improved techniques are well suited for use with portable media devices.
Description
BACKGROUND OF THE INVENTION

1. Field of the Invention


The invention relates to media devices and, more particularly, to playing of media on media devices.


2. Description of the Related Art


Conventionally, video players are able to output video to a display device. Video players can be software applications operating on a personal computer or a specialized electronic device, such as a DVD player. These video players allow a user to playback a video. In addition, these video players allow other functions, such as fast forward and rewind operations, to be invoked by their user. Unfortunately, however, these conventional video players are not well suited for portable media devices being battery-powered and having limited processing capacity. Thus, there is a need for improved techniques for presenting video on portable media players.


SUMMARY OF THE INVENTION

The invention relates to improved techniques for performing accelerated video presentation on a media device. The improved techniques enable smooth, uniform accelerated video presentation by displaying key frames from a video file in a periodic fashion. The rate and direction of accelerated video presentation can be controlled.


The invention is well suited for use with portable media devices. The portable media devices can, for example, be battery-powered media playback devices. The battery-powered media playback devices can be highly portable, such as handheld or pocket-sized media players.


The invention can be implemented in numerous ways, including as a method, system, device, apparatus, or computer readable medium. Several embodiments of the invention are discussed below.


As a method for presenting video in an accelerated manner, one embodiment of the invention includes at least the acts of: receiving a request for accelerated presentation of a video, the video including a plurality of frames stored in a video file, some of the frames being key frames; identifying, after receiving the request, a next key frame in the video file for the video; retrieving the identified next key frame of the video file; and presenting the identified next key frame of the video.


As a method for playing a video on a media playback device in an accelerated manner, where the media playback device has a display device, one embodiment of the invention includes at least the acts of: determining a next key frame in a video file for the video; identifying a storage location and at least one attribute of the next key frame; retrieving the next key frame based on the storage location and the at least one attribute; decoding the next key frame; and outputting the decoded key frame to the display device.


As a media playback device, one embodiment of the invention includes at least: a media store that stores video files, the video files including frames, and at least some of the frames are key frames; a processor capable of processing video concerning at least one of the video files in an accelerated manner by successively providing key frames of the at least one of the video files; an output device; and a decoder configured to receive the frames of the video from the processor and to output video presentation information to the output device.


As a media playback device, another embodiment of the invention includes at least: a user input device configured to receive a user video acceleration input; a media store that stores video files, the video files including frames, and at least some of the frames are key frames; a key frame table capable of storing key frame information pertaining to at least a plurality of the key frames of the video file; a processor capable of processing video concerning at least one of the video files in an accelerated manner in response to the user video acceleration input, the processor operates to process the video by successively outputting key frames of the video file associated with the video; an output device; and a decoder configured to receive the frames of the video from the processor and output video presentation information to the output device.


As a computer readable medium including at least computer program code for presenting video in an accelerated manner, one embodiment of the invention includes at least: computer program code for receiving a request for accelerated presentation of a video, the video including a plurality of frames stored in a video file, some of the frames being key frames; computer program code for identifying, after receiving the request, a next key frame in the video file for the video; computer program code for retrieving the identified next key frame of the video file; and computer program code for presenting the identified next key frame of the video.


Other aspects and advantages of the invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the invention.





BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:



FIG. 1 is a block diagram of a media player according to one embodiment of the invention.



FIG. 2 is a flow diagram of a video acceleration process according to one embodiment of the invention.



FIG. 3 is a diagram of a representative video format.



FIG. 4 is a flow diagram of a user input process according to one embodiment of the invention.



FIGS. 5A-5B are flow diagrams of a periodic frame identification process according to one embodiment of the invention.



FIG. 6 is a flow diagram of a modified cache process according to one embodiment of the invention.



FIG. 7 is a flow diagram of a modified seek process according to one embodiment of the invention.





DETAILED DESCRIPTION OF THE INVENTION

The invention relates to improved techniques for performing accelerated video presentation on a media device. The improved techniques enable smooth, uniform accelerated video presentation by displaying key frames from a video file in a periodic fashion. The rate and direction of accelerated video presentation can be controlled.


The invention is well suited for use with portable media devices. The portable media devices can, for example, be battery-powered media playback devices. The battery-powered media playback devices can be highly portable, such as handheld or pocket-sized media players.


Embodiments of the invention are discussed below with reference to FIGS. 1-7. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.



FIG. 1 is a block diagram of a media player 100 according to one embodiment of the invention. The media player 100 includes a processor 102 that pertains to a microprocessor or controller for controlling the overall operation of the media player 100. The media player 100 stores media data pertaining to media items in a file system 104. More particularly, media files for the media items are stored in the file system 104. The file system 104 is, typically, a mass storage device, such as a storage disk or a plurality of disks. The file system 104 typically provides high capacity storage capability for the media player 100. The file system 104 can store not only media data but also non-media data (e.g., when operated in a disk mode). However, since the access time to the file system 104 is relatively slow, the media player 100 can also include a cache 106 (cache memory). The cache 106 is, for example, Random-Access Memory (RAM) provided by semiconductor memory. The relative access time to the cache 106 is substantially shorter than for the file system 104. However, the cache 106 does not have the large storage capacity of the file system 104. Further, the file system 104, when active, consumes substantially more power than does the cache 106. Since the media player 100 is normally a portable media player that is powered by a battery 107, power consumption is a general concern. Hence, use of the cache 106 enables the file system 104 to be inactive or off more often than if no cache 106 were used, thereby reducing power consumption of the portable media player.


The media player 100 also includes a user input device 108 that allows a user of the media player 100 to interact with the media player 100. For example, the user input device 108 can take a variety of forms, such as a button, keypad, dial, etc. Still further, the media player 100 includes a display 110 (screen display) that can be controlled by the processor 102 to display information to the user. A data bus 111 can facilitate data transfer between at least the file system 104, the cache 106, the processor 102, and a coder/decoder (CODEC) 112.


In one embodiment, the media player 100 serves to store a plurality of media items (e.g., videos) in the file system 104. When a user desires to have the media player 100 play a particular media item, a list of available media items can be displayed on the display 110. Then, using the user input device 108, a user can select one of the available media items. Upon receiving a selection of a particular media item, the media data (e.g., video file) for the particular media item is accessed by the processor 102 and then supplied to a coder/decoder (CODEC) 112. In the case of video and audio output, the CODEC 112 produces video output signals for the display 110 (or a display driver) and produces analog output signals for a speaker 114 (in this case the CODEC 112 can include one CODEC for audio and another CODEC for video). The speaker 114 can be a speaker internal to the media player 100 or external to the media player 100. For example, headphones or earphones that connect to the media player 100 would be considered an external speaker.


The media player 100 also includes a network/bus interface 116 that couples to a data link 118. The data link 118 allows the media player 100 to couple to a host computer. The data link 118 can be provided over a wired connection or a wireless connection. In the case of a wireless connection, the network/bus interface 116 can include a wireless transceiver.


Further, the media player 100 also includes a RAM 120 and a Read-Only Memory (ROM) 122. The ROM 122 can store programs, utilities or processes to be executed in a non-volatile manner. The ROM 122 can be implemented such that it is re-programmable, e.g., using EEPROM or FLASH technologies. The RAM 120 provides volatile data storage, such as for the cache 106.


Moreover, the processor 102 includes a media acceleration manger 124. The media acceleration manager 124 manages acceleration of the output of media items. Typically, the media items are videos, thus the accelerated output presents select video images from the file system 104 or the cache 106 onto the display 110 in an accelerated manner. More specifically, among other things, the media acceleration manager 124 determines when and what video images are presented on the display 110. For example, based on a user selection to accelerate media (i.e., video) output, the media acceleration manager 124 determines the appropriate frames of the video file to be output and then supplies such frames with appropriate timing to the CODEC 112 which decodes the frames for display on the display 110. The frames being processed by the media acceleration manager 124 or the processor 102 are typically retrieved from the cache 106, though they could also be retrieved from the file system 104. To facilitate the display of accelerated media (i.e., video), a key frame table 126 can be provided. In one embodiment, the key frame table 126 is stored in a portion of the RAM 120. The key frame table 126 can be used to assist the processor 102 in identifying those frames of a video file that are key frames which, as discussed below, are used to display accelerated media.



FIG. 2 is a flow diagram of a video acceleration process 200 according to one embodiment of the invention. The video acceleration process 200 is, for example, performed by a media device, such as the media device 100 illustrated in FIG. 1.


The video acceleration process 200 typically operates while a video is playing on the media device. The media device will typically have a display screen that displays images pertaining to the video. While the video is playing, at its normal speed, the video acceleration process 200 determines whether the video playback is to be accelerated. Typically, a user will interact with the media device to signal a request for acceleration of the video playback. As an example, the user can press a “fast forward” or “rewind” button to request accelerated video playback.


When the decision 202 determines that the video playback should not accelerate, then the video can continue to play at its normal rate. However, when the decision 202 determines that the video playback should accelerate, a next key frame in the video file pertaining to the video is identified 204. The video file pertaining to the video includes a number of frames, some of these frames are key frames. Key frames are complete image frames, whereas other frames are typically incomplete or partial frames. Key frames can also be referred to as independent frames (or I frames). The video file, for example, can pertain to an MPEG format. Exemplary video formats include H.264 and MPEG4.


After the next key frame in the video file has been identified 204, the identified next key frame of the video file can be retrieved 206. The identified next key frame can be retrieved 206 from a data storage device. The data storage device can be a disk drive, random access memory (e.g., FLASH memory), or cache memory associated with the disk drive. In any case, after the identified next key frame is retrieved 206, the identified next key frame can be presented 208. In the case of video playback, the identified next key frame can be presented 208 by displaying the identified next key frame on a display device.


Next, a decision 210 determines whether a next frame should be presented. When the decision 210 determines that a next frame should not yet be presented, the video acceleration process 200 awaits until the appropriate time to present the next video frame. The timing associated with the decision 210 affects the degree of acceleration of the video playback. Delaying the presentation of a next frame of the video for a shorter duration increases acceleration provided during video playback, whereas delaying for a longer duration would slow the acceleration during video playback. In one implementation, in accordance with a predetermined time, the decision 210 allows for the video acceleration process 200 to periodically present successive next key frames of the video file. Once the decision 210 determines that a next frame should be presented, a decision 212 determines whether there is additional video data to be presented. When the decision 210 determines that there is no more video data to be presented, the video acceleration process 200 ends. On the other hand, when the decision 212 determines that there is additional video to be presented, the video acceleration process 200 returns to repeat the block 204 and subsequent blocks so that the video acceleration process 200 can continue with processing of a next key frame in a similar fashion. Consequently, successive key frames in the video file are able to be directly and successively presented on a display device during an acceleration mode for video playback.


In another example, the decision 212 could determine not to continue the video acceleration process 200 when accelerated video playback is no longer desired. For example, a user may request that the accelerated video playback stop completely or return to its normal playback rate. In such cases, the decision 212 can determine to end the video acceleration process 200, in which case the video playback rate would return to its normal rate or the video playback would altogether stop depending upon the user's request.



FIG. 3 is a diagram of a representative video format 300. The representative video format 300 includes a header (H) 302 and series of frames 304. Certain ones of the frames 304 are key frames (K) 306. As noted above, according to one embodiment of the invention, the key frames 306 within the video format 300 can be identified and retrieved and thereafter utilized in presenting video playback in an accelerated manner.



FIGS. 4-7 are flow diagrams concerning a more particular implementation of accelerated video playback. The playback of video in an accelerated manner can correspond to a fast forward operation or a rewind operation.



FIG. 4 is a flow diagram of a user input process 400 according to one embodiment of the invention. The user input process 400 is, for example, performed by a media device, such as the media device 100 illustrated in FIG. 1.


The user input process 400 begins with a decision 402. The decision 402 determines whether a user input has been received. When the decision 402 determines that a user input has not been received, then the user input process 400 awaits such an input. Once the decision 402 determines that a user input has been received, a decision 404 determines whether the user input corresponds to a request for a fast forward (FF) or rewind (RW) operation. When the decision 404 determines that the user input is requesting to initiate a fast forward or a rewind operation, turn-on of a data storage device is requested 406. For example, in one embodiment, the data storage device is a hard disk storage device. A hard disk storage device can store large amounts of data but typically has a significant startup delay (relative to video processing rates) before data can be accessed on the hard disk storage device. Hence, the request 406 operates to begin the process of turning-on the hard drive storage device. Here, in this embodiment, it is assumed that the data storage device will need to be accessed to service the request for a fast forward (FF) or rewind (RW) operation; therefore, it is enabled and initiated in advance so as be more likely ready when access to the data storage device is needed.


Next, a key frame request timer is activated 408. The key frame request timer provides a periodic software event, i.e., a key frame timer event, to trigger a presentation of a next frame of video on a display device in an accelerated manner. The key frame timer event is discussed below with reference to FIGS. 5A and 5B. The period of the key frame request timer determines the rate of acceleration. The media device, or its user, can control or influence the rate of acceleration. For example, in one embodiment, when a fast forward or rewind operation is requested by a user, the initial rate of acceleration is a first rate; then, after being operated at the first rate for a predetermined period of time, a subsequent rate of acceleration is used, with the subsequent rate being greater than the initial rate. In this example, the media device automatically increases the rate of acceleration after the predetermined period of time.


On the other hand, when the decision 404 determines that the user input is not requesting to start a fast forward or rewind operation, a decision 410 determines whether the user input is requesting to stop a fast forward or rewind operation. For example, when a fast forward or rewind operation is currently active, a user will often want to at some point stop the fast forward or rewind operation. The user can do so with a user input. When the decision 410 determines that the user input is requesting to stop a fast forward or rewind operation, turn-off of the data storage device is requested 412. Since the media device is often portable and thus battery powered, it is often preferable to have the data storage device inactive to reduce power consumption (unless needed for other purposes). The key frame request timer is also deactivated 414 since the fast forward (FF) or rewind (RW) operation is ending.


Alternatively, when the decision 410 determines that the user input is not requesting to stop a fast forward or a rewind operation, a decision 416 determines whether the user input is requesting other processing. When the decision 416 determines that the user input is requesting other processing, the other processing can be requested 418. Following any of the blocks 408, 414, 418, as well as following the decision 416 when other processing is not requested, the user input process 400 returns to repeat the decision 402 and subsequent operations so that subsequent user inputs can be similarly processed.



FIGS. 5A-5B are flow diagrams of a periodic frame identification process 500 according to one embodiment of the invention. The periodic frame identification process 500 is, for example, performed by a media device, such as the media device illustrated in FIG. 1.


The periodic frame identification process 500 begins with a decision 502. The decision 502 determines whether a key frame timer event has occurred. When the decision 502 determines that a key frame timer event has not occurred, then the periodic frame identification process 500 awaits such an event. In other words, the periodic frame identification process 500 is effectively invoked when a key frame timer event occurs.


In any event, when the decision 502 determines that a key frame timer event has occurred, processing is performed so that a next video frame can be presented on a display device associated with the media device. The video frame being presented is not an adjacent frame of the video, but a time-advanced frame of the video. In particular, an index for the next key frame (NKF) is determined 504. For example, the next key frame can be the key frame immediately following the previously processed key frame. As another example, the next key frame can be the key frame one or a few key frames after the previously processed key frame.


After the index for the next key frame is determined 504, a decision 506 determines whether key frame information on the next key frame is in a key frame table. As noted above, the key frame table can store information on the key frames of a video file. The key frame table is stored in memory, such as RAM, for fast access by a processor of the media device. The media device 100 illustrated in FIG. 1 includes a key frame table 126. An exemplary key frame table can include, for each key frame within the key frame table: an index or pointer (corresponding to the table entry); an offset (corresponding to an address location in a data storage device); a time (i.e., a presentation time for the key frame); and a size (i.e., frame size).


When the decision 506 determines that the key frame information for the next key frame is not currently in the key frame table, an internal seek process is invoked 508 for a limited duration. The internal seek process causes a block of the video file in the direction of accelerated playback to be processed. The processing of the block, which includes a series of frames, operates to add additional key frame information into the key frame table. The limited duration limits the time spent processing the seek operation so as to not overburden the processor of the media device, thus avoiding distortion or stalling of the video presentation. For example, the limited duration can correspond to the time to seek through ten (10) seconds of video. Additional information on the operations associated with the seek process is discussed below with reference to FIG. 7. Following the block 508, the periodic frame identification process 500 returns to repeat the decision 506 to again determine whether the key frame information on the next key frame is in the key frame table. Given that the seek process operates to add additional key frame information into the key frame table, the key frame information for the next key frame would ordinarily now be present in the key frame table.


Once the decision 506 determines that the key frame information on the next key frame is available from the key frame table, the key frame information for the next key frame is retrieved 510 from the key frame table. At this point, the periodic frame identification process 500 can optionally perform a decision 511. The decision 511 can determine whether the next key frame should be ignored. For example, in one embodiment, the decision 511 can determine whether the presentation time associated with the next key frame is far enough in advance of the presentation time of the key frame that was last output. If the next key frame is too close to the presentation time of the key frame last output (e.g., less than 2 seconds apart), the next key frame can be ignored and the periodic frame identification process 500 can return to repeat the block 504 so that a next key frame can acquired and processed.


On the other hand, if the decision 511 determines that the next key frame is not too close to the presentation time of the key frame last output, then, using at least a portion of the key frame information, a decision 512 determines whether the next key frame is in a cache. The cache is a cache memory that is associated with the data storage device, such as a hard drive storage device. The cache provides high-speed access to that portion of the data from the data storage device that is in the cache. For example, the cache can be the cache 106 illustrated in FIG. 1. When the decision 512 determines that the next key frame is in the cache, then a pointer, size and time for the next key frame are retrieved 514 from the cache and provided to a decoder. The decoder can then operate in the normal course to retrieve the video data associated with the next key frame from the data storage device, decode the retrieved video data, and output the video signals to present the video on the display device.


On the other hand, when the decision 512 determines that the next key frame is not in the cache, a decision 516 determines whether the data storage device is ready. As previously noted, the advanced turn-on of the data storage device at block 406 of the user input process 400 illustrated in FIG. 4 anticipates that the data storage device will often be needed in the presenting of media (i.e., video) in an accelerated manner. Hence, the data storage device may already be ready when needed. Hence, at the decision 516, it is determined whether the data storage device is ready (i.e., fully activated or started-up). When the decision 516 determines that the data storage device is not yet ready, the periodic frame identification process 500 waits until the device is ready. Once the data storage device is ready, the cache is at least partially invalidated 518 (i.e., current cache content is purged or available for being overwritten). Next, the next key frame is retrieved 520 from the data storage device. The next key frame is then stored 522 to the cache. Following the block 522, the periodic frame identification process 500 proceeds to perform block 514 where a pointer, size and time for the next key frame can be retrieved and provided 514 to the decoder.


Following the block 514, the periodic frame identification process 500 ends. However, it should be noted that the next time the key frame timer event occurs, the periodic frame identification process 500 would again be performed.


Accordingly, the key frame timer provides a periodic timing for retrieving and presenting a next frame of video when operating to present video in an accelerated manner. The acceleration can, for example, be due to a fast forward mode or a rewind mode of video playback. The next key frame table is utilized to enable the media device to quickly determine a next key frame that is to be retrieved and presented. In this regard, presentation of a video in an accelerated manner makes use of the key frame images within the video file. Although these key frames are not uniformly provided within video files, the periodic presentation of key frames operates to effectively present a video in an accelerated manner. The acceleration processing operates to display successive key frames with little or no regard for the timing attributes of the key frames. By controlling the rate (periodicity) of displaying next key frames, the rate of acceleration can be controlled.


In some cases, a video file might have a high percentage of key frames. According to one embodiment of the invention, metadata of a video file can be analyzed to examine the number of key frames over the duration of the video. In one implementation, so long as the key frames on average are at least two (2) seconds apart over the duration of the video, each of the key frames of the video can be utilized in an accelerated output mode (e.g., fast forward or rewind). However, if the average number of frames over the duration of the video is less than two (2) seconds apart, less than all of the key frames can be utilized when outputting video in the accelerated manner. For example, if there is a high number of key frames in the video, every other key frame could be utilized, thereby effectively reducing the number of key frames being utilized. When less than all the key frames in the video are used, the key frames are effectively subsampled.



FIG. 6 is a flow diagram of a modified cache process 600 according to one embodiment of the invention. The modified cache process 600 concerns modifications to a conventional cache process that can be performed to facilitate utilization of a key frame table as discussed above. In other words, it is advantageous that the key frame table include key frame information for the various key frames of a video file to be presented. By modifying a conventional cache process to perform operations beneficial to the generation of a key frame table allows for efficient and cost effective formation of a key frame table.


The modified cache process 600 initially retrieves 602 a frame from the data storage device, namely, a hard drive data storage device. A decision 604 then determines whether the frame is a key frame. When the decision 604 determines that the frame is a key frame, a decision 606 determines whether key frame information for the key frame is in the key frame table. When the decision 606 determines that the key frame information for the key frame is not in the key frame table, key frame information for the key frame is stored 608 in the key frame table. The key frame information can be obtained from the frame or through conventional processing of information in the frame as well as in other prior frames. Alternatively, when the decision 606 determines that the key frame information for the key frame is already in the key frame table, the block 608 is bypassed.


Following the block 608 or its being bypassed, or following the decision 604 when the frame is not a key frame, cache processing of the frame is performed 610. Here, the cache processing performs a cache algorithm in a conventional manner. In one embodiment, the cache processing can be performed without regard to the need for frames to be in the cache for purposes of presenting video in an accelerated manner. To the extent frames needed are not in the cache, the frames can be retrieved from the data storage device, which can remain activated during the acceleration process. Following the block 610, a decision 612 determines whether more video data is to be cached at this time. When the decision 612 determines that more video data is to be cached at this time, a next frame is determined 614. Then, the modified cache process 600 returns to repeat the block 602 and subsequent operations so that the next frame of the video file can be similarly processed. On the other hand, once the decision 612 determines that no more data is to be cached at this time, the modified cache process 600 ends.



FIG. 7 is a flow diagram of a modified seek process 700 according to one embodiment of the invention. The modified seek process 700 concerns modifications to a conventional seek process that can be performed to facilitate utilization of a key frame table as discussed above. In other words, it is advantageous that the key frame table include key frame information for the various key frames of a video file to be presented. By modifying a conventional seek process to perform operations beneficial to the generation of a key frame table allows for efficient and cost effective formation of a key frame table. In general, a seek operation (or seek mode) is an operational mode of the media device in which the media device assists the user in moving a playback position to a desired point in the media.


The modified seek process 700 begins with a decision 702 that determines whether a seek request has been issued. When the decision 702 determines that a seek request has not been issued, the modified seek process 700 awaits such a request. In other words, the modified seek process 700 is effectively invoked when a seek request is issued. Once the decision 702 determines that a seek request has issued, a frame is retrieved 704 from the data storage device, namely, a hard drive data storage device. A decision 706 then determines whether the frame is a key frame. When the decision 706 determines that the frame is a key frame, a decision 708 determines whether key frame information for the key frame is in the key frame table. When the decision 708 determines that the key frame information for the key frame is not in the key frame table, key frame information for the key frame is stored 710 in the key frame table. The key frame information can be obtained from the frame or through conventional processing of information in the frame as well as in other prior frames. Alternatively, when the decision 708 determines that the key frame information for the key frame is already in the key frame table, the block 710 is bypassed.


Following the block 710 or its being bypassed, or following the decision 706 when the frame is not a key frame, seek processing on the frame is performed 712. Here, the seek processing performs a seek algorithm in a conventional manner. In one embodiment, the seek processing can be performed in response to a user request. In another embodiment, the seek processing can be performed due to an internal system request (e.g., block 508 of FIG. 5A). To the extent frames needed by the seek processing are not in the cache, the frames can be retrieved from the data storage device, which can remain activated during the acceleration process. Following the block 712, a decision 714 determines whether more video data is to be traversed at this time. When the decision 714 determines that more video data is to be traversed at this time, a next frame is determined 716. Then, the modified seek process 700 returns to repeat the block 704 and subsequent operations so that the next frame of the video file can be similarly processed. On the other hand, once the decision 714 determines that no more data is to be traversed at this time, the modified seek process 700 ends.


The various aspects, embodiments, implementations or features of the invention can be used separately or in any combination.


The invention can be implemented by software, hardware or a combination of hardware and software. The invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium include read-only memory, random-access memory, CD-ROMs, DVDs, magnetic tape, and optical data storage devices. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.


The advantages of the invention are numerous. Different aspects, embodiments or implementations may yield one or more of the following advantages. One advantage of the invention is that video can be output in an accelerated manner, yet have a smooth, regular presentation (as perceived by a user). The frames of the accelerated video being output are based on key frames, which tend to naturally occur at the more important scenes of the video. Another advantage of the invention is that the control of the acceleration process can be customized, such as to change its acceleration rate. Still another advantage of the invention is that the acceleration can pertain to a fast forward operation or a rewind operation using the same generalized approach. Yet still another advantage of the invention is that the invention facilitates accelerated video output yet allows a separate caching mechanism for normal video playback.


The many features and advantages of the present invention are apparent from the written description and, thus, it is intended by the appended claims to cover all such features and advantages of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, the invention should not be limited to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention.

Claims
  • 1. A method for presenting video in an accelerated manner, said method comprising: (a) receiving a request for accelerated presentation of a video, the video including a plurality of frames stored in a video file, some of the frames being key frames;(b) identifying, after receiving the request, a next successive key frame in the video file for the video;(c) retrieving the identified next successive key frame of the video; and(d) presenting the identified next successive key frame of the video in accordance with an acceleration rate that is inversely related to a period of time between the presenting of a current key frame and the next successive key frame wherein said presenting (d) presents successive key frames of the video on a display screen of a portable media device.
  • 2. The method recited in claim 1, wherein said method further comprises: (e) periodically repeating said identifying (b), said retrieving (c) and said presenting (d).
  • 3. The method recited in claim 2, wherein said repeating (e) continues so long as the video presentation is to remain accelerated.
  • 4. The method recited in claim 3, wherein the video presentation is being accelerated in either a forward direction or a reverse direction.
  • 5. The method recited in claim 2, wherein said repeating (e) is performed periodically in accordance with a predetermined period of time.
  • 6. The method recited in claim 1, wherein the acceleration rate is initially set at a first rate and later increased to a second rate, the second rate being greater than the first rate.
  • 7. The method recited in claim 1, wherein the acceleration rate changes from the first rate to the second rate after operating at the first rate for a predetermined duration.
  • 8. The method recited in claim 1, wherein the request for accelerated video presentation is a request for a fast forward operation.
  • 9. The method recited in claim 1, wherein the request for accelerated video presentation is a request for a rewind operation.
  • 10. The method recited in claim 1, wherein said retrieving (c) of the identified next successive key frame of the video file is retrieved from a cache memory that temporarily stores at least a portion of the video file.
  • 11. A method for playing a video on a media playback device in an accelerated manner, the media playback device having a display device, said method comprising: determining a next successive key frame in a video file for the video;identifying a storage location and at least one attribute of the next successive key frame;retrieving the next successive key frame based on the storage location and the at least one attribute;decoding the next successive key frame; andoutputting the decoded successive key frame to the display device a period of time after the display of a current key frame wherein the period of time is inversely related to a playback acceleration rate.
  • 12. The method recited in claim 11, wherein said method further comprises: periodically repeating said determining, said identifying, said retrieving, said decoding and said outputting.
  • 13. The method recited in claim 12, wherein said repeating is periodically performed in accordance with a predetermined duration of time.
  • 14. The method recited in claim 13, wherein the predetermined duration of time is provided by a timer event.
  • 15. The method recited in claim 13, wherein the predetermined duration of time is dependent on a rate of acceleration to be provided.
  • 16. The method recited in claim 12, wherein the media playback device includes a key frame table that provides the storage location and the at least one attribute for a plurality of key frames of the video file, wherein said determining of the next key frame is performed using the key frame table, andwherein said identifying of the storage location and the at least one attribute of the next key frame is provided by the key frame table.
  • 17. The method recited in claim 16, wherein the media playback device is a portable media playback device.
  • 18. A media playback device, comprising: a media store that stores video files, the video files including frames, and at least some of the frames are key frames;a processor capable of processing video concerning at least one of the video files in an accelerated manner by providing successive key frames of the at least one of the video files;an output device; anda decoder, operatively connected to said processor and said output device, said decoder being configured to receive the frames of the video from said processor and to output video presentation information to said output device in accordance with an acceleration rate that is inversely related to a period of time between the output of a current key frame and a next successive key frame.
  • 19. The media playback device recited in claim 18, wherein the media playback device is a portable, handheld media playback device.
  • 20. A media playback device, comprising: a user input device configured to receive a user video acceleration input;a media store that stores video files, the video files including frames, and at least some of the frames are key frames;a key frame table capable of storing key frame information pertaining to at least a plurality of the key frames of the video file;a processor capable of processing video concerning at least one of the video files in an accelerated manner in response to the user video acceleration input, said processor operates to process the video by outputting key frames of the video file, wherein the outputting is based upon a period of time between the display of a current key frame and a next successive key frame, the period of time being inversely related to the user video acceleration input;an output device; anda decoder, operatively connected to said processor and said output device, configured to receive the frames of the video from said processor and output video presentation information to said output device.
  • 21. The media playback device recited in claim 20, wherein the key frame information is stored to said key frame table as a portion of the video file is being cached or as a seek to another portion of the video file is performed.
  • 22. A computer readable medium including at least computer program code for presenting video in an accelerated manner, said computer readable medium comprising: computer program code for receiving a request for accelerated presentation of a video, the video including a plurality of frames stored in a video file, some of the frames being key frames;computer program code for identifying, after receiving the request, a next successive key frame in the video file for the video;computer program code for retrieving the identified next successive key frame of the video file; andcomputer program code for presenting the identified next successive key frame of the video a period of time after the presenting of a current key frame the period of time being inversely related to a video playback acceleration rate.
US Referenced Citations (190)
Number Name Date Kind
4090216 Constable May 1978 A
4386345 Narveson et al. May 1983 A
4451849 Fuhrer May 1984 A
4589022 Prince et al. May 1986 A
4908523 Snowden et al. Mar 1990 A
4928307 Lynn May 1990 A
4951171 Tran et al. Aug 1990 A
5185906 Brooks Feb 1993 A
5293494 Saito et al. Mar 1994 A
5406305 Shimomura et al. Apr 1995 A
5559945 Beaudet et al. Sep 1996 A
5566337 Szymanski et al. Oct 1996 A
5583993 Foster et al. Dec 1996 A
5608698 Yamanoi et al. Mar 1997 A
5616876 Cluts Apr 1997 A
5617386 Choi Apr 1997 A
5670985 Cappels, Sr. et al. Sep 1997 A
5684513 Decker Nov 1997 A
5710922 Alley et al. Jan 1998 A
5712949 Kato et al. Jan 1998 A
5721949 Smith et al. Feb 1998 A
5726672 Hernandez et al. Mar 1998 A
5739451 Winksy et al. Apr 1998 A
5740143 Suetomi Apr 1998 A
5760588 Bailey Jun 1998 A
5778374 Dang et al. Jul 1998 A
5803786 McCormick Sep 1998 A
5815225 Nelson Sep 1998 A
5822288 Shinada Oct 1998 A
5835721 Donahue et al. Nov 1998 A
5835732 Kikinis et al. Nov 1998 A
5838969 Jacklin et al. Nov 1998 A
5864868 Contois Jan 1999 A
5867163 Kurtenbach Feb 1999 A
5870710 Ozawa et al. Feb 1999 A
5918303 Yamaura et al. Jun 1999 A
5920728 Hallowell et al. Jul 1999 A
5923757 Hocker et al. Jul 1999 A
5952992 Helms Sep 1999 A
6006274 Hawkins et al. Dec 1999 A
6009237 Hirabayashi et al. Dec 1999 A
6011585 Anderson Jan 2000 A
6018705 Gaudet et al. Jan 2000 A
6041023 Lakhansingh Mar 2000 A
6052654 Gaudet et al. Apr 2000 A
6108426 Stortz Aug 2000 A
6122340 Darley et al. Sep 2000 A
6158019 Squibb Dec 2000 A
6161944 Leman Dec 2000 A
6172948 Keller et al. Jan 2001 B1
6179432 Zhang et al. Jan 2001 B1
6185163 Bickford et al. Feb 2001 B1
6191939 Burnett Feb 2001 B1
6208044 Viswanadham et al. Mar 2001 B1
6216131 Liu et al. Apr 2001 B1
6217183 Shipman Apr 2001 B1
6248946 Dwek Jun 2001 B1
6295541 Bodnar et al. Sep 2001 B1
6298314 Blackadar et al. Oct 2001 B1
6332175 Birrell et al. Dec 2001 B1
6336365 Blackadar et al. Jan 2002 B1
6336727 Kim Jan 2002 B1
6341316 Kloba et al. Jan 2002 B1
6357147 Darley et al. Mar 2002 B1
6377530 Burrows Apr 2002 B1
6452610 Reinhardt et al. Sep 2002 B1
6467924 Shipman Oct 2002 B2
6493652 Ohlenbusch et al. Dec 2002 B1
6536139 Darley et al. Mar 2003 B2
6549497 Miyamoto et al. Apr 2003 B2
6560903 Darley May 2003 B1
6587403 Keller et al. Jul 2003 B1
6587404 Keller et al. Jul 2003 B1
6605038 Teller et al. Aug 2003 B1
6606281 Cowgill et al. Aug 2003 B2
6611789 Darley Aug 2003 B1
6617963 Watters et al. Sep 2003 B1
6621768 Keller et al. Sep 2003 B1
6623427 Mandigo Sep 2003 B2
6631101 Chan et al. Oct 2003 B1
6693612 Matsumoto et al. Feb 2004 B1
6731312 Robbin May 2004 B2
6760536 Amir et al. Jul 2004 B1
6762741 Weindorf Jul 2004 B2
6794566 Pachet Sep 2004 B2
6799226 Robbin et al. Sep 2004 B1
6801964 Mahdavi Oct 2004 B1
6870529 Davis Mar 2005 B1
6871063 Schiffer Mar 2005 B1
6876947 Darley et al. Apr 2005 B1
6882955 Ohlenbusch et al. Apr 2005 B1
6898550 Blackadar et al. May 2005 B1
6911971 Suzuki et al. Jun 2005 B2
6918677 Shipman Jul 2005 B2
6934812 Robbin et al. Aug 2005 B1
6950087 Knox et al. Sep 2005 B2
7028096 Lee Apr 2006 B1
7046230 Zadesky May 2006 B2
7062225 White Jun 2006 B2
7084856 Huppi Aug 2006 B2
7084921 Ogawa Aug 2006 B1
7092946 Bodnar Aug 2006 B2
7124125 Cook et al. Oct 2006 B2
7143241 Hull Nov 2006 B2
7146437 Robbin et al. Dec 2006 B2
7171331 Vock et al. Jan 2007 B2
7191244 Jennings et al. Mar 2007 B2
7213228 Putterman et al. May 2007 B2
7234026 Robbin et al. Jun 2007 B2
7277928 Lennon Oct 2007 B2
7301857 Shah et al. Nov 2007 B2
7356679 Le et al. Apr 2008 B1
7508535 Hart et al. Mar 2009 B2
20010013983 Izawa et al. Aug 2001 A1
20010037367 Iyer Nov 2001 A1
20010041021 Boyle et al. Nov 2001 A1
20010042107 Palm Nov 2001 A1
20020002413 Tokue Jan 2002 A1
20020013784 Swanson Jan 2002 A1
20020045961 Gibbs et al. Apr 2002 A1
20020046315 Miller et al. Apr 2002 A1
20020055934 Lipscomb et al. May 2002 A1
20020090912 Cannon et al. Jul 2002 A1
20020116082 Gudorf Aug 2002 A1
20020152045 Dowling et al. Oct 2002 A1
20020156833 Maurya et al. Oct 2002 A1
20020161865 Nguyen Oct 2002 A1
20020173273 Spurgat et al. Nov 2002 A1
20020189426 Hirade et al. Dec 2002 A1
20020189429 Qian et al. Dec 2002 A1
20020199043 Yin Dec 2002 A1
20030037254 Fischer et al. Feb 2003 A1
20030046434 Flanagin et al. Mar 2003 A1
20030050092 Yun Mar 2003 A1
20030074457 Kluth Apr 2003 A1
20030076301 Tsuk et al. Apr 2003 A1
20030076306 Zadesky Apr 2003 A1
20030079038 Robbin et al. Apr 2003 A1
20030095096 Robbin et al. May 2003 A1
20030097379 Ireton May 2003 A1
20030104835 Douhet Jun 2003 A1
20030128192 van Os Jul 2003 A1
20030133694 Yeo Jul 2003 A1
20030153213 Siddiqui et al. Aug 2003 A1
20030156503 Schilling et al. Aug 2003 A1
20030167318 Robbin et al. Sep 2003 A1
20030176935 Lian et al. Sep 2003 A1
20030229490 Etter Dec 2003 A1
20040001395 Keller et al. Jan 2004 A1
20040001396 Keller et al. Jan 2004 A1
20040012556 Yong et al. Jan 2004 A1
20040055446 Robbin et al. Mar 2004 A1
20040069122 Wilson Apr 2004 A1
20040076086 Keller Apr 2004 A1
20040086120 Akins, III et al. May 2004 A1
20040094018 Ueshima et al. May 2004 A1
20040125522 Chiu et al. Jul 2004 A1
20040165302 Lu Aug 2004 A1
20040177063 Weber et al. Sep 2004 A1
20040198436 Alden Oct 2004 A1
20040224638 Fadell et al. Nov 2004 A1
20040267825 Novak et al. Dec 2004 A1
20050015254 Beaman Jan 2005 A1
20050053365 Adams et al. Mar 2005 A1
20050108754 Carhart et al. May 2005 A1
20050111820 Matsumi et al. May 2005 A1
20050122315 Chalk et al. Jun 2005 A1
20050123886 Hua et al. Jun 2005 A1
20050152294 Yu et al. Jul 2005 A1
20050160270 Goldberg et al. Jul 2005 A1
20050166153 Eytchison et al. Jul 2005 A1
20050245839 Stivoric et al. Nov 2005 A1
20050248555 Feng et al. Nov 2005 A1
20050259524 Yeh Nov 2005 A1
20060013414 Shih Jan 2006 A1
20060068760 Hameed et al. Mar 2006 A1
20060088228 Marriott et al. Apr 2006 A1
20060098320 Koga et al. May 2006 A1
20060135883 Jonsson et al. Jun 2006 A1
20060152382 Hiltunen Jul 2006 A1
20060155914 Jobs et al. Jul 2006 A1
20060170535 Watters et al. Aug 2006 A1
20060190577 Yamada Aug 2006 A1
20060221788 Lindahl et al. Oct 2006 A1
20060265503 Jones et al. Nov 2006 A1
20060272483 Honeywell Dec 2006 A1
20070028009 Robbin et al. Feb 2007 A1
20070124679 Jeong et al. May 2007 A1
20070135225 Nieminen et al. Jun 2007 A1
20070255163 Prineppi Nov 2007 A1
Foreign Referenced Citations (68)
Number Date Country
43 34 773 Apr 1994 DE
44 45 023 Jun 1996 DE
0 127 139 May 1984 EP
0578604 Jan 1994 EP
0 757 437 Feb 1997 EP
0 813 138 Dec 1997 EP
0 863 469 Sep 1998 EP
0 917 077 May 1999 EP
0 982 732 Mar 2000 EP
1 028 425 Aug 2000 EP
1028426 Aug 2000 EP
1 076 302 Feb 2001 EP
1 213 643 Jun 2002 EP
1289197 Mar 2003 EP
1 503 363 Feb 2005 EP
1536612 Jun 2005 EP
1 566 743 Aug 2005 EP
1566948 Aug 2005 EP
1 372 133 Dec 2005 EP
1 686 496 Aug 2006 EP
2 370 208 Jun 2002 GB
2384399 Jul 2003 GB
59-023610 Feb 1984 JP
03-228490 Oct 1991 JP
04-243386 Aug 1992 JP
6-96520 Apr 1994 JP
8-235774 Sep 1996 JP
9-50676 Feb 1997 JP
9-259532 Oct 1997 JP
2000-90651 Mar 2000 JP
2000-224099 Aug 2000 JP
2000-285643 Oct 2000 JP
2000-299834 Oct 2000 JP
2000-311352 Nov 2000 JP
2000-339864 Dec 2000 JP
2001-236286 Aug 2001 JP
2001-312338 Nov 2001 JP
2002-076977 Mar 2002 JP
2002-175467 Jun 2002 JP
2003-188792 Jul 2003 JP
2003-259333 Sep 2003 JP
2003-319365 Nov 2003 JP
2004-021720 Jan 2004 JP
2004-219731 Aug 2004 JP
2004-220420 Aug 2004 JP
10-2001-0076508 Aug 2001 KR
WO 9516950 Jun 1995 WO
WO 9817032 Apr 1998 WO
WO 9928813 Jun 1999 WO
WO 0022820 Apr 2000 WO
WO 0133569 May 2001 WO
WO 0165413 Sep 2001 WO
WO 0167753 Sep 2001 WO
WO 0225610 Mar 2002 WO
WO 03023786 Mar 2003 WO
WO 03036457 May 2003 WO
WO 03067202 Aug 2003 WO
2004061850 Jul 2004 WO
WO 2004055637 Jul 2004 WO
WO2004084413 Sep 2004 WO
WO 2004104815 Dec 2004 WO
WO 2005031737 Apr 2005 WO
WO 2005031737 Apr 2005 WO
WO 2005048644 May 2005 WO
WO 2005008505 Jul 2005 WO
WO 2005109781 Nov 2005 WO
WO 2006040737 Apr 2006 WO
WO 2006071364 Jun 2006 WO
Related Publications (1)
Number Date Country
20070157268 A1 Jul 2007 US