1. Field of the Invention
The present invention relates to assessment of digital videos and, more particularly, to automating assessment of digital video encodings.
2. Description of the Related Art
Digital video systems are replacing existing analog video systems and making possible the creation of many new telecommunication services (e.g., direct broadcast satellite, digital television, high definition television, video teleconferencing, telemedicine, e-commerce) that are becoming an essential part of the U.S. and world economy.
Furthermore, powered by recent advances in digital video compression technology, the different ways of delivering digital video content to viewers is increasing rapidly. In the past, viewers were constrained to watch video programming in front of a television receiver in their home. Today, people may watch digital video at any time and in any place. A viewer can now watch a video on their desktop PC or on a mobile handheld device. A process known as—transcoding—enables distribution over various networks and playback over various devices.
Digital video transcoding is the direct digital-to-digital conversion of an initial digital video encoding, into a resulting digital video encoding. This is usually done because the initial digital video encoding is so large that distribution over bandwidth limited networks is impractical, or because the initial digital video encoding is incompatible with limited display capabilities of televisions, cell phones, personal video players or other specialty consumer electronics. Accordingly, digital video transcoding overcomes such impracticality or incompatibility of the initial digital encoding by conversion into a more suitable format of the resulting encoding.
For example, a popular initial digital video encoding used by motion picture studios is Apple's ProRes 422 (HQ), which is a high-definition lossy video compression format developed by Apple Inc. for studio use in post production. Its popularity is due, at least in part, to its outstanding visual quality at full width 1920 by 1080 resolution, 4:2:2 chroma sampling, and 10-bit sample depth. Naturally, a large amount of data is used to provide encodings of such outstanding visual quality. For example, feature length movies encoded in ProRes 422 (HQ) may be as large as approximately 100-200 gigabytes (GBs) or more, which in an uncompress form may be about 600 GBs.
Accordingly, it should be understood that ProRes 422 (HQ) is an initial digital video encoding, which is intended for use in studio workflow and editing, and which is not intended or practical for end-user viewing or distribution over bandwidth limited networks. Initial digital video encodings, such as ProRes 422 (HQ), advantageously provide for retaining higher quality than typical end user digital video encodings, while consuming less disk storage as compared to disk storage consumed by uncompressed digital video alternatives.
Further, it is anticipated that initial ProRes 422 (HQ) encodings may be transcoded into resulting video encodings in suitable formats. For example, resulting AVC1 (also known as H.264) encodings provide a compact format, which is suitable for distribution over bandwidth limited networks, and for display on handheld media players, such as the iPod™ available from Apple Inc., or on networked set-top boxes, such as the AppleTV™ available from Apple Inc.
While such digital video transcoding provides many advantages, some challenges still remain. The resulting digital video encodings often include visually annoying transcoding artifacts, which are introduced by the transcoding, and which are not apparent in the initial high quality encoding. Some common examples of such transcoding artifacts include annoying jerkiness, annoying video pixilation or annoying smearing (which is localized over a sub-region portraying a fast moving object in the resulting digital video encoding.)
Such challenges are exacerbated by further difficulties, which are inherent in assessing such transcoding artifacts. To be most accurate, assessment of such transcoding artifacts digital video quality should be based on the perceived visual quality of the actual resulting digital video encoding, which is intended for end-users. Such transcoding artifacts are variable and depend (in part) upon the dynamic characteristics of the initial digital video encoding (e.g., spatial detail, motion).
Accordingly, conventional schemes for manually assessing transcoding artifacts are time consuming and labor intensive. Hence, there is a need for improved approaches for assessing transcoding artifacts in digital video encodings.
Broadly speaking, the present invention provides a system and method for automating assessment of defects in digital videos. According to one aspect, the invention provides a system and method for automating assessment of defects, such as transcoding artifacts, in digital video encodings.
In one embodiment, the invention pertains to a method and system for submitting digital video content to a digital video distribution system for encoding (e.g., transcoding) and distribution in a compact format. Portions of the encoded digital video content, referred to as video segments, that have perceived defects (e.g., transcoding artifacts) can be identified. An electronic record of the perceived defects for each of the identified segments can be created and used to automatically create a condensed defect review video that facilitates a convenient and efficient assessment of the perceived defects by others.
The invention can be implemented in numerous ways, including as a method, system, device, or apparatus (including graphical user interface and computer readable medium). Several embodiments of the invention are discussed below.
As a media distribution system, one embodiment of the invention can, for example, include at least a media submission sub-system configured to facilitate review of a digital video stored in an electronic video file. The media submission sub-system is configured to (i) receive a defect report pertaining to one or more defects in a digital video, the defect report indicating at least a defect location for each of the one or more defects in the digital video, and (ii) form a defect review video from the digital video based on the corresponding defect locations for the identified one or more defects in the digital video as identified in the defect report.
As a method for facilitating review of a digital video stored in an electronic video file, one embodiment of the invention can, for example, include at least: receiving a defect report pertaining to one or more defects in a digital video, the defect report indicating at least a defect location for each of the one or more defects in the digital video; and automatically, through use of a computer, forming a defect review video from the digital video based on the corresponding defect locations for the identified one or more defects in the digital video as identified in the defect report.
As a method for reviewing digital videos, one embodiment of the invention can, for example, include at least: submitting digital video content to a digital video distribution system for transcoding and distribution in a compact format; transcoding the submitted digital video content into the compact format; reviewing transcoding artifacts, which are present in one or more video segments of the compact format; identifying the one or more video segments having the transcoding artifacts; and creating an electronic record of the transcoding artifacts for the identified segments.
As a computer readable medium including at least computer program code stored thereon for automating assessment of transcoding artifacts, one embodiment of the invention can, for example, include at least: computer program code of segments of submitted digital video content; computer programs code for transcoding the submitted digital video content into a compact format, wherein the compact format includes transcoding artifacts; computer program code for packaging segments of the compact format and corresponding segments of the submitted video content together into a playable file; and computer program code for providing instruction parameters in the playable file for automatically arranging playback of each of the segments of the compact format, together with the corresponding segments of the submitted video content, so as to demonstrate appearance of the transcoding artifacts in the compact format, relative to appearance of the submitted video content.
Other aspects and advantages of the invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the invention.
The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
The present invention provides a system and method for automating assessment of defects in digital videos. According to one aspect, the invention provides a system and method for automating assessment of defects, such as transcoding artifacts, in digital video encodings.
In one embodiment, the invention pertains to a method and system for submitting digital video content to a digital video distribution system for distribution in one or more different a compact formats.
The submission of digital video content to the distribution system can be performed in a uniform and computer-assisted manner. The submitted digital video content can then be encoded (e.g., transcoded) into a compact format for distribution. The compact format can then be reviewed to identify portions of the digital video content, referred to as video segments, that have perceived defects (e.g., transcoding artifacts). An electronic record of the perceived defects for each of the identified segments can be created by an agent performing the review. Subsequently, in one embodiment, the electronic record formed from the review process can be used to automatically assemble video clips into a compact playable file. This may provide a convenient “highlights” video which, on playback, can display segments of the compact format together with segments of the submitted digital video content, for direct “side-by-side” comparison. Direct comparison of the appearance of the perceived defects in the compact format relative to the appearance of the submitted digital video content may provide for efficient assessment and disposition of the perceived defects.
It should be understood that digital video transcoding, as the term is used herein, is the digital-to-digital conversion of the digital video encoding of submitted digital video content into the resulting digital video encoding having a compact format. In one embodiment, this may be done because the digital encoding of the submitted digital video content may be so large that distribution over bandwidth limited networks is impractical, or because the digital encoding of the submitted digital video content may be incompatible with limited display capabilities of televisions, cell phones, portable media players, or other consumer electronic products. Accordingly, digital video transcoding may overcome such impracticality and incompatibility of the digital encoding of the submitted digital video content by conversion into a more suitable resulting digital video encoding often having a more compact format.
Further, it should be understood that video transcoding artifacts, as the term is used herein, are visually annoying artifacts in segments of the digital video encoding of the compact format, which are introduced by the previously mentioned transcoding, and which are not apparent in the digital encoding of the submitted digital video content. Common examples of such video transcoding artifacts include, but are not limited to, annoying jerkiness, annoying video pixilation and annoying smearing (which localized over a sub-region portraying a fast moving object in the digital video encoding of the compact format).
Assessment is generally defined as a process of documenting, sometimes in measurable terms, knowledge, skills, attitudes or beliefs. Paper and ink documentation methods, which work well in many fields of endeavor, do not work as well for documenting a reviewing agent's assessment of video defects, such as transcoding artifacts, in digital video recordings because paper and ink do not fully capture and document the reviewing agent's dynamic visual experience of the transcoding artifacts. One embodiment of the invention documents, and may accurately capture the reviewing agent's assessment of video defects, based on the reviewing agent's perceived visual quality of the actual digital video encoding. In one embodiment, the invention automates creation of a playable highlights video, which may conveniently document the reviewer's assessment of the defects in the video content being reviewed.
The data size of the original submitted video content is often very large often too large to be shared easily or conveniently with others. In contrast, the data size of a playable highlights video (compact playable file) is usually much smaller, while still retaining a consistent timeline with the original submitted video content. As will be discussed later in greater detail, in one embodiment, the invention can reduce data size in the highlights video while still retaining the timeline of the original submitted video material by using filler content instead in place video content. The filler content can, for example, be blank or which otherwise have low data complexity.
Because the invention automates the assessment of video defects (e.g., transcoding artifacts), the invention may increase convenience and efficiency. Because the compact file of the highlights video has the small data size, it may be easily and conveniently shared with others. In accordance with one embodiment of the invention, the highlights video can be provided to a content provider of the original submitted video content, thereby communicating a reviewing agent's assessment of the video defects effectively to the content provider.
Because the highlights video is playable, the content provider may conveniently and visually experience the reviewing agent's artifact assessment. Because, the highlights video retains the original timeline of the submitted video content, the content provider may easily understand display of the video defects in corresponding timing context of the original submitted video.
Because the highlights video of the invention may show the content provider the direct “side-by-side” comparison of appearance of the video defects (e.g., transcoding artifacts) in the compact format, relative to appearance of the submitted video content. As a result, the content provider is much less likely to mistakenly blame other for video defects that may be present in the original submitted video content.
In light of the foregoing reasoning, the invention may advantageously facilitate a media distribution system in making an accurate, appropriate and simplified assessment on whether a particular video, e.g., compact video encoding, has sufficient quality to be distributed. Hence, the invention can help avoid release of inferior digital video products which might have unacceptable defects, such as annoying transcoding artifacts. Accordingly, the invention may provide for increased quality and satisfaction perceived by content providers and consumers of video content.
Embodiments of the invention are discussed below with reference to
The digital media distribution system 100 can also include or support a plurality of clients, such as a first client 104, a second client 110, and a third client 114. For simplified illustration in
The digital media player 108 is an application program (e.g., software application) that operates on the first client 104, which can be a computing device. One example of a suitable digital media player 108 is QuickTime™ or iTunes™ which are software applications offered by Apple Inc. The first client 104 is coupled to the media distribution site server 102 through the data network 106. Hence, the first client 104 can interact with the media distribution site server 102 to manage, receive and play digital media assets, such as videos, stored in the digital media assets storage device 103.
The content management/submission interface program 112 is an application program (e.g., software application) that operates on the second client 110, which can be a computing device. The content management/submission interface program 110 is used in submitting (or resubmitting) digital media content to the digital media distribution system 100. For example, a content provider might want to upgrade the quality of previously submitted digital video content by resubmitting digital video content having improved quality, such as aesthetic characteristics (e.g., better sounding audio and/or better looking video). In any case, when the content provider desires to update the prior submission, the content management/submission interface program 112 can be used to resubmit the corresponding digital content.
The digital media distribution system 100 can also include a submission server 118. The submission server 118 can process submissions of digital media assets, such as digital videos, to the digital media distribution system 100 for distribution. In one embodiment, the content management/submission interface program 112 can be used to perform a submission of a digital video to the submission server 118 via the data network 106.
The digital video content that has been submitted to the submission server 118 (e.g., via the second client 110) can be processed and reviewed to determines whether it is permitted to be made available for distribution by the media distribution site server 102. For example, in one embodiment, the submission server 118 accepts an account login corresponding to a registered content provider, and accepts submission of a digital video from the content provider. Here, the content provider operates the content management/submission interface program 112 on the client 110 to submit the digital video to the submission server 118. iTunes Producer™ or iTunes Connect™ available from Apple Inc. are one examples of software programs that are suitable for the suitable content management/submission interface program 112. For additional information on submission of media items to a media distribution system see, (i) U.S. Patent Publication No. 2004/0254883 A1; (ii) U.S. Patent Publication No. 2007/0083471 A1, (iii) U.S. patent application Ser. No. 11/946,711, filed Nov. 28, 2007, entitled “RESUBMISSION OF MEDIA FOR NETWORK-BASED DISTRIBUTION”; and (iv) U.S. patent application Ser. No. 12/354,701, filed Jan. 15, 2009, entitled “SYSTEM AND METHOD FOR CONTROLLING ONLINE STORE SERVICES AND SUBMISSION OR RESUBMISSION OF DIGITAL MEDIA CONTENT USING AUTOMATED ENDORSEMENT TICKETING”; all of which are hereby incorporated by reference herein.
Typically, the digital video being submitted to the submission server 118 has a high resolution digital video encoding. For example, content providers, such as motion picture studios, might submit digital videos in a high resolution encoding, such as ProRes 422 (HQ). However, these video files having the high resolution encoding are very large, e.g., on the order of several hundreds of gigabytes for a feature length movies. Hence, since distribution of media items by the media distribution system 100 is over the data network 106 to clients 104, 110 or 114 which often limited-display capabilities, the submission server 118 can further operate to produce at least one an alternative video file in another video encoding more suitable for data transmission and/or lower resolution devices. In one embodiment, the submission server 118 can operates to transcode the submitted video content from the high resolution format to a lower resolution format that is more compact, which can be referred to as a compact format. As an example, AVC1 video encoding (also known as H.264 encoding) is a popular compact format, which may be suitable for distribution over bandwidth limited networks, and for display on handheld media players, such as the iPod™ available from Apple Inc., or on networked set-top boxes, such as the AppleTV™ available from Apple Inc.
The client review program 116 is an application program (e.g., software application) that operates on the third client 114, which is a computing device. The client review program 116 can be used by an agent when reviewing digital video, such as the transcoded video content, for video defects. In the case of transcoding, the act of transcoding can produce defects, referred to as transcoding artifacts. These defects can be present in one or more video segments of the transcoded video content (i.e., compact format). The agent can record those video defects that are perceived in an electronic file.
The media distribution system 100 may advantageously provide for online review of digital video content, as submitted or as encoded (e.g., transcoded). Typically, the review is performed manually by an agent. In an alternative embodiment, the digital video distribution system 100, such as the submission server 118, may emulate an agent to provide fully automated objective review of objective characteristics of transcoding artifacts, for example, including (but not limited to) examination of computed Peak Signal to Noise Ratios (PSNR). Accordingly, some of the objective review may be automated in software to compare at least some of the objective characteristics of the digital video content against objective standards or policies.
Besides any objective review (i.e., computerized review), the media distribution system normally provides for online aesthetic review (i.e., subjective review) of the digital video content (typically in the compact file) to identify defects, such as transcoding defects. For example, with the client review program 116, an agent can playback and observe video appearance of the digital video content as well as playback and listen to the corresponding sound track. Creation of an electronic record of the transcoding artifacts for each of the identified segments can be facilitated by the client review program 116. For example, based on the agent's review of the resulting compact format, the video segments having the transcoding artifacts can be identified, and respective start and stop times surrounding a particular identified defect can be recorded in an electronic record.
As will be discussed in greater detail subsequently herein, the invention provides for convenient and efficient assessment of video defects, such as transcoding artifacts. In one embodiment, the submission server 118 can operate to facilitate video review and approval by automatically assembling video clips of particular segments having potential defects into a compact playable file. In one embodiment, an agent (reviewer) can examine the video to identify perceived defects, the perceived defects can then be documents in an electronic record, and then the appropriate video clips can be automatically assembled. Assessment of video defects, such as transcoding artifacts, can for example be characterized by using ITU-R BT.500-11 [Subjective Video Quality Assessment of Motion Pictures].
As mentioned previously, the digital video encoding of the submitted video content is typically very large. For example, feature length movies encoded in ProRes 422 (HQ) may be as large as approximately 100-200 gigabytes (GBs) or more. Accordingly, this very large size may otherwise have caused practical difficulties in demonstrating appearance of the transcoding artifacts in the compact format, relative to appearance of the submitted video content. However, in one embodiment, the invention can advantageously limits these difficulties by providing a convenient playable highlights video, displaying segments of the compact format together with segments of the submitted video content, for direct side-by-side comparison.
The interface display illustrated in
Through use of the interface display for an electronic record 200, data for an electronic record can entered, reviewed and/or modified by an agent (e.g., media review person). For example, the agent may add an explanation, justification or discussion of each transcoding artifact. In particular, the agent can add annotations or numbers characterizing severity of the transcoding artifacts. Examples of severity number ratings and annotations characterizing severity shown in
As shown in
In one embodiment, the interface display of an electronic record 200 include a “View” control option to allow the agent to initiate inspection of the compact format (encoded video). For example, the agent can initiate player software to play the compact format of the video content by selecting the “View” control option, which is shown adjacent to the legend “Inspect Video File”.
In one embodiment, the player software can also play the audio sound track synchronously with playing the video content. Accordingly, the agent can also review any audio defects, which are contemporaneous with one or more video segments of the compact format, and can identify the audio segments having the audio defects. As shown in
Similarly, as shown in
In one embodiment, after the player software has played through to the end of the compact format encoding of the submitted video content and the agent has completed reviewing and identifying all of the transcoding artifacts using the interface display shown in
In accordance with one embodiment of the invention, submitted digital video content has an initial data size, and video clips of the identified segments are automatically assembled into the compact playable file. The compact playable file has a smaller data size, which is substantially smaller than approximately one tenth (or preferably smaller than approximately one hundredth) of the initial data size of the submitted digital video content. For example, in one embodiment the compact playable file is relatively small, typically less than approximately one gigabyte. As pointed out previously, the file size for the submitted content is typically very large. For example, feature length movies encoded in ProRes 422 (HQ) may be as large as approximately 100-200 gigabytes (GBs) or more.
This very large size may otherwise have caused practical difficulties in reviewing and/or demonstrating defects (e.g., transcoding artifacts) in the compact format, relative to appearance of the submitted video content. However, the invention may advantageously limit these difficulties by providing convenient highlights video in a compact playable file. The highlights video can display segments of the compact format together with segments of the submitted video content for direct “side-by-side” comparison. The size of a compact playable file can also be dramatically smaller that the size of a feature length movie. In one embodiment, the size of a compact playable file can be proportional to the amount of time being covered by the video clips to present the defects. For example, if the video clips to present the defects in a sixty minute movie are two minutes in length, then the compact playable file will be 1/30th of the size of the full movie.
The automatic assembly process 300 can starts when an agent requests a compact playable file (or defect review video). The compact playable file can generally result from assembling video clips of identified segments. Start and stop time codes of can be parsed 302 from an electronic record. The electronic record contains information on defects of a video that has been reviewed, such as by an agent. As discussed herein, the video is a video encoding and the defects pertain to at least transcoding artifacts. Using the start and stop time codes, video segments having the transcoding artifacts can be identified.
Video clips of the identified segments are obtained 306 from the compact format. Here, the video portions of the compact format corresponding to the identified segments can be extracted from the compact format. The time codes obtained by the parsing 302 serve to specify the desired video portions from the compact portion. Similarly, video clips of the identified segments are also obtained 308 from the submitted video content. The submitted video content has time codes and an original natural timeline. When the submitted video content is transcoded to form the compact format, the compact format maintains the same (matching) time codes and the same (matching) original natural timeline as the submitted video content. Accordingly, the same (matching) time codes can be used to identify and retrieve corresponding video clips from the submitted video content.
In accordance with one embodiment, the identified segments of the compact format and corresponding identified segments of the submitted video content can be packaged into the compact playable file being assembled. Time codes of the identified segments of the compact format are paired with substantially matching time codes of the identified segments of the submitted video content. For example, initial time codes (start and stop) are parsed from the electronic records, and are used to identify an initial video segment of the compact format having a particular transcoding artifact. An initial video clip of the identified segment is edited from the compact format. Similarly, a corresponding initial video clip is edited from the submitted video content.
The automatic assembly process 300 continues in
In one embodiment, the automatic assembly process 300 provides for the reduced data size of the highlights video (while still retaining the original, natural timeline) by using filler content. The filler content is normally blank or otherwise contains low data complexity. As mentioned previously, the submitted digital video content and the compact format have a common natural timeline. Accordingly, it should be understood that the natural timeline can be retained by advantageously using appropriately time matching lengths of filler content between the obtained video clips of the compact format and also between the corresponding video clips of the submitted video content, as the highlights video is assembled and packaged into the compact playable file. As shown in
The compact playable file can also have a text track added 316. The text track can chapters to the compact playable file. Each chapter can specify a start point (and perhaps an end point) for each of the video clips so as to provide convenient skipping to any of the start points of the video clips, thereby skipping over any filler content during playback of the compact playable file. The text track can alternatively or additionally include text from the previously mentioned notes, annotations or severity indication within the electronic record. The video clips previously obtained 306 and 308 are added 318 to the compact playable file. As a result, the compact playable file can include (i) a first video track containing the obtained video clips of the compact format as well as the appropriate fillers, and (ii) a second video track containing the obtained video clips of the submitted content as well as the appropriate fillers.
The process 300 continues in
Accordingly, it should be understood that the automatic assembly process 300 provides for obtaining video clips of a set of the identified segments of the compact format, and for obtaining video clips of identified segments of the submitted video content, where each of the identified segments of the submitted video content can corresponds to a respective member of the set of identified segments of the compact format. The automatic assembly process 300 can automatically arrange the video clips of the identified segments in a selected, chronological ordering. More specifically, video clips of the identified segments of the compact format can be automatically arranged in a selected chronological ordering, and video clips of the identified segments of the submitted video content can be automatically arranged in the selected chronological ordering, where each of the identified segments of the submitted video content corresponds to a respective member of the set of identified segments of the compact format.
The video tracks are automatically assembled from the sequential arrangement of the video clips of the identified segments into the compact playable file, which provides a highlights video. Within the compact playable file, the identified segments of the compact format and corresponding identified segments of the submitted video content can be automatically arranged in parallel chronological order.
In one embodiment, the compact playable file can be considered a container file. For example, in one embodiment, four tracks are packaged together into a compact playable QuickTime container file, along with related media atoms and media data atoms. A helpful reference for technical details about QuickTime is found in the comprehensive document entitled “QuickTime File Format Specification,” dated Sep. 4, 2007 and available from Apple Inc. In one embodiment: Track 1 is an AVC1 video track encoding, which has been referenced previously as the first track containing video clips from the compact format; Track 2 is a sound track in MPEG4 Audio format encoding; Track 3 is a ProRes 422 (HQ) video track encoding, which has been referenced previously as the second track containing video clips from the submitted video content; and Track 4 is the previously referenced text track. These four tracks along with a header are further illustrated in
In one embodiment, the submitted video content has the ProRes 422 (HQ) encoding has a display resolution of 1920 by 1080. The compact format in the AVC1 encoding has a display resolution of 640 by 480, which is lower than the 1920 by 1080 resolution of the submitted video content. In the playable file, instruction parameters can be included in the ProRes 422 (HQ) video track (or elsewhere in the playable file) for automatically scaling down the resolution of the video clips of the submitted video content during playback, so as to substantially match playback display of the lower video resolution of the video clips of the compact format. Hence, when both tracks are displayed in simultaneous adjacent playback display regions of the same size as shown in
Appendix A provides a more detailed textual description of characteristics and format of a compact playable file illustrated in
The various aspects, features, embodiments or implementations of the invention described above can be used alone or in various combinations.
The invention is preferably implemented by software, hardware, or a combination of hardware and software. The invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium generally include read-only memory and random-access memory. More specific examples of computer readable medium are tangible and include Flash memory, EEPROM memory, memory card, CD-ROM, DVD, hard drive, magnetic tape, and optical data storage device. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
The advantages of the invention are numerous. Different embodiments or implementations may, but need not, yield one or more of the following advantages. One advantage is that the invention provides increased convenience and efficiency by automating assessment of media defects, such as transcoding artifacts. Another advantage is that the invention facilitates sharing a reviewer's assessments concerning a video using a highlights video. The highlights video has a reduced file size that make it efficient for not only playback but also transmission over a network. Another advantage is that the invention provides an easily understandable visual experience of the assessment of transcoding artifacts. For example, the original natural timeline of the submitted video can be retained, and the appearance of the transcoding artifacts in the compact format can be displayed relative to the appearance of the submitted video content.
The many features and advantages of the present invention are apparent from the written description. Further, since numerous modifications and changes will readily occur to those skilled in the art, the invention should not be limited to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as failing within the scope of the invention.