Image reproduction apparatus and method for simultaneously displaying multiple moving-image thumbnails

Information

  • Patent Grant
  • 10891032
  • Patent Number
    10,891,032
  • Date Filed
    Wednesday, April 11, 2018
    6 years ago
  • Date Issued
    Tuesday, January 12, 2021
    4 years ago
Abstract
An image reproduction method and apparatus are provided for simultaneously displaying multiple moving-image thumbnails. A controller of the image reproduction apparatus generates a moving-image contents list including moving-image thumbnails corresponding to one or more moving-image contents, when a request for displaying the moving-image contents list is input. A multi-image reproducer of the image reproduction apparatus simultaneously reproduces the moving-image thumbnails. The moving-image contents list including the simultaneously reproduced moving-image thumbnails is displayed at a display unit of the image reproduction apparatus.
Description
BACKGROUND OF THE INVENTION
1. Field of the Invention

The present invention relates generally to an image reproduction apparatus and method, and more particularly, to an image reproduction apparatus and method for simultaneously reproducing and displaying respective moving-image thumbnails included in a moving-image thumbnail list for image reproduction when the moving-image thumbnail list is displayed.


2. Description of the Related Art

Generally, if an image reproduction request is input, a terminal capable of reproducing image data generates a list of one or more images stored in a memory of the terminal. The image list is displayed on a screen, and an image selected from the image list is reproduced and displayed on the screen. The terminal receives a list of images stored in an image streaming providing server, which provides an image streaming service, from the image streaming providing server, and displays the received image list on the screen.


When displaying the image list, the terminal displays image reproduction information, such as, for example, a representative thumbnail image presenting a particular scene of a corresponding image, a title of the image, and a reproduction time of the image, together on the image list. The terminal re-sizes a particular frame of the image into a preset image size, sets the re-sized frame to a representative thumbnail image, and displays the representative thumbnail image on the image list.


Thereafter, if a selection for reproducing a particular image of the image list is input, the terminal reproduces and displays the selected image on the screen.


As such, when a conventional terminal displays an image list for image reproduction, image reproduction information, such as, for example, a representative thumbnail image, an image title, and an image reproduction time, is displayed on the image list.


However, as high-resolution video generation and reproduction becomes easier to achieve on a terminal, and as a storage space of the terminal increases, the number and volume of moving-image contents that can be stored in the terminal increase. In addition, with the development of network technologies, the amount of personally created contents also increases.


Since a user may not accurately remember a previously viewed image when desiring to view the image again, it may be difficult for the user to find desired moving-image contents using only a title and a representative thumbnail image of the moving-image contents.


Moreover, the user may need to reproduce one or more moving-image contents several times to find the desired moving-image contents.


SUMMARY OF THE INVENTION

The present invention has been made to address at least the above problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention provides an image reproduction apparatus and method for simultaneously reproducing and displaying respective moving-image thumbnails included in a moving-image list to allow a user to easily find and select desired moving-image contents.


According to an aspect of the present invention, an electronic device is provided that includes a memory for storing instructions and a processor configured to execute the instructions to at least store a plurality of video contents in the memory, based on receiving a first user request, display a plurality of video thumbnails for the plurality of video contents on a display of the electronic device, wherein the plurality of video thumbnails are respectively generated from the plurality of video contents, and a video thumbnail includes a plurality of image frames to be sequentially displayed, based on a user input for selecting one of the displayed plurality of video thumbnails, reproduce a video content corresponding to the selected video thumbnail, based on a user input for selecting one of the plurality of video contents, display a plurality of section-based video thumbnails for the selected video content on the display, wherein the plurality of section-based video thumbnails are respectively generated from different portions of the selected video content, and each of the plurality of section-based video thumbnails includes a plurality of image frames to be sequentially displayed, and based on a user input for selecting one of the displayed plurality of section-based video thumbnails, reproduce a portion of the video content corresponding to the selected section-based video thumbnail.


According to another aspect of the present invention, a method is provided for displaying video thumbnails at an electronic device, with the method including, based on receiving a first user request, displaying a plurality of video thumbnails for a plurality of video contents on a display of the electronic device, wherein the plurality of video thumbnails are respectively generated from the plurality of video contents, and a video thumbnail includes a plurality of image frames to be sequentially displayed; based on a user input for selecting one of the displayed plurality of video thumbnails, reproducing a video content corresponding to the selected video thumbnail; based on a user input for selecting one of the plurality of video contents, displaying a plurality of section-based video thumbnails for the selected video content on the display, wherein the plurality of section-based video thumbnails are respectively generated from different portions of the selected video content, and each of the plurality of section-based video thumbnails includes a plurality of image frames to be sequentially displayed; and based on a user input for selecting one of the displayed plurality of section-based video thumbnails, reproducing a portion of the video content corresponding to the selected section-based video thumbnail.


According to a further aspect of the present invention, a non-transitory computer readable storage medium with instructions stored thereon is provided, with the instructions executable by at least one processor of an electronic device to cause the at least one processor to control: based on receiving a first user request, displaying a plurality of video thumbnails for a plurality of video contents on a display of the electronic device, wherein the plurality of video thumbnails are respectively generated from the plurality of video contents, and a video thumbnail includes a plurality of image frames to be sequentially displayed; based on a user input for selecting one of the displayed plurality of video thumbnails, reproducing a video content corresponding to the selected video thumbnail; based on a user input for selecting one of the plurality of video contents, displaying a plurality of section-based video thumbnails for the selected video content on the display, wherein the plurality of section-based video thumbnails are respectively generated from different portions of the selected video content, and each of the plurality of section-based video thumbnails includes a plurality of image frames to be sequentially displayed; and based on a user input for selecting one of the displayed plurality of section-based video thumbnails, reproducing a portion of the video content corresponding to the selected section-based video thumbnail.





BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of the present invention will be more apparent from the following detailed description when taken in conjunction with the accompanying drawings, in which:



FIG. 1 is a block diagram illustrating an image reproduction apparatus, according to an embodiment of the present invention;



FIG. 2 is a flowchart illustrating a process of reproducing an image by using a moving-image contents list including moving-image thumbnails, according to an embodiment of the present invention;



FIG. 3 is a flowchart illustrating a process of reproducing an image by using a section-based moving-image thumbnail list, according to an embodiment of the present invention;



FIG. 4 is a diagram illustrating a screen on which representative moving-image thumbnails are reproduced and displayed in moving-image contents list display region, according to an embodiment of the present invention;



FIG. 5 is a diagram illustrating a display screen including a moving-image contents list display region together with an image reproduction region, according to an embodiment of the present invention;



FIG. 6 is diagrams illustrating a process of reproducing an image by using a section-based moving-image thumbnail list, according to an embodiment of the present invention;



FIG. 7 is a diagram illustrating a process of generating a section-based moving-image thumbnail, according to an embodiment of the present invention; and



FIG. 8 is diagrams illustrating a process of reproducing and displaying moving-image thumbnails on a phonebook display region, according to an embodiment of the present invention.





DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION

Embodiments of the present invention are described in detail with reference to the accompanying drawings. The same or similar components may be designated by the same or similar reference numerals although they are illustrated in different drawings. Detailed descriptions of constructions or processes known in the art may be omitted to avoid obscuring the subject matter of the present invention.


Embodiments of the present invention determine whether representative video thumbnails for one or more video contents exist in response to an image reproduction request, and simultaneously reproduces and displays the representative video thumbnails corresponding to the one or more video contents if the representative video thumbnails exist, thus allowing a user to easily find desired video contents.



FIG. 1 is a block diagram illustrating an image reproduction apparatus, according to an embodiment of the present invention.


Referring to FIG. 1, the image reproduction apparatus includes a controller 10, an image converter 20, a multi-image reproducer 30, a storing unit 40, an input unit 50, and a display unit 60.


The controller 10 may include a Central Processing Unit (CPU), a Read Only Memory (ROM) having a control program for controlling the image reproduction apparatus, and a Random Access Memory (RAM) used as a memory region for storing a signal or data that is input from outside the image reproduction apparatus or an operation that is performed in the image reproduction apparatus. The CPU may include, for example, a single core, a dual core, a triple core, or a quad core, and the CPU, the ROM, and the RAM may be interconnected through an internal bus.


The controller 10 may control the image converter 20, the multi-image reproducer 30, the storing unit 40, the input unit 50, and the display unit 60.


The controller 10 generates a moving-image contents list including representative moving-image thumbnails corresponding to one or more moving-image contents stored in the storing unit 40, if a request for displaying the moving-image contents list for moving-image contents reproduction is input through the input unit 50. Thereafter, the controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the respective moving-image thumbnails, and the controller 10 displays the moving-image contents list including the reproduced one or more representative moving-image thumbnails through the display unit 60. The controller 10 controls the multi-image reproducer 30 to simultaneously or sequentially reproduce the respective moving-image thumbnails in an automatic manner without a user's selection or execution.


In order to generate one or more representative moving-image thumbnails in advance, the controller 10, according to an embodiment of the present invention, may control the image converter 20 to generate one or more representative moving-image thumbnails by converting one or more moving-image contents when the image reproduction apparatus is charged or is in a sleep mode.


In another embodiment of the present invention, the controller 10 determines whether there are representative moving-image thumbnails corresponding to one or more moving-image contents stored in the storing unit 40. A representative moving-image thumbnail is a moving image generated by converting a moving-image section, corresponding to a preset time point in moving-image contents, to a preset size. The moving-image thumbnail may be a moving image having a size of 320 pixels (width) by 240 pixels (length), and having a rate of 15 frames per second. The preset size is at least ⅕ or 1/10 smaller than a pixel size of original moving-image contents.


If there are representative moving image thumbnails corresponding to one or more moving-image contents, the controller 10 generates a moving-image contents list including the representative moving-image thumbnails corresponding to the one or more moving-image contents. The controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the respective moving-image thumbnails. The controller 10 displays the moving-image contents list, including the reproduced one or more representative moving-image thumbnails, through the display unit 60. The controller 10 may variously configure and display the moving-image contents list, including the one or more representative moving-image thumbnails, according to the screen size of the display unit 60 and the size of the representative moving-image thumbnails. For example, when displaying the moving-image contents list through the display unit 60, the controller 10 may further display image information, such as, for example, title, reproduction time, producer, creator, and description, of the moving-image contents, as well as the representative moving-image thumbnails.


If representative moving-image thumbnails corresponding to the one or more moving-image contents do not exist, the controller 10 controls the image converter 20 to generate representative moving-image thumbnails corresponding to the one or more moving-image contents. The controller 10 generates the moving-image contents list including the generated one or more representative moving-image thumbnails. The controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the one or more representative moving-image thumbnails included in the generated moving-image contents list. The controller 10 displays the moving-image contents list, including the reproduced one or more representative moving-image thumbnails, through the display unit 60. Specifically, the controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the one or more representative moving-image thumbnails, thus, allowing the user to view the representative moving-image thumbnails reproduced on the moving-image contents list and find desired moving-image contents.


Thereafter, if a selection of a representative moving-image thumbnail for reproducing particular moving-image contents is input through the input unit 50, the controller 10 reproduces the moving-image contents corresponding to the selected representative moving-image thumbnail and displays the moving-image contents through the display unit 60. The moving-image contents is a high-definition moving image, and may be moving image data having a size of 1920 pixels (width) by 1080 pixels (length), and having a rate of 30 frames per second.


If a request for displaying one or more section-based moving-image thumbnails corresponding to the moving-image contents is input through the input unit 50, the controller 10 determines whether there are one or more section-based moving-image thumbnails.


If there are one or more section-based moving-image thumbnails, the controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the one or more section-based moving-image thumbnails, and the controller 10 displays the reproduced one or more section-based moving-image thumbnails through the display unit 60.


If the one or more section-based moving-image thumbnails do not exist, the controller 10 divides moving-image contents into one or more moving-image sections, according to a preset condition. The controller 10 controls the image converter 20 to generate a moving-image thumbnail by converting a portion of each moving-image section. The preset condition includes feature information, such as, for example, time, face detection, facial expression detection, voice detection, and scene change. Thus, the controller 10 may divide the moving-image contents into moving-image sections, each of which corresponds to a preset time, or moving-image sections, each beginning with a moving-image frame having a detected face, facial expression, voice, or scene change. For example, the controller 10 may divide the moving-image contents into moving-image sections corresponding to every 5 minutes and convert moving image data corresponding to a preset time, for example, 20 seconds, in each moving-image section to generate one or more moving-image thumbnails.


Thereafter, the controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the one or more section-based moving-image thumbnails, and displays the reproduced one or more section-based moving-image thumbnails through the display unit 60.


If a selection of a particular moving-image thumbnail from the reproduced one or more section-based moving-image thumbnails is input through the input unit 50, the controller 10 reproduces moving-image contents of the moving-image section corresponding to the selected moving-image thumbnail, and displays the reproduced moving-image contents through the display unit 60.


To generate one or more section-based moving-image thumbnails in advance, the controller 10, according to an embodiment of the present invention, may control the image converter 20 to generate the one or more section-based moving-image thumbnails by converting the moving-image contents when the image reproduction apparatus is charged.


The image converter 20 generates moving-image thumbnails having a resolution, a file format, and a compression scheme desired by the user by converting moving-image contents of various resolutions, file formats, and compression schemes supported in the image reproduction apparatus, according to the performance of the image reproduction apparatus or a screen size of the display unit 60.


In particular, under control of the controller 10, the image converter 20 converts moving-image contents into a preset size in advance to generate representative moving-image thumbnails or one or more section-based moving-image thumbnails. The image converter 20 parses the moving-image contents to identify an extension type of the moving-image contents. The image converter 20 performs decoding by using a codec corresponding to the identified extension type, and resizes the decoded moving-image contents to a preset image size. The image converter 20 encodes the resized moving-image contents by using a codec suitable for a preset image size, and multiplexes the encoded moving-image contents to output the moving-image thumbnails. The image converter 20 may include a parser for parsing the extension type of the moving-image contents, a decoder for decoding the moving-image contents by using one or more codecs corresponding to the extension type, a resizer for resizing the size of the decoded moving-image contents, an encoder for encoding the resized moving-image contents by using the codec corresponding to the resized moving-image contents, and a multiplexer for multiplexing the encoded moving-image contents. For example, to convert moving-image contents having a size of 1920 pixels (width) by 1080 pixels (length) and a rate of 30 frames per second into a moving-image thumbnail having a size of 320 pixels (width) by 240 pixels (length) and a rate of 15 frames per second, the image converter 20 determines an extension type, such as, for example, AVI, MP4, WMV, FLV, and MKV, of the moving-image contents. If the moving-image contents have an extension type of AVI, the image converter 20 decodes the moving-image contents by using a codec such as, for example, Moving Picture Experts Group 4 (MPEG4)4, H.264, H.263, DivX3.11, wmv7.8, or vc1, and resizes the decoded moving-image contents from 1080p to Quarter Video Graphics Array (QVGA). Thereafter, the image converter 20 encodes the moving-image contents of QVGA into MPEG4 and multiplexes the encoded moving-image contents to MP4 to output the moving-image thumbnail. When converting the moving-image contents into a preset size, the image converter 20 maintains a preset ratio of width to length according to a resolution. For example, assuming that a ratio of a width to a length is 1.778 for moving-image contents having 1920 pixels (width) by 1080 pixels (length) and a ratio thereof is 1.333 for moving-image contents having 320 pixels (width) by 240 pixels (length), the image converter 20 may generate a moving-image thumbnail having 320 pixels (width) by 240 pixels (length) by converting the moving-image contents in such a way to maintain the width-to-length ratio of 1.333. If the moving-image contents are converted to generate the moving-image thumbnail smaller than 240 pixels (length), the image converter 20 may perform conversion in such a way to adjust the width and the length to maintain the width-to-length ratio of 1.333 and display the remaining space in black. If the moving-image contents are converted to generate the moving-image thumbnail larger than 320 pixels by 240 pixels, the image converter 20 may cut the size of an image frame into the moving-image thumbnail having 320 pixels (width) by 240 pixels (length) to maintain the width-to-length ratio of 1.333.


The multi-image reproducer 30 simultaneously reproduces one or more representative moving-image thumbnails or one or more section-based moving-image thumbnails, under control of the controller 10.


The storing unit 40 may store input/output signals or data to correspond to operations of the image converter 20, the multi-image reproducer 30, the input unit 50, and the display unit 60, under control of the controller 10. The storing unit 40 may store control programs and applications for control of the image reproduction apparatus or the controller 10.


The term “storing unit” includes the storing unit 40, the ROM or RAM included in the controller 10, or a memory card (for example, a Secure Digital (SD) card or a memory stick) mounted in the image reproduction apparatus. The storing unit 40 may include a non-volatile memory, a volatile memory, a Hard Disk Drive (HDD), or a Solid State Drive (SSD).


The input unit 50 may include a key input means including a plurality of keys for key input, a pointing input means for pointing input, such as, for example, a mouse, and a touch input means for touch input. The input unit 50 forwards an input signal received there through to the controller 10.


The display unit 60 may be embodied as a Liquid Crystal Display (LCD), and visually provides menus of a portable terminal, input data, function setting information, and various other information to the user. The display unit 60 outputs a booting screen, a standby screen, a display screen, a call screen, and other application execution screens of the portable terminal. In particular, the display unit 60 displays one or more representative moving-image thumbnails, or one or more section-based moving-image thumbnails reproduced by the multi-image reproducer 30.


As such, embodiments of the present invention simultaneously reproduce and display representative moving-image thumbnails corresponding to one or more moving-image contents in response to an image reproduction request, allowing the user to view the reproduced moving-image thumbnails and easily find desired moving-image contents.



FIG. 2 is a flowchart illustrating a process of reproducing an image by using a moving-image contents list including moving-image thumbnails, according to an embodiment of the present invention.


In step 200, the controller 10 executes an image reproduction function in response to a request for image reproduction.


In step 201, the controller 10 determines whether there are representative moving-image thumbnails corresponding to one or more moving-image contents stored in the storing unit 40.


If there are representative moving-image thumbnails corresponding to one or more moving-image contents, the controller 10 proceeds to step 203. If there are no representative moving-image thumbnails corresponding to one or more moving-image contents, the controller 10 proceeds to step 202 to control the image converter 20 to generate representative moving-image thumbnails corresponding to the one or more moving-image contents.


In step 203, the controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the representative moving-image thumbnails corresponding to the one or more moving-image contents, and displays the reproduced one or more representative moving-image thumbnails through the display unit 60.


In step 204, the controller 10 determines whether a selection of a representative moving-image thumbnail for reproducing moving-image contents is input. If the selection of a representative moving-image thumbnail is input, the controller 10 proceeds to step 205. If the selection of a representative moving-image thumbnail is not input, the controller 10 continuously repeats step 204 to determine whether the selection of a representative moving-image thumbnail is input.


In step 205, the controller 10 reproduces the moving-image contents corresponding to the selected representative moving-image thumbnail, and displays the reproduced moving-image contents through the display unit 60.



FIG. 3 is a flowchart illustrating a process of reproducing an image by using a section-based moving-image thumbnail list, according to an embodiment of the present invention.


In step 300, the controller 10 determines whether a request for displaying section-based moving-image thumbnails corresponding to the moving-image contents is input. If the request is input, the controller 10 proceeds to step 301. If the request is not input, the controller 10 continuously repeats step 300 to determine whether the request for displaying section-based moving-image thumbnails corresponding to the moving-image contents is input.


In step 301, the controller 10 determines whether there are one or more section-based moving-image thumbnails. If there are one or more section-based moving-image thumbnails, the controller 10 proceeds to step 303. If there are no section-based moving-image thumbnails, the controller 10 proceeds to step 302 to generate one or more section-based moving-image thumbnails. Specifically, the controller 10 divides moving-image contents into one or more moving-image sections according to a preset condition, as previously described, and controls the image converter 20 to generate a moving-image thumbnail by converting a portion of each moving-image section.


In step 303, the controller 10 controls the multi-image reproducer 30 to simultaneously reproduce the one or more section-based moving-image thumbnails and displays the reproduced one or more section-based moving-image thumbnails through the display unit 60.


In step 304, the controller 10 determines whether a selection of a moving-image thumbnail is input. If the selection of a moving-image thumbnail is input, the controller 10 proceeds to step 305. If the selection of a moving-image thumbnail is not input, the controller 10 continuously repeats step 304 to determine whether a selection of a moving-image thumbnail is input.


In step 305, the controller 10 reproduces moving-image contents of a moving-image section corresponding to the selected moving-image thumbnail, and displays the reproduced moving-image contents through the display unit 60.


Embodiments of the present invention simultaneously reproduce and display representative moving-image thumbnails corresponding to one or more moving-image contents in response to an image reproduction request, allowing the user to view the reproduced moving-image thumbnails and easily find desired moving-image contents.


As previously described, the controller 10, according to an embodiment of the present invention, reproduces representative moving-image thumbnails corresponding to one or more moving-image contents, and displays the reproduced representative moving-image thumbnails in response to an image reproduction request. The displayed representative moving-image thumbnails corresponding to the one or more moving-image contents may be as shown in FIG. 4 or 5.



FIG. 4 is a diagram illustrating a screen on which representative moving-image thumbnails are reproduced and displayed in moving-image contents list display region, according to an embodiment of the present invention.


As shown in FIG. 4, the controller 10 may display image information, such as, for example, title, reproduction time, producer, and creator, of moving-image contents, as well as representative moving-image thumbnails 400, 401, 402, 403, and 404 corresponding to one or more reproduced moving-image contents.



FIG. 5 is a diagram illustrating a screen on which a moving-image contents list display region is displayed together with an image reproduction region, according to an embodiment of the present invention.


As shown in FIG. 5, the controller 10 may display the full region of the display unit 60, which is divided into a first region 500 for reproducing moving-image contents and a second region 510 for displaying representative video thumbnails corresponding to one or more moving-image contents.



FIG. 6 is diagrams illustrating a process of reproducing an image by using a section-based moving-image thumbnail list, according to an embodiment of the present invention.


If an image reproduction request is input through the input unit 50, the controller 10 simultaneously reproduces and displays representative moving-image thumbnails corresponding to one or more moving-image contents, as shown on a screen 600. If one or more representative moving-image thumbnails have already been generated, the controller 10 may directly display the generated one or more representative moving-image thumbnails. If one or more representative moving-image thumbnails have not yet been generated, the controller 10 may generate representative moving-image thumbnails by converting one or more moving-image contents into a preset size. The controller may then sequentially display the generated representative moving-image thumbnails on the screen on a first-generated, first-displayed basis. The controller 10, when displaying one or more representative moving-image thumbnails through the display unit 60, configures and displays them as one list. For example, the controller 10 may configure and display a moving-image thumbnail list including one or more representative moving-image thumbnails as shown in the screen 600. The controller 10 may configure and display a moving-image thumbnail list, including image information regarding moving-image contents, as well as one or more representative moving-image thumbnails, as shown in FIG. 4.


If a selection of a representative moving-image thumbnail is input through the input unit 50 to reproduce particular moving-image contents, the controller 10 reproduces and displays moving-image contents corresponding to the selected representative moving-image thumbnail, as shown on a screen 610.


If a request for displaying one or more section-based moving-image thumbnails corresponding to the moving-image contents is input through the input unit 50, the controller 10 determines whether there are one or more section-based moving-image thumbnails. If there are one or more section-based moving-image thumbnails, the controller 10 simultaneously reproduces and displays the one or more section-based moving-image thumbnails on the screen, as shown on a screen 620. The controller 10 may configure a moving-image thumbnail list, including one or more section-based moving-image thumbnails, and display the moving-image thumbnail list on the screen. If one or more section-based moving-image thumbnails do not exist, the controller 10 divides moving-image contents into one or more moving-image sections according to a preset condition, and generates a video thumbnail by converting a portion of each video section. The controller 10 simultaneously reproduces and displays the one or more section-based moving-image thumbnails on the screen.


If a selection of a particular moving-image thumbnail from the reproduced one or more section-based moving-image thumbnails is input through the input unit 50, the controller 10 reproduces and displays moving-image contents of a moving-image section corresponding to the selected moving-image thumbnail, as shown on a screen 630. For example, if a video thumbnail corresponding to a moving-image section whose reproduction start time is 3 (minutes):20 (seconds) is selected, the controller 10 may start reproduction from a portion of moving-image contents corresponding to a reproduction start time of 3:20.



FIG. 7 is a diagram illustrating a process of generating section-based moving-image thumbnails, according to an embodiment of the present invention.


If a request for displaying one or more section-based moving-image thumbnails is input through the input unit 50, the controller 10, according to an embodiment of the present invention, determines whether one or more section-based moving-image thumbnails exist. When one or more section-based moving-image thumbnails do not exist, the controller 10 divides moving-image contents into one or more moving-image sections according to a preset condition, and generates a moving-image thumbnail by converting a portion of each moving-image section. The preset condition may include feature information such as, for example, time, face detection, motion vector detection, facial expression detection, voice detection, and scene change.


For example, if the moving-image contents are divided into a total of four sections, that is, a first section, a second section, a third section, and a fourth section, according to a preset condition as shown in FIG. 7, the controller 10 generates a first moving-image thumbnail 700 corresponding to a first section by converting a portion of moving-image contents of the first section, which corresponds to a preset time in a reproduction time of the moving-image contents of the first section, into a preset size. In the same manner, the controller 10 generates a second moving-image thumbnail 710 corresponding to a second section, a third moving-image thumbnail 720 corresponding to a third section, and a fourth moving-image thumbnail 730 corresponding to a fourth section.


Thereafter, the controller 10 may generate a moving-image thumbnail list including the first moving-image thumbnail 700 corresponding to the first section, the second moving-image thumbnail 710 corresponding to the second section, the third moving-image thumbnail 720 corresponding to the third section, and the fourth moving-image thumbnail 730 corresponding to the fourth section and display the moving-image thumbnail list on the screen.


Thus, the user may immediately search for and view moving-image contents corresponding to a desired moving-image section.



FIG. 8 shows diagrams illustrating a process of reproducing and displaying a moving-image thumbnail on a phonebook, according to an embodiment of the present invention.


Embodiments of the present invention may be applied to a function or application, such as, for example, a phonebook, for which an image thumbnail may be displayed, as well as a function for reproducing moving-image contents.


For example, if the user desires to generate profile information, such as a phone number, of a particular person on the phonebook, embodiments of the present invention may provide a function for registering an image thumbnail or a moving-image thumbnail for the particular person. In this way, the user may register an image thumbnail or a moving-image thumbnail by capturing a still image or a moving image for the particular person or using a previously stored still image or moving image.


Thereafter, if a request for executing the phonebook is input through the input unit 50, as shown in FIG. 8, the controller 10 may simultaneously reproduce and display moving-image thumbnails 801, 802, and 803 corresponding to phone number items, together with a stored phonebook list, as shown on a screen 800.


If a selection for displaying detailed items, such as, for example, a name, a phone number, a home address, and an e-mail address, of a phone number item on the phonebook list is input through the input unit 50, the controller 10 may configure a detailed item screen corresponding to the selected phone number item and display the detailed item screen, as shown on a screen 810. The controller 10 may reproduce and display moving-image contents 811 corresponding to a moving-image thumbnail, which is previously stored corresponding to the phone number item, on the detailed item screen.


The embodiments of the present invention can be implemented with hardware, software, or a combination of hardware and software. Such arbitrary software may be stored, whether or not erasable or re-recordable, in a volatile or non-volatile storage such as a ROM; a memory such as a RAM, a memory chip, a device, or an integrated circuit; and an optically or magnetically recordable and machine (e.g., computer)-readable storage medium such as a Compact Disc (CD), a Digital Versatile Disk (DVD), a magnetic disk, or a magnetic tape. The image reproduction method, according to embodiments of the present invention, may be implemented by a computer or a portable terminal that includes a controller and a memory. The memory is an example of a machine-readable storage medium that is suitable for storing a program or programs including instructions for implementing embodiments of the present invention. Therefore, embodiments of the present invention include a program including codes for implementing an apparatus or method claimed in an arbitrary claim and a machine-readable storage medium for storing such a program. The program may be electronically transferred through an arbitrary medium, such as a communication signal delivered through wired or wireless connection, and embodiments of the present invention properly include equivalents thereof.


The image reproduction apparatus may receive and store the program from a program providing device connected in a wired or wireless manner. The program providing device may include a memory for storing a program including instructions for instructing the image reproduction apparatus to execute a preset image reproduction method, information necessary for the image reproduction method, a communication unit for performing wired or wireless communication with the image reproduction apparatus, and a controller for transmitting a corresponding program to the image reproduction apparatus at the request of the image reproduction apparatus or automatically.


Embodiments of the present invention simultaneously reproduce and display representative moving-image thumbnails corresponding to one or more moving-image contents in response to a moving-image reproduction request, allowing the user to view the reproduced moving-image thumbnails and easily search for desired moving-image contents.


Moreover, since section-based moving-image thumbnails corresponding to moving-image contents are simultaneously reproduced and displayed, the user may view section-based moving-image thumbnails of particular moving-image contents and directly move to and view a desired moving-image section.


While the present invention has been shown and described with reference to certain embodiments thereof, it will be understood by those of skill in the art that various changes in form and detail may be made therein without departing from the scope of the present invention. Therefore, the scope of the present invention is not limited to the disclosed embodiments, and it should be defined by the scope of the following claims and equivalents thereof.

Claims
  • 1. An electronic device for displaying video thumbnails, the electronic device comprising: a memory for storing instructions; anda processor configured to execute the instructions to at least: store a plurality of video contents including a first video content and a second video content in the memory,based on receiving a first user request, display a plurality of video thumbnails including a first video thumbnail and a second video thumbnail for the plurality of video contents on a display of the electronic device, wherein the plurality of video thumbnails are respectively generated from the plurality of video contents, and the first video thumbnail and the second video thumbnail respectively include a plurality of image frames to be sequentially displayed,based on a user input for selecting the first video thumbnail of the displayed plurality of video thumbnails, reproduce the first video content corresponding to the selected first video thumbnail,receive a user input for displaying a plurality of section-based video thumbnails corresponding to the first video content while reproducing the first video content,based on the plurality of section-based video thumbnails corresponding to the first video content not existing, divide the first video content into moving-image sections and generate the plurality of section-based video thumbnails corresponding to the moving-image sections by converting each of the moving-image sections into a moving-image content, wherein each of the plurality of section-based video thumbnails includes a plurality of image frames to be sequentially displayed,display the plurality of section-based video thumbnails corresponding to the first video content on the display, andbased on a user input for selecting one of the displayed plurality of section-based video thumbnails corresponding to the first video content, reproduce a portion of the first video content corresponding to the selected section-based video thumbnail.
  • 2. The electronic device of claim 1, wherein the processor is further configured to execute the instructions to perform at least one of: simultaneously reproducing the plurality of video thumbnails while the plurality of video thumbnails are displayed on the display, andsimultaneously reproducing the plurality of section-based video thumbnails while the plurality of section-based video thumbnails are displayed on the display.
  • 3. The electronic device of claim 1, wherein each of the plurality of video thumbnails for the plurality of video contents has a size smaller than a size of a corresponding video content.
  • 4. The electronic device of claim 1, wherein the first video content corresponding to the first video thumbnail is displayed on a first area of the display while the plurality of video thumbnails are displayed on a second area of the display.
  • 5. The electronic device of claim 4, wherein the processor is further configured to execute the instructions to perform one of: generating a video content list including the plurality of video thumbnails,dividing the second area into a plurality of regions, anddisplaying each of the plurality of video thumbnails on each of the plurality of regions.
  • 6. The electronic device of claim 5, wherein the video content list further includes a title of a corresponding video content, a reproduction time of the corresponding video content, a producer of the corresponding video content, a creator of the corresponding video content, or a description of the corresponding video content.
  • 7. The electronic device of claim 1, wherein different portions of the first video content are respective video sections into which the first video content is divided according to a preset condition, and wherein the preset condition comprises at least one of a motion detection, a face detection, a facial expression detection, a voice detection, and a scene change.
  • 8. The electronic device of claim 7, wherein the processor is further configured to execute the instructions to perform: generating the plurality of section-based video thumbnails by converting the different portions of the first video content into the plurality of section-based video thumbnails such that each of the plurality of section-based video thumbnails has a resolution or a file format selected by the user.
  • 9. The electronic device of claim 1, wherein the plurality of video thumbnails are generated while the electronic device is in a sleep mode or is charging.
  • 10. A method for displaying video thumbnails by an electronic device, the method comprising: based on receiving a first user request, displaying a plurality of video thumbnails including a first video thumbnail and a second video thumbnail for a plurality of video contents including a first video content and a second video content on a display of the electronic device, wherein the plurality of video thumbnails are respectively generated from the plurality of video contents, and the first video thumbnail and the second video thumbnail respectively include a plurality of image frames to be sequentially displayed;based on a user input for selecting the first video thumbnail of the displayed plurality of video thumbnails, reproducing the first video content corresponding to the selected first video thumbnail;receiving a user input for displaying a plurality of section-based video thumbnails corresponding to the first video content while reproducing the first video content,based on the plurality of section-based video thumbnails corresponding to the first video content not existing, dividing the first video content into moving-image sections and generating the plurality of section-based video thumbnails corresponding to the moving-image sections by converting each of the moving-image sections into a moving-image content, wherein each of the plurality of section-based video thumbnails includes a plurality of image frames to be sequentially displayed,displaying the plurality of section-based video thumbnails corresponding to the first video content on the display; andbased on a user input for selecting one of the displayed plurality of section-based video thumbnails corresponding to the first video content, reproducing a portion of the first video content corresponding to the selected section-based video thumbnail.
  • 11. The method of claim 10, further comprising at least one of: simultaneously reproducing the plurality of video thumbnails while the plurality of video thumbnails are displayed on the display; andsimultaneously reproducing the plurality of section-based video thumbnails while the plurality of section-based video thumbnails are displayed on the display.
  • 12. The method of claim 10, wherein each of the plurality of video thumbnails for the plurality of video contents has a size smaller than a size of a corresponding video content.
  • 13. The method of claim 10, wherein the first video content corresponding to the first video thumbnail is displayed on a first area of the display while the plurality of video thumbnails are displayed on a second area of the display.
  • 14. The method of claim 13, further comprising: generating a video content list including the plurality of video thumbnails;dividing the second area into a plurality of regions; anddisplaying each of the plurality of video thumbnails on each of the plurality of regions.
  • 15. The method of claim 14, wherein the video content list further includes a title of a corresponding video content, a reproduction time of the corresponding video content, a producer of the corresponding video content, a creator of the corresponding video content, or a description of the corresponding video content.
  • 16. The method of claim 10, wherein different portions of the first video content are respectively video sections into which the first video content is divided according to a preset condition, and the preset condition comprises at least one of a motion detection, a face detection, a facial expression detection, a voice detection, and a scene change.
  • 17. The method of claim 16, further comprising: generating the plurality of section-based video thumbnails by converting the different portions of the first video content into the plurality of section-based video thumbnails such that each of the plurality of section-based video thumbnails has a resolution or a file format selected by the user.
  • 18. The method of claim 10, wherein the plurality of video thumbnails are generated while the electronic device is in a sleep mode or is charging.
  • 19. A non-transitory computer readable storage medium with instructions stored thereon, the instructions executable by at least one processor of an electronic device to cause the at least one processor to control: based on receiving a first user request, displaying a plurality of video thumbnails including a first video thumbnail and a second video thumbnail for a plurality of video contents including a first video content and a second video content on a display of the electronic device, wherein the plurality of video thumbnails are respectively generated from the plurality of video contents, and the first video thumbnail and the second video thumbnail respectively include a plurality of image frames to be sequentially displayed;based on a user input for selecting the first video thumbnail of the displayed plurality of video thumbnails, reproducing the first video content corresponding to the selected first video thumbnail;receiving a user input for displaying a plurality of section-based video thumbnails corresponding to the first video content while reproducing the first video content,based on the plurality of section-based video thumbnails corresponding to the first video content not existing, dividing the first video content into moving-image sections and generating the plurality of section-based video thumbnails corresponding to the moving-image sections by converting each of the moving-image sections into a moving-image content, wherein each of the plurality of section-based video thumbnails includes a plurality of image frames to be sequentially displayed,displaying the plurality of section-based video thumbnails corresponding to the first video content on the display; andbased on a user input for selecting one of the displayed plurality of section-based video thumbnails corresponding to the first video content, reproducing a portion of the first video content corresponding to the selected section-based video thumbnail.
Priority Claims (1)
Number Date Country Kind
10-2012-0034342 Apr 2012 KR national
PRIORITY

This application is a Continuation of U.S. application Ser. No. 13/845,634 filed with the U.S. Patent and Trademark Office on Mar. 18, 2013, and claims priority under 35 U.S.C. § 119(a) to a Korean Patent Application filed in the Korean Intellectual Property Office on Apr. 3, 2012 and assigned Serial No. 10-2012-0034342, the entire disclosure of each of which is incorporated herein by reference.

US Referenced Citations (196)
Number Name Date Kind
5081668 Ito Jan 1992 A
5477337 Schuler Dec 1995 A
5524195 Clanton Jun 1996 A
5682326 Klingler Oct 1997 A
5884141 Inoue Mar 1999 A
6329787 Ito Dec 2001 B1
6370316 Yamada Apr 2002 B1
6408128 Abecassis Jun 2002 B1
6424357 Frulla Jul 2002 B1
6469711 Foreman Oct 2002 B2
6509716 Yi Jan 2003 B2
6553180 Kikuchi Apr 2003 B1
6788026 Muramatsu Sep 2004 B2
7053917 Kato May 2006 B2
7269290 Tojo Sep 2007 B2
7418673 Oh Aug 2008 B2
7456893 Son Nov 2008 B2
7463767 Kosako Dec 2008 B2
7600139 Ang Oct 2009 B2
7693391 Hamada Apr 2010 B2
7702014 Kellock Apr 2010 B1
7711184 Kosako May 2010 B2
7970257 Momosaki Jun 2011 B2
7986819 Momosaki Jul 2011 B2
7992097 Ubillos Aug 2011 B2
8004594 Oyama Aug 2011 B2
8078603 Chandratillake et al. Dec 2011 B1
8112711 Ackley Feb 2012 B2
8179391 Hong May 2012 B2
8234280 Mayle Jul 2012 B1
8331735 Lee Dec 2012 B2
8345998 Malik Jan 2013 B2
8462192 O'Connell Jun 2013 B2
8538961 Xu Sep 2013 B2
8571605 Park Oct 2013 B2
8572653 Kim Oct 2013 B2
8610821 Kawaguchi Dec 2013 B2
8621514 Yao Dec 2013 B2
8660403 Takahashi Feb 2014 B2
8666182 Kim Mar 2014 B2
8669735 Kim Mar 2014 B2
8671346 Hua Mar 2014 B2
8849093 Kato Sep 2014 B2
8896776 Kimura Nov 2014 B2
8942542 Sherrets Jan 2015 B1
9043838 Yao May 2015 B2
9047287 Kojima Jun 2015 B2
9063638 Schrock Jun 2015 B1
9106958 el Kaliouby et al. Aug 2015 B2
9124111 Ogawa Sep 2015 B2
9232136 Kawaguchi Jan 2016 B2
9237296 Jung Jan 2016 B2
9386328 Crane Jul 2016 B1
9514536 Rafati Dec 2016 B2
9704281 LeBlanc Jul 2017 B2
10372758 Berry Aug 2019 B2
20010040592 Foreman Nov 2001 A1
20020030744 Sawachi Mar 2002 A1
20020069218 Sull Jun 2002 A1
20020082059 Nariai Jun 2002 A1
20020094026 Edelson Jul 2002 A1
20020097984 Abecassis Jul 2002 A1
20020126135 Ball Sep 2002 A1
20020136301 Yoneyama Sep 2002 A1
20020166122 Kikinis Nov 2002 A1
20030016947 Ishii Jan 2003 A1
20030026434 Naruto Feb 2003 A1
20030076438 Ishimaru Apr 2003 A1
20030093790 Logan May 2003 A1
20030156824 Lu Aug 2003 A1
20030177496 Lee Sep 2003 A1
20030177503 Sull Sep 2003 A1
20030191756 Oh Oct 2003 A1
20040095396 Stavely May 2004 A1
20040125124 Kim Jul 2004 A1
20040181747 Hull Sep 2004 A1
20040189692 Tojo Sep 2004 A1
20040226048 Alpert Nov 2004 A1
20040240005 Kim Dec 2004 A1
20050010955 Elia Jan 2005 A1
20050012829 Tashiro Jan 2005 A1
20050063677 Kosako Mar 2005 A1
20050084232 Herberger Apr 2005 A1
20050086692 Dudkiewicz Apr 2005 A1
20050210414 Angiulo Sep 2005 A1
20060017840 Sawachi Jan 2006 A1
20060064716 Sull et al. Mar 2006 A1
20060174204 Jung Aug 2006 A1
20060210157 Agnihotri Sep 2006 A1
20070014534 Kim Jan 2007 A1
20070046698 Nam Mar 2007 A1
20070053657 Hamada Mar 2007 A1
20070064811 Zador Mar 2007 A1
20070101268 Hua May 2007 A1
20070103565 Xu May 2007 A1
20070201839 Murakami Aug 2007 A1
20070226527 Ang Sep 2007 A1
20070258703 Ohnishi Nov 2007 A1
20070260677 DeMarco Nov 2007 A1
20070294641 Rashkovskiy Dec 2007 A1
20080018666 Takeuchi Jan 2008 A1
20080032739 Hoodbhoy Feb 2008 A1
20080065697 Moriya Mar 2008 A1
20080152297 Ubillos Jun 2008 A1
20080155421 Ubillos Jun 2008 A1
20080155459 Ubillos Jun 2008 A1
20080192840 Hua Aug 2008 A1
20080193101 Agnihotri Aug 2008 A1
20080311894 Klein Dec 2008 A1
20090021592 Oyama Jan 2009 A1
20090033785 Fujinawa Feb 2009 A1
20090076909 Ioffe Mar 2009 A1
20090091586 Kosako Apr 2009 A1
20090097748 Lee Apr 2009 A1
20090100462 Park Apr 2009 A1
20090119583 Kihara May 2009 A1
20090142037 Mikawa Jun 2009 A1
20090150947 Soderstrom Jun 2009 A1
20090185745 Momosaki Jul 2009 A1
20090262074 Nasiri Oct 2009 A1
20090313545 Kim Dec 2009 A1
20090316017 Ichii Dec 2009 A1
20090319231 Beland Dec 2009 A1
20100064248 Lee Mar 2010 A1
20100070523 Delgo Mar 2010 A1
20100070876 Jain Mar 2010 A1
20100088645 Zhang Apr 2010 A1
20100104145 Momosaki Apr 2010 A1
20100123816 Koh May 2010 A1
20100134506 Ro et al. Jun 2010 A1
20100153882 Nakagawa Jun 2010 A1
20100177955 Simakov Jul 2010 A1
20100178024 Agarwal Jul 2010 A1
20100239176 Yamakado Sep 2010 A1
20100253792 Kawaguchi Oct 2010 A1
20100259562 Miyazawa Oct 2010 A1
20100262912 Cha Oct 2010 A1
20100287070 Santeufemia Nov 2010 A1
20100306800 Jung Dec 2010 A1
20100332959 Mitchell Dec 2010 A1
20110016395 Margulis Jan 2011 A1
20110022982 Takaoka Jan 2011 A1
20110058222 Nomoto Mar 2011 A1
20110107220 Perlman May 2011 A1
20110134257 Kojima Jun 2011 A1
20110138420 Sanford Jun 2011 A1
20110166824 Haisty Jul 2011 A1
20110170029 Kimura Jul 2011 A1
20110238754 Dasilva Sep 2011 A1
20110252447 Suzuki et al. Oct 2011 A1
20110261293 Kimura Oct 2011 A1
20110271304 Loretan et al. Nov 2011 A1
20110273540 Lee et al. Nov 2011 A1
20110289108 Bhandari Nov 2011 A1
20110321095 Yao et al. Dec 2011 A1
20120020643 Kato Jan 2012 A1
20120039534 Malik Feb 2012 A1
20120054794 Kim Mar 2012 A1
20120094720 Choi Apr 2012 A1
20120106925 Dirik May 2012 A1
20120127282 Hwangbo May 2012 A1
20120128318 Yamaguchi May 2012 A1
20120139945 Choi Jun 2012 A1
20120162249 Tsuda Jun 2012 A1
20120216148 Takahashi Aug 2012 A1
20120249907 Kimura Oct 2012 A1
20120276954 Kowalsky Nov 2012 A1
20120294583 Kosaka Nov 2012 A1
20120331505 Chun Dec 2012 A1
20130019263 Ferren Jan 2013 A1
20130024758 Darby Jan 2013 A1
20130070143 Jang Mar 2013 A1
20130093786 Tanabe Apr 2013 A1
20130166587 Berry Jun 2013 A1
20130195186 Yu Aug 2013 A1
20130266066 Goel Oct 2013 A1
20130279815 Xu Oct 2013 A1
20130305190 Ahn Nov 2013 A1
20130316763 Kader Nov 2013 A1
20130318443 Bachman Nov 2013 A1
20140047350 Kim Feb 2014 A1
20140098886 Crenshaw Apr 2014 A1
20140108585 Barton Apr 2014 A1
20140109140 Yao Apr 2014 A1
20140115441 Badoiu Apr 2014 A1
20140115534 Yuan Apr 2014 A1
20140289629 Rossmann Sep 2014 A1
20140348248 Ihara Nov 2014 A1
20150015906 Aiba Jan 2015 A1
20150103008 Lee Apr 2015 A1
20150234861 Kojima Aug 2015 A1
20150324096 LeBlanc Nov 2015 A1
20160098241 Lim Apr 2016 A1
20160127764 Jung May 2016 A1
20170285922 LeBlanc Oct 2017 A1
20190303402 Berry Oct 2019 A1
Foreign Referenced Citations (13)
Number Date Country
1901632 Jan 2007 CN
101635814 Jan 2010 CN
101843096 Sep 2010 CN
102157174 Aug 2011 CN
102238353 Nov 2011 CN
1 349 049 Oct 2003 EP
1 521 468 Apr 2005 EP
2 034 487 Mar 2009 EP
2 413 597 Feb 2012 EP
2004-023787 Jan 2004 JP
1020060068985 Jun 2006 KR
1020070028253 Mar 2007 KR
WO 2009094083 Jul 2009 WO
Non-Patent Literature Citations (7)
Entry
European Search Report dated Aug. 24, 2018 issued in counterpart application No. 18185029.8-1210, 19 pages.
Chinese Office Action dated Jul. 24, 2018 issued in counterpart application No. 201310113601.9, 25 pages.
Korean Office Action dated May 23, 2018 issued in counterpart application No. 10-2012-0034342, 9 pages.
Chinese Office Action dated Jan. 31, 2018 issued in counterpart application No. 201310113601.9, 23 pages.
European Search Report dated Nov. 25, 2015 issued in counterpart application No. 15180279.0-1904, 14 pages.
Chinese Office Action dated Jun. 29, 2016 issued in counterpart application No. 201310113601.9, 21 pages.
European Search Report dated Nov. 20, 2017 issued in counterpart application No. 15180279.0-1914, 18 pages.
Related Publications (1)
Number Date Country
20180232128 A1 Aug 2018 US
Continuations (1)
Number Date Country
Parent 13845634 Mar 2013 US
Child 15950705 US