BRIEF DESCRIPTION OF THE DRAWINGS
Other objects and advantages of the invention will become apparent upon reading the following detailed description and upon reference to the drawings in which:
FIG. 1 depicts the general working environment of the instant invention.
FIG. 2 illustrates the specific participating parties of the instant invention and the relationship between these parties.
FIG. 3 contains an illustration of the working environment and the interaction between the participating parties of the instant invention.
FIG. 4 describes the preferred structure and layout of the server and of the internal workings of the server.
FIG. 5 contains an illustration of a preferred workflow that is set into motion after upload of content and until storage of that content.
FIG. 6 describes the workflow that is set into motion at the server after request of a multimedia slideshow.
FIG. 7 illustrates the specific steps initiated by the instant invention when determining the connection speed of a user.
FIG. 8 depicts the data file processing rules of the instant invention in connection to a determined connection speed value.
FIG. 9 illustrates the workflow of the instant invention when uploading multimedia content from the user presenting the content.
FIG. 10 illustrates the workflow of the instant invention showing the steps initiated by a user interested in a multimedia slideshow.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Referring now to the drawings, wherein like reference numerals indicate the same parts throughout the several views, there is provided a preferred system and method for automatically and dynamically creating multimedia slideshows for viewing remotely in a client-server type arrangement. The system allows for the quick, flexible and easy sharing of personal or arbitrary multimedia content in an online environment, wherein the multimedia content is customized for viewing according to the Internet connection capabilities of a viewing user. The instant invention will preferably enable a user to upload and store his or her content in an online storage facility and furthermore will preferably ensure that the content will be provided to interested users in the best possible quality according to the Internet connection speed of these users.
By way of general explanation and in accord with the preferred embodiment, it is to be understood that when the phrase “dynamically creating online multimedia slideshows” is used herein that usage will preferably be interpreted as providing an online multimedia storage and presentation process for simultaneous use by a plurality of users, wherein the process can be separated into two component parts. One part will preferably allow a user to select and store multimedia material online. The other part will preferably control the dynamic creation of a multimedia slideshow containing selected material and the distribution of that multimedia slideshow to an interested user. By storing personal multimedia material according to the first part of the instant invention, the user will be able to store multimedia content in different formats in an online storage and presentation system wherein the second part of the instant invention ensures that the content will be provided to interested users in the best possible quality according to the connection capabilities of interested users.
For purposes of the instant embodiment it should be understood that the invention preferably seeks to provide a process by which users can store and present personal or arbitrary multimedia material over the Internet without having to specifically take into account possible connection speed issues of users interested in viewing the multimedia material. The instant invention preferably provides the participating users with a graphical user interface guiding the user through the individual steps of the processes, wherein the required number of steps are minimized to only the steps necessary to ensure a quick and easy implementation of the “share and present” principle. To ensure a minimum of required user interactions, a plurality of specific steps will preferably be executed without visible notification to the user. For example, the conversion of uploaded multimedia material to an alternative format will preferably be carried out without a notification to the uploading user. Similarly, when providing a multimedia slideshow to a user, the instant invention will also not provide the interested user with specific information about the current status of the dynamic creation process. Additionally, so that an interested user is provided with the best possible quality according to his or her connection speed, the instant invention will preferably be able to change performance/display parameters of the multimedia material. For example, it might be possible to change the display size of digital video files. The workflows and additional specifications regarding the instant invention will be described in more detail below.
As is generally indicated in FIG. 1, at least a portion of the instant invention will be implemented in form of software running on a users computer 100. Such a computer will have some amount of program memory and hard disc storage (whether internal or accessible via a network) as is conventionally utilized by such units. Additionally it is possible that an external camera 110 of some sort be utilized with—and will preferably be connectible to the computer so that video and/or graphic information can be transferred to and from the computer. Preferably the camera 110 will be a digital video camera, although that is not a requirement, as it is contemplated that the user might wish to utilize still images from a digital still camera in the creation of his or her multimedia work. Further given the modern trend toward incorporation of cameras into other electronic components (e.g. in handheld computers, telephones, laptops, etc.) those of ordinary skill in the art will recognize that the camera might be integrated into the computer or some other electronic device and, thus, might not be a traditional single-purposes video or still camera. Although the camera will preferably be digital in nature, any sort of camera might be used, provided that the proper interfacing between it and the computer is utilized. Additionally a microphone 130 might be utilized so that the user can add voice-over narration to a specific multimedia work or can control his or her computer via voice-recognition software and additionally a CD or DVD burner 120 could be useful for storing content on writable or rewritable media. Additionally to that an Internet access device 140, preferably a router, will be connected to the networking card contained in the computer to gain access to the Internet.
Turning next to FIG. 2, this figure illustrates the likely participating parties in an environment according to the instant invention. As is indicated in that figure, a plurality of local desktop computers 210 are connected to the Internet via a number of different access means. For example, users might be connected to the Internet via dial-up, landline broadband (over coaxial cable, fiber optic or copper wires), Wi-Fi, satellite connection, etc. According to Figure, desktop computers can also be connected to a server 200, which is also connected to the Internet. Thus, the functionality of the instant invention can also be implemented by communicating with the server 200. It should be noted that the three desktop computers that are illustrated in this figure are only examples of the number of remote desktops and/or laptops that could be simultaneously performing the steps of the instant method. Additionally it should be noted that the illustration and display of three desktop computers in FIG. 2 is not meant to limit the instant invention to a “one-computer=one user” model. This illustration is offered to visually suggest a general method of accessing the functionalities of the instant invention. Those of ordinary skill in the art will recognize that it is certainly possible that a number of users will be able to access the server functionalities from a single computer or from a variety of different computers that are connected to the Internet.
As is generally indicated in FIG. 3, this figure illustrates the general layout of the hardware that is preferably used when implementing the instant invention. Additionally, this figure describes the general workflow that is set into motion when using the instant invention. Only for purposes of efficient illustration, the participating users in this figure have been limited to two users. As was previously mentioned, the instant invention is not directed to a strict user A and user B scenario. Rather, the instant invention is designed to implement the well known multi user access principle of the data distribution via the Internet to a multimedia storage and presentation system.
A server 300 is preferably the center of the instant invention, wherein the server contains a multimedia database 335 in which any number of different multimedia files might be stored. The data files will preferably be comprised of digital music files 325, digital photo/picture files 320 and/or digital video files 315. Typically, a number of different applications will be resident on the server, wherein user management 340 is one of these applications. The user management 340 processes the different requests of each connected or connecting user to the server. The functions will be described further in connection with FIG. 4. Of the other applications that will preferably be available on the server, the media converter application is one of the important applications. This application preferably processes the uploaded content from a user. This processing preferably includes the conversion of the uploaded content into different versions of that content. The conversion process and the actions connected therewith depend on the format of the uploaded multimedia material. After successful processing of the uploaded materials, the converted data files will preferably be stored in the multimedia database 335.
The general workflow of the instant invention will preferably be carried out as follows. User 1305 has a number of different multimedia source files available that he or she wants to share over the Internet with other users. These files are preferably stored locally within the storage 310 available in the desktop computer. These files might include music files 325, photo/image files 320 and video files 315. Pursuant to this example, User 1305 uploads 330 the files that he or she wants to share to the server, wherein before uploading the content the user first preferably authenticates him- or herself by transmitting a user login and password to the user management 340 application running on the server. By using a user account approach the server will be able to assign the uploaded multimedia files to an individual user. The media converter 345 preferably processes the uploaded files and the processed files are stored in the multimedia database 335 of the server. After the completion of the upload and the following processing of the multimedia files. In one preferred embodiment, User 1305 will be able to inform others of the availability of the upload work any number of ways, e.g., via email, wherein the email contains an Internet link to the multimedia files or multimedia gallery of User 1305. Alternatively User 2360 might search for the multimedia files of User 1305 on the server, wherein the multimedia database 335 delivers the results of the search to User 2360. User 2 might request 350 a slideshow of all the stored multimedia files and then the instant invention will preferably provide the user with the multimedia files and will thereafter start the slideshow streaming process 355 from the server to User 2360. It should be noted that the user who is interested in viewing a multimedia slideshow is preferably not limited to only the multimedia data from a single user. The interested user might be able to select and view a number of different multimedia materials as he or she sees fit. Additionally, the multimedia files that will preferably be streamed to the user are selected according to the user's Internet connection speed and or quality, thereby providing the user with a multimedia slideshow in the best quality according to the Internet connection speed of that user.
Turning next to FIG. 4, FIG. 4 describes a preferred structure and layout of the server 400. In other words, FIG. 4 illustrates a preferred internal workings of the server. The server preferably contains application layer 405, wherein a plurality of different applications are stored in the server. Preferably, these applications will be capable of running continuously on the server to help process the requests of the different users. The application layer preferably contains different applications that manage the inner workings of the server. For example, the user management application 340 that stores the user settings and user accounts and also manages the storage of the different files that each user uploads and desires to share with others. Additionally, a load control application 410 will preferably be running on the server and that application manages the specific distribution of processing power and bandwidth of the server to ensure that each potential connected user receives the same quality of service. Additionally, the server preferably contains a media converter application 345 which is an integral part of the instant invention. The media converter 345 preferably processes each uploaded multimedia file and stores each processed multimedia file in the multimedia database. One application that is of particular importance for the instant invention is the slideshow producer 415, which preferably automatically selects the appropriate type of multimedia file for streaming to an interested user. In a preferred arrangement, it automatically and dynamically creates the slideshows for requesting users.
Additionally, the server of the instant invention also preferably features a multimedia storage area 420, in which the instant invention will store the uploaded multimedia files from the users. Note that the server might not necessarily be a single computer, instead the server part of the instant invention could comprise of a plurality of connected computers that make up the server part of the instant invention. FIG. 4 additionally illustrates how the different files from potential users will preferably be stored in the multimedia database of the instant invention. Preferably, each user will get a specific account, wherein the account generally contains an account name and an account password. The settings associated with the user account will preferably be handled and stored by the user management application 340, but the account name is preferably used as a criterion when storing the multimedia files from each user. Additionally, the multimedia files will preferably be differentiated by type. So, for example, the audio files will preferably be stored in a different folder than the photo/video files. Additionally, the different files will preferably be stored either by the name that the uploading user supplied or a name chosen by the instant invention according to an automated naming scheme (e.g., files might be given names such as A1 to An).
The files will preferably be stored according to their file formats in designated folders and additionally the instant invention will preferably store different versions of the uploaded files into these folders as well. Each user of the instant invention will preferably get an assigned storage space of a specific size, for example 250 MB. Of course, it is contemplated that the user will preferably be able to purchase more storage space as needed. The storage process, the storage into individual folders and the creation of the different version of a specific file will preferably be executed without any notification of the uploading user. The files that were uploaded by a user 425 of the instant invention will preferably be automatically sorted and stored according to their file format into corresponding folders, folders that will be created automatically by the instant invention when the user creates his or her personal user account. In a preferred arrangement, files that have been recognized as audio files will be stored in a folder for audio files 430, files that have been recognized as video files will be stored in a folder for video files 435, and files that have been recognized as photo or image files will be stored in a folder for image files 440, etc. The recognition of the specific file types will preferably be carried out by an analysis of the file type and the metadata of the file. Additionally, as has been previously mentioned, the files will preferably be stored according to a predetermined naming scheme, wherein the instant invention changes the original file name of the uploading file and stores the files according to a simpler naming convention. For example audio files might be given names such as A1 to An 445, wherein n should be understood to be replacement for an arbitrary numbering schemes. The naming scheme for the uploaded video files will preferably be the same. In FIG. 4 the naming scheme is depicted as B1 to Bn 450. It is certainly also possible that the video files might also be stored using a similar naming scheme as that used for the audio files. The processes connected to the storage of uploaded photo/image files will preferably be more elaborate. In a preferred arrangement, the media converter application 345 creates different versions from an uploaded original file, each of which versions is formed from the original by modifying various of its performance parameters (e.g., bit depth, resolution, frame rate, sample rate, image size, etc.). For example, when the user uploads a digital image file with a resolution of 3500×2084 pixels, the media converter application will create files with resolutions that are different from that of the uploaded/original file, e.g., files with resolutions of 640×480, 800×600, 1024×786, 1280×1024 and 1600×1200 might be created and the instant invention will preferably store these created files according to the previously mentioned naming scheme. Starting from the uploaded file (C1 to Cn) to the created different versions 455 of that uploaded file (e.g., C11 to C1n).
FIG. 5 describes a preferred workflow that is initiated when a user elects to upload multimedia files. As a first preferred step, the user will select the digital multimedia 500 files that he or she wants to upload and thereafter share with other users. In a next preferred step, the user will initiate the upload process 502 by signalling to the instant invention that the selection of multimedia files is completed. The next step will preferably be executed after each successful upload of a selected multimedia file or files. That is, the instant invention will preferably check each individual file 504 for integrity, completeness, format, etc. After this initial check, the instant invention will preferably determine the file type of each of the uploaded files. The files will preferably be at least differentiated into image files 506, audio files 518 and video files 528 and for each file type a preferred process is activated. For example, in a case where an uploaded file is an image file 506, the instant invention will determine if the format of that file is a supported format 508. If the determination reveals that the file is supported by the instant invention 510, the process will preferably proceed to the next step in which the image file will be converted to a plurality of different resolutions 516 and these converted files will preferably then be stored in the multimedia database 560 according to the previously described naming scheme. The conversion process and the results of this process are preferably dependent on the type and format of the source file. If the uploaded image file is not supported by the instant invention 512, the process will preferably change the format 514 of the uploaded file to a format that is supported by the instant invention and will thereafter proceed in the processing by creating individual versions of the uploaded file.
As was discussed previously, the processing step that is utilized in connection with uploaded audio files 518 is preferably similar to the process associated with image files. The process will preferably determine if the currently uploaded audio file is of a supported format 520 and, if that is the case 522, the audio file will preferably be stored in the multimedia database 560. If the format of the audio file is not supported 524, the process will preferably automatically convert the audio file to a format that is supported by the instant invention 526. Afterwards, the audio file will preferably be stored in the multimedia database 560.
Preferably, files that have been determined to be video files 528 will be processed in the same way as files that have been determined as audio files. The format of the video files will be determined 530 and, if that format is supported 540 by the multimedia slideshow producer, the video file will preferably be stored in the multimedia database 560.
However, in a preferred embodiment the instant invention will automatically convert uploaded video files to a format that is supported by the multimedia slideshow producer 555 and the converted file will be stored in the multimedia database 560 according to the previously described naming scheme.
Turning next to FIG. 6, this figure illustrates a preferred workflow that is activated from a user interested in a multimedia slideshow. In a first preferred step, an interested user requests the creation of a multimedia slideshow from the instant invention 600. The next steps are preferably executed exclusively on the server part of the instant invention, wherein in the next preferred step the connection speed of the interested user is determined 605. The specific steps connected with the determination of the connection speed will be described further in connection with FIG. 7. After the connection speed of the interested user has been determined, the process will preferably access the multimedia database 610 and, in the next preferred step, localize the desired multimedia files 615, files that the interested user may have specifically requested when initiating the request of the multimedia slideshow. After the process has determined the location of the desired multimedia files, in a next preferred step the slideshow producer will be activated 620, wherein the slideshow producer preferably implements the following steps. Next preferably, the files will be selected from the multimedia database 625, wherein this selection is implemented sequentially, however it is certainly possible that the selection will be implemented in a random fashion. If the next selected file is an image file 630, the process will preferably select the stored version of the file 635 that is determined to be the best version of the file for the previously determined connection speed of the user. Additionally in the next step the instant invention preferably determines if, according to the determined connection speed, the selected image file might be supplemented with a music file as background music 640. If the connection speed allows for the provision of the image file and a music file as background music, in the next preferred step the instant invention will transfer the image file and the digital music file to the user 645. In case that the next file in the list of the defined files is a video file 650 the process preferably will stop the playback of the background music 655 and select the digital video file according to the determined connection speed 660, which preferably means that the process will transfer the video file to the user 665. Depending on the determined connection speed, the process will preferably change one or more performance parameter values of the video files (e.g., bit rate, frame rate, image size, compression algorithm, etc.) to ensure best possible quality of the video file for the user. These steps beginning with the selection of the multimedia files will preferably be executed until all of the selected desired multimedia files have been processed.
Turning now to FIG. 7, this figure illustrates the steps that will preferably be executed by the instant invention when determining the connection speed 700 of a user. The determination will preferably be made by the execution of a test procedure which is communicated to the user 710 or with the determination of a value 760. The test procedure 710 will preferably be implemented via the following steps. In a first preferred step, the process will send data packets of dummy data to the user 720. In a next preferred step, the process will measure the transfer time of these data packets 730 and by using the results from the measurement of the transfer time and the amount of the dummy data the process will be able to approximately determine the connection speed of the user 740. The determined value will then preferably be stored while the multimedia slideshow creation process 750 is taking place and will be therewith accessed as needed during the process of the instant invention. The determination of the connection speed by value extraction 760 is quicker and is likely, in some circumstances, to provide a more accurate result than the determination by test procedure. If the user who is interested in a multimedia slideshow is logged into the multimedia storage and presentation system and if the user has an account, the process will preferably access the user account database 770 and by using the login name of the current user the process will select the appropriate user account 780 and will read one or more parameter values that describe the connection speed of that user from that user account, wherein the value that is retrieved was preferably provided or determined by a test procedure at the time of the creation of the user account.
Turning next to FIG. 8, this figure illustrates some differences in processing and distributing the multimedia files during the implementation of the instant invention in connection with a determined connection speed value. The connection speed value and the connected processing and selection rules are preferably divided into three categories. The first category is a connection speed below 1 Mbit 800, the second category is a connection speed between 1 Mbit and/or 2 Mbit 850, the third category is the connection speed of 4 Mbit, 8 Mbit or higher 860, wherein every connection speed value higher than 2 Mbit is preferably assigned to the third category. In the preferred arrangement, different processing rules 810 regarding multimedia files are associated with each category. Further, these rules will preferably be different depending on the format of the multimedia files. For example, there are comparable rules for image files 820, video files 830 and music files 840. These processing rules instruct the slideshow production process which versions of the stored files will be integrated into the multimedia slideshow creation process and additionally how some of these files are to be displayed for the interested user. By way of example only, the rules for a connection speed below 1 Mbit could instruct the process to only select image files or versions of image files with a performance parameters/resolution of 640×480 and/or 800×600 862. In this scenario, video files are preferably displayed with a reduction in bitrate and/or reduced frame rate or frame size and the video file is preferably only to be displayed with a half-size display size 864. Similarly, and by way of further example, audio files will preferably be distributed to the user with a reduction in bitrate 866. The preferred rules for a connection speed between 1 Mbit and 2 Mbit are similar, only image files or the versions of the image files with a resolution of 1024×768 and/or 1280×1024 868 are to be selected for a positive user experience of the multimedia slideshow. Video files will preferably be distributed to the user with a reduction in bitrate and the video file will be displayed with full screen display size 870. Audio files will preferably be distributed to the user without change 872, although other arrangements are certainly possible. Users with a connection speed of 4 Mbit or more will preferably be provided with image files having a resolution of 1600×1200 874 or more. This may result in the use of unchanged video files which are provided in full screen display mode 876 and unchanged audio files 878.
Turning next to FIG. 9, this figure depicts a preferred workflow for a user wanting to present his or her personal multimedia material to others. According to a first preferred step, the user will connect to the instant multimedia storage and presentation system via a browser application from his or her local personal computer and will log in to the storage and presentation system 900. In the next preferred step, the user will select locally stored personal multimedia material that he or she wants to share over the Internet for upload 910. The instant invention will then preferably upload the selected multimedia material to the server system providing the storage and presentation system 920 and, in the next preferred step, which is executed on the server system, the uploaded files will be checked 930, to determine the file type, the file format and other parameter values that describe the file. In the next step, the instant invention will preferably convert the uploaded multimedia material to formats supported by the slideshow producer application and additionally the instant invention will preferably create files with modified parameter values 940. For example, different resolutions might be created to support the process of constructing a multimedia slideshow according to the connection speed of an interested user. These created and converted files will then preferably be stored in the multimedia database of the instant invention 950. In the next preferred step, the user might be able to define individual access rights for specific multimedia files 960.
Turning now to FIG. 10, this figure illustrates a preferred workflow of the instant invention for a user interested in viewing a multimedia slideshow. In a first preferred step, the user will connect to the multimedia storage and presentation system 1000 and in the next step the user will be able to either login to the system without a user account 1010 or with a user account 1020. In a next preferred step, the user will select the multimedia files or the content that he or she wishes to view in a multimedia slideshow 1030. However, it is certainly possible that the user who is interested in a multimedia slideshow can opt for a completely random slideshow, without specifying any multimedia files. In a next preferred step, the instant invention will determine the connection speed of the user in order to provide the user with the best possible quality regarding the multimedia slideshow. Depending on the way the user has connected to the system, the instant invention will preferably determine the connection speed/bandwidth. If the user accessed the system without a user account 1010, the instant invention will preferably determine the connection speed by initiating the previously described determination by test procedure 1040. If the user accessed the system via a user account 1020, the instant invention will obtain a connection speed by accessing the previously stored data for that user 1050. In the next preferred step, the instant invention will begin with the dynamic creation and distribution of the multimedia files to the user and the user will receive and view the presentation 1060.
CONCLUSIONS
Of course, many modifications and extensions could be made to the instant invention by those of ordinary skill in the art. For example in one preferred embodiment it would be possible that the instant invention could adapt the creation process of the multimedia slideshow on the fly e.g., if a different user (e.g., a friend) is given access to view the slide show, the instant invention could sense or determine his or her type of connection and reformat the slide show to accommodate that bandwidth. Additionally it might be possible to provide some form of download option, which allows a viewing user to store the created and received multimedia slideshow locally simultaneously or after the slideshow has been distributed to the viewing user.
Thus, the present invention is well adapted to carry out the objects and attain the ends and advantages mentioned above as well as those inherent therein. While the inventive device has been described and illustrated herein by reference to certain preferred embodiments in relation to the drawings attached thereto, various changes and further modifications, apart from those shown or suggested herein, may be made therein by those of ordinary skill in the art, without departing from the spirit of the inventive concept the scope of which is to be determined by the following claims.
Patent Application
20080016185
