Patent Application
20240221788
This application is based on the application with a CN application number of 202210767916.4 and the filing date being on Jul. 1, 2022, and claims its priority. The disclosure of this CN application as a whole is incorporated into the present application herein by reference.
The present disclosure relates to the technical field of terminals, and in particular, to an audio publishing method, an apparatus and a computer-readable storage medium.
Currently, there are some websites or applications that aggregate audio contents, such as news, stories, speeches, work reviews, and so on. These audio contents tend to have long playback durations. Users usually select audios of interest based on information such as titles and classifications of the audio contents.
According to a first aspect of some embodiments of the present invention, an audio publishing method is provided, comprising: acquiring an original audio material; generating visual content of an audio clip corresponding to clipping information of the original audio material in response to the clipping information inputted by a user, wherein the visual content is provided with a Redirect-to control for redirecting to the original audio material; and publishing the visual content of the audio clip into a feed in response to a publishing operation of the user.
In some embodiment, the audio publishing method further comprises: displaying a preview of the visual content of the audio clip before the publishing of the visual content of the audio clip.
In some embodiment, the visual content further comprises description information of the audio clip.
In some embodiment, the description information of the audio clip comprises at least one of a title, a cover image, or a text description.
In some embodiment, generating visual content of an audio clip corresponding to clipping information comprises: obtaining description information of the original audio material through a RSS feed link input by the user, wherein the original audio material is obtained through the RSS feed link; displaying one or more input controls, each input control comprising the description information of the original audio material; and generating the visual content of the original audio material according to the clipping information and the description information of the original audio material.
In some embodiment, generating visual content of an audio clip corresponding to clipping information comprises: generating a background color for the visual content based on a cover image in the case that the description information comprises the cover image.
In some embodiment, generating visual content of an audio clip corresponding to clipping information comprises: generating an animation effect of the visual content.
In some embodiment, the animation effect is associated with a change in an audio attribute of the audio clip.
In some embodiment, the visual content is further provided with user interaction control(s).
In some embodiment, acquiring an original audio material comprises: displaying an upload page in response to an operation on a Create control of the user, wherein the upload page comprises a Video Upload control and an Audio Upload control; displaying an audio upload interface in response to a selection on the Audio Upload control of the user; and acquiring the original audio material through the upload interface.
In some embodiment, the audio upload interface comprises an input box for an RSS feed link to obtain the original audio material.
In some embodiment, the feed is a short video feed, and the audio publishing method further comprises: publishing the original audio material into an audio feed.
In some embodiment, generating visual content of an audio clip corresponding to clipping information of the original audio material in response to the clipping information is input by a user comprises: displaying an audio clip editing interface in response to the user starting to edit the audio clip, wherein the audio clip editing interface comprises a track area of the original audio material, a first movement control, and a second movement control, and the first movement control and the second movement control are respectively used to identify a start position and an end position of the audio clip in the track area; using playback time points corresponding to the first movement control and the second movement control as the clipping information of the original audio material in response to the user accomplishing editing the audio clip; and generating the visual content of the audio clip according to the clipping information.
According to a second aspect of some embodiments of the present invention, an audio publishing apparatus is provided, including: a memory; a processor coupled to the memory, the processor configured to, based on instructions stored in the memory, carry out any one of the foregoing audio publishing methods.
According to a third aspect of some embodiments of the present invention, a non-transitory computer-readable storage medium is provided on which a computer program is stored, which executed by a processor, implement any one of the foregoing audio publishing methods.
According to a fourth aspect of some embodiments of the present invention, a non-transitory computer program product is provided, which when executed on a computer causes the computer to implement any one of the foregoing audio publishing methods.
Other features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings.
In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, a brief introduction will be given below for the drawings required to be used in the description of the embodiments or the prior art. It is obvious that, the drawings illustrated as follows are merely some embodiments of the present invention. For a person skilled in the art, he or she may also acquire other drawings according to such drawings on the premise that no inventive effort is involved.
Below, a clear and complete description will be given for the technical solution of embodiments of the present disclosure with reference to the figures of the embodiments. Obviously, merely some embodiments of the present disclosure, rather than all embodiments thereof, are given herein. The following description of at least one exemplary embodiment is in fact merely illustrative and is in no way intended as a limitation to the invention, its application or use. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present disclosure without creative efforts shall fall within the protection scope of the present disclosure.
Unless otherwise specified, the relative arrangement, numerical expressions and numerical values of the components and steps set forth in these examples do not limit the scope of the invention.
At the same time, it should be understood that, for ease of description, the dimensions of the various parts shown in the drawings are not drawn to actual proportions.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, these techniques, methods, and apparatuses should be considered as part of the specification.
Of all the examples shown and discussed herein, any specific value should be construed as merely illustrative and not as a limitation. Thus, other examples of exemplary embodiments may have different values.
Notice that, similar reference numerals and letters are denoted by the like in the accompanying drawings, and therefore, once an article is defined in a drawing, there is no need for further discussion in the accompanying drawings.
After analyzing the related art, the inventors have found that, for the current audio playback mode, a listener usually listens from the start of the audio if he/she does not know much about the specific contents of an audio product. However, for a long audio material having scattered information and a long foreshadowing part, some users may lose interest before listening to the exciting part. Therefore, users will miss some wonderful audio contents, and it is difficult for audio creators to guide more users to listen to their works.
The present invention provides an audio publishing method, apparatus and computer storage medium to address the problem of low efficiency of information acquisition for listeners due to the limited approach to access of audio content playback in the related art.
In step S102, an original audio material is acquired.
The original audio material is, for example, uploaded locally by a user from a terminal or acquired from the network. The manner of network acquisition comprises, for example, acquisition from a cloud, or acquisition through an RSS (Really Simple Syndication) feed link input by a user.
In step S104, visual content of an audio clip corresponding to clipping information of the original audio material is generated in response to the clipping information inputted by a user, wherein the visual content is provided with a Redirect-to control for redirecting to the original audio material.
The clipping information is used to identify a start point and an end point of the audio clip that the user wants to cut out. For example, the clipping information comprises a start time point and an end time point of the audio clip, or a start time point and a duration of the audio clip, or an end time point and a duration of the audio clip, etc.
In some embodiments, the user may enter numerical values and symbols of the clipping information through an input box.
In some embodiments, the user determines the clipping information by controlling some movement controls in an audio track area of the original audio material, wherein the movement controls are used to identify the start and end positions of the audio clip.
In some embodiments, an audio clip editing interface is displayed in response to the user starting to edit the audio clip, wherein the audio clip editing interface comprises a track area of the original audio material, a first movement control, and a second movement control, and the first movement control and the second movement control are respectively used to identify a start position and an end position of the audio clip in the track area; playback time points corresponding to the first movement control and the second movement control are used as the clipping information of the original audio material in response to the user accomplishing editing the audio clip.
After the user operates the movement controls, corresponding time points can be displayed on the interface. The user can also edit the displayed time points to change the positions of the movement controls on the track area.
The visual content may be video content, or may be multimedia content with a playback effect similar to that of video, for example, multimedia content comprising a dynamic image and an audio material that are played simultaneously. A Redirect-to control can be deployed in the playback interface of the visual content.
In some embodiments, the visual content comprises description information of the audio clip. The description information comprises, for example, at least one of a title, a cover image, or a text description. In addition, a background, an animation effect or the like can be generated for the visual content. The information, background, animation or other objects can be automatically generated or edited by the publisher. These objects are then composited with the audio clip to generate the visual content.
In some embodiments, a preview of the visual content of the audio clip is displayed before the publishing of the audio clip's visual content. Thus, the publisher can adjust the audio clip or other objects used to generate the visual content according to the preview effect.
In step S106, the visual content of the audio clip is published into a feed in response to a publishing operation of the user.
The feed comprises multiple multimedia contents. A viewer can watch the multiple multimedia contents in the feed in sequence through a switching operation. The multimedia contents comprises, for example, videos, audios, and the like.
Through the above embodiment, a creator can select and publish a part of the original audio material, for example, the most attractive and highlight part of the original audio material. Therefore, when a viewer browses the visual content corresponding to the audio clip, it is easier for the viewer to quickly understand the content of the complete original audio material, and can be redirected to a playback interface of the original audio material when interested. Therefore, the above embodiment provides an additional approach to audio access and playback, which can improve the information acquisition efficiency of visitors, and can increase the click-through rate of a creator's audio material. Moreover, the above embodiment can realize automatic generation of the visual content without the need of the user's complex video production operations, thereby improving the efficiency of publishing the user-created content, and having wide applicability.
In some embodiments, the feed comprises a short video feed and an audio feed. In response to a publishing operation of the user, the visual content of the audio clip can be published into a short video feed, and the original audio material can be published into an audio feed. A short video feed is a feed making it more convenient for viewers to obtain information, which comprises multiple short videos and visual contents, the length of each video and visual content being less than a preset value. In the process of viewing short videos in a feed, a viewer watches short videos and visual contents pushed by the system. For example, when a user performs a gesture operation such as a swiping up and down operation, he/she may see short videos or visual contents of audio clips published through the preceding embodiment. The audio feed comprises multiple audios, wherein adjacent audios are, for example, works in a same album. Most audio works in audio feeds are longer than the media contents in short video feeds. The above embodiment can build a channel between a short video feed and an audio feed, attracting viewers to browse visual contents of audio clips by means of the short video feed characterized by information aggregation and high information density, and then guiding them to the audio feed. Therefore, it is convenient for users to switch between different types of media.
In some embodiments, a user can trigger the creation and publication of an audio clip by selecting a Create control. For example, an upload page is displayed in response to an operation on a Create control of the user, wherein the upload page comprises a Video Upload control and an Audio Upload control; an audio upload interface is displayed in response to a selection on the Audio Upload control of the user. Therefore, the user can upload the original audio material through the audio upload interface, wherein the uploading may comprise uploading locally or uploading from the network.
The Create tool in the above embodiment supports both publishing of videos and publishing of visual contents of audios. Therefore, the Create tool can be applied to a scenario where a video feed and an audio feed coexist, for example, a scenario where visual contents of audio clips are published in a short video feed.
In some embodiments, the audio upload interface comprises an input box for an RSS feed link to obtain the original audio material through the RSS feed link.
In some embodiments, an RSS feed link comprises multiple audios, such as multiple audio albums. In this case, a list of audio albums can be displayed for the creator to select a target audio album and a target audio as the original audio material.
At present, more audio creators record their audio works through RSS feeds. The above embodiment provides a way of uploading an original audio material through a RSS feed link, which expands the way of audio acquisition, thereby facilitating the operation of the creator.
In addition to acquiring the original audio material through a RSS feed, related information such as the title, cover image or text description and other description information of the original audio material can also be obtained. This information can be displayed in the Create interface of the audio clip, some or all of which can be edited by the user. In some embodiments, description information of the original audio material is obtained through a RSS feed link input by the user, wherein the original audio material is obtained through the RSS feed link; one or more input controls are displayed, each input control comprising the description information of the original audio material; and the visual content of the original audio material is generated according to the clipping information and the description information of the original audio material.
In addition, the duration of the original audio material “1 hour and 12 minutes” and its text description “This is a story” are also incorporated in the playback interface of the visual content. For example, the duration of the original audio material is displayed on the Redirect-to control 47, so that the user can intuitively understand the information of the original audio material to be redirected to.
As required, an input control for inputting content such as text description can also be provided, so that the user can edit the description content. The cover image can be set to Not-editable to keep consistent with the cover image of the original audio material if desired. However, the present invention does not limit this.
In some embodiments, in the case where the description information comprises a cover image, a background color can be generated for the visual content based on the cover image. Thus, the background of the visual content that matches the color of other parts of the visual content can be automatically generated.
In some embodiments, an animation effect of the visual content is generated. Therefore, the visual content of the audio clip can have a presentation effect closer to that of a video. The animation effect can be selected from a library of effects, or automatically generated based on information about the audio clip.
In some embodiments, the animation effect is associated with a change in an audio attribute of the audio clip. Therefore, it is possible to render the animation effect based on the audio attribute. The audio attribute comprises, for example, at least one of rhythm, volume, or pitch of the audio. The animation effect comprises, for example, at least one of a deformation, a change in movement direction, trajectory or speed of a target object in the animation.
As required, a corresponding relationship between a category of the audio attribute and a category of the animation effect can be set, so that when a specific audio attribute changes, the animation can present a preset effect.
With this embodiment, a visual effect matching the auditory effect can be automatically produced.
In some embodiments, the visual content is also provided with user interaction controls. For example, in the preview interface shown in
The above embodiment can realize automatic generation of the visual content of the audio clip without the need of the user to manually create the visual content, thus improving the generation efficiency of the visual content and facilitating the user to publish more audio clips in a feed, especially a short video feed.
An embodiment of an audio publishing apparatus of the present invention will be described below with reference to
Through the above embodiment, a creator can select and publish a part of the original audio material, for example, the most attractive and highlight part of the original audio material. Therefore, when a viewer browses the visual content corresponding to the audio clip, it is easier for the viewer to quickly understand the content of the complete original audio material, and can be redirected to a playback interface of the original audio material when interested. Therefore, the above embodiment provides an additional approach to audio access and playback, which can improve the information acquisition efficiency of visitors, and can increase the click-through rate of a creator's audio material. Moreover, the above embodiment can realize automatic generation of the visual content without the need of the user's complex video production operations, thereby improving the efficiency of publishing the user-created content, and having wide applicability.
In some embodiments, the audio publishing apparatus further comprises a preview module 540 configured to display a preview of the visual content of the audio clip before the publishing of the visual content of the audio clip.
In some embodiments, the visual content further comprises description information of the audio clip.
In some embodiments, the description information of the audio clip comprises at least one of a title, a cover image, or a text description.
In some embodiments, the generation module 520 is further configured to obtain description information of the original audio material through a RSS feed link input by the user, wherein the original audio material is obtained through the RSS feed link; display one or more input controls, each input control comprising the description information of the original audio material; and generate the visual content of the original audio material according to the clipping information and the description information of the original audio material.
In some embodiments, the generation module 520 is further configured to generate a background color for the visual content based on a cover image in the case that the description information comprises the cover image.
In some embodiments, the generation module 520 is further configured to generate an animation effect of the visual content.
In some embodiments, the animation effect is associated with a change in an audio attribute of the audio clip.
In some embodiments, the visual content is further provided with user interaction control(s).
In some embodiments, the acquisition module 510 is further configured to display an upload page in response to an operation on a Create control of the user, wherein the upload page comprises a Video Upload control and an Audio Upload control; display an audio upload interface in response to a selection on the Audio Upload control of the user; and acquire the original audio material through the upload interface.
In some embodiments, the audio upload interface comprises an input box for an RSS feed link, and the acquisition module 510 is further configured to acquire the original audio material through the RSS feed link.
In some embodiments, the publishing module 530 is further configured to publish the visual content of the audio clip into a short video feed; and publish the original audio material into an audio feed.
In some embodiments, the generation module 520 is further configured to display an audio clip editing interface in response to the user starting to edit the audio clip, wherein the audio clip editing interface comprises a track area of the original audio material, a first movement control, and a second movement control, and the first movement control and the second movement control are respectively used to identify a start position and an end position of the audio clip in the track area; use playback time points corresponding to the first movement control and the second movement control as the clipping information of the original audio material in response to the user accomplishing editing the audio clip; and generate the visual content of the audio clip according to the clipping information.
The memory 610 may include, for example, system memory, a fixed non-volatile storage medium, or the like. The system memory stores, for example, an operating system, application programs, a boot loader (Boot Loader), and other programs.
An embodiment of the present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored, which is characterized in that when the program is executed by a processor, any one of the foregoing audio publishing method is implemented.
One skilled in the art should understand that, the embodiments of this invention may be provided as a method, a system, or a computer program product. Therefore, embodiments of this invention can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment containing both hardware and software elements. Moreover, the present invention may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including but not limited to disk storage, CD-ROM, optical memory, etc.) having computer-usable program code embodied therein.
The present invention has been described with reference to flow charts and/or block diagrams of methods, apparatuses (systems) and computer program products according to embodiments of the present invention. It should be understood that each process and/or block in the flowcharts and/or block diagrams, and combinations of the processes and/or blocks in the flowcharts and/or block diagrams may be implemented by computer program instructions. The computer program instructions may be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing apparatus to generate a machine such that the instructions executed by a processor of a computer or other programmable data processing apparatus to generate means implementing the functions specified in one or more flows of the flowcharts and/or one or more blocks of the block diagrams.
The computer program instructions may also be stored in a computer readable storage device capable of directing a computer or other programmable data processing apparatus to operate in a specific manner such that the instructions stored in the computer readable storage device produce an article of manufacture including instruction means implementing the functions specified in one or more flows of the flowcharts and/or one or more blocks of the block diagrams.
These computer program instructions can also be loaded onto a computer or other programmable device to perform a series of operation steps on the computer or other programmable device to generate a computer-implemented process such that the instructions executed on the computer or other programmable device provide steps implementing the functions specified in one or more flows of the flowcharts and/or one or more blocks of the block diagrams.
The above is merely preferred embodiments of this invention, and is not limitation to this invention. Within spirit and principles of this utility model, any modification, replacement, improvement and etc. shall be contained in the protection scope of this invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202210767916.4 | Jul 2022 | CN | national |
