This application is the U.S. National Stage of International Application No. PCT/CN2020/124038, filed on Oct. 27, 2020, which based on the Chinese patent application with the application number of 201911047128.2, filed on Oct. 30, 2019, and the Chinese patent application with the application number of 201911047107.0, filed on Oct. 30, 2019, and claims the priority of the above-mentioned Chinese patent applications, the entire contents of which are hereby incorporated by reference.
The embodiments of the disclosure relate to the field of computer technology, in particular to a video processing method and apparatus, and terminal and storage medium.
Current video processing methods are poor in diversity, which also limits subsequent presentation and editing methods. Therefore, further improvement is needed to enhance user experience.
This Summary is provided to introduce concepts in a simplified form that are described in detail in the Detailed Description section that follows. This summary section is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.
In order to solve the above problems, the present disclosure provides a video processing method and apparatus, and terminal and storage medium. The method of the present disclosure utilizes cameras on both sides of the terminal to perform video recording simultaneously, which improves the video recording method, provide more flexible options for the presentation and clips of videos.
An embodiment of the present disclosure provides a video processing method, comprising: turning on a first camera on a first side and a second camera on a second side of a terminal in response to a first preset operation, wherein the first side and the second side are opposite or have different directions; and performing video recording by using the first camera and the second camera simultaneously.
An embodiment of the present disclosure provides a video processing device, comprising: a control module, configured to turn on a first camera on a first side and a second camera on a second side of a terminal in response to a preset operation, wherein the first side and the second side are opposite or have different directions; and a video recording module, configured to use the first camera and the second camera for simultaneous video recording.
An embodiment of the present disclosure provides a multimedia data playing method, comprising: receiving multimedia data to be played, wherein the multimedia data to be played comprises a first multimedia data stream, a second multimedia data stream and a corresponding timeline, and the timeline comprises a time period, which indicates whether the first multimedia data stream or the second multimedia data stream is output in a preset area in the corresponding time period, or whether the first multimedia data stream or the second multimedia data stream is in a preset output state in the corresponding time period.
Outputting the first multimedia data stream or the second multimedia data stream correspondingly in the preset area according to the timeline, or outputting the first multimedia data stream or the second multimedia data stream according to the preset output state.
An embodiment of the present disclosure provides a multimedia data editing method, comprising: receiving multimedia data to be edited, wherein the multimedia data to be edited comprises at least two multimedia data streams and a corresponding timeline, and the timeline indicates which one of the at least two multimedia data streams is output in a corresponding output area in a corresponding time period or which one of the at least two multimedia data streams is in a preset output state in a corresponding time period.
Editing the multimedia data to be edited based on the timeline and the at least two multimedia data streams.
An embodiment of the present disclosure provides a terminal, comprising: at least one memory and at least one processor; wherein the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the video processing method above.
In a video processing method of the disclosure, by using cameras on two sides of a terminal for video recording, a video recording method is improved, allowing more flexible choices for video presentation and editing.
The above and other features, advantages and aspects of various embodiments of the disclosure will become more apparent in combination with the accompanying drawings and with reference to the following detailed description. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic, and components and elements are not necessarily drawn to scale.
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for the purpose of A more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the protection scope of the present disclosure.
It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this regard.
As used herein, the term “including” and variations thereof are open-ended inclusions, i.e., “including but not limited to”. The term “based on” is “based at least in part on.” The term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; the term “some embodiments” means “at least some embodiments”. Relevant definitions of other terms will be given in the description below.
It should be noted that concepts such as “first” and “second” mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or interdependence.
It should be noted that the modifications of “a” and “a plurality” mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, they should be understood as “one or a plurality of”. multiple”.
The current video recording method of the terminal is relatively limited in application scenarios. For example, when shooting a beautiful scenery, if you want to capture the feelings expressed or what the photographer wants to say, you can only shoot the perfect scene, and then point the camera at the photographer himself or switch the camera used for shooting (for example, switch from rear to forward). This shooting experience is not friendly. In addition, this shooting method cannot reproduce the beautiful scenery and the picture of the photographer at the same moment, and the application scene is relatively limited.
In the present disclosure, a smartphone is taken as an example for description to better understand the present disclosure. However, it should be understood that the terminals in the present disclosure may include, but are not limited to, such as mobile phones, smart phones, notebook computers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), navigation devices, vehicle-mounted terminals Mobile terminal equipment such as equipment, vehicle display terminal, vehicle electronic rearview mirror, etc., and fixed terminal equipment such as digital TV, desktop computer, etc.
In some embodiments, turning on both the first camera and the second camera may include turning on two cameras at the same time, or turning on one camera first and then turning on the other camera in response to the first preset operation, so that the two cameras are turned on. In some embodiments, two cameras, that is, the front camera and the rear camera, are turned on at the same time. When the front camera and the rear camera are turned on at the same time, two video streams may be obtained. Further, the video stream obtained by the front camera may be referred to as a first video stream, and the video stream obtained by the rear camera may be referred to as a second video stream. Because the front camera and the rear camera are turned on and off at the same time, the first video stream and the second video stream contain different video data in the same time period. A user may preview the recording effect through a screen while the video streams are obtained.
In some embodiments, the first preset operation may include a voice command, a key operation, etc., which enables the first camera and the second camera to be turned on. In the disclosure, the first side and the second side of the terminal include but are not limited to a front side and a back side of the terminal, so that the first camera and the second camera include but are not limited to the front camera and the rear camera of the terminal. In addition, the first camera and the second camera respectively include one or more lenses. In addition, when the first camera or the second camera includes a plurality of lenses, it is not necessary that all the lenses need to work, instead, only some lenses may work, and the other lenses may be in an idle or unavailable state. In some embodiments, the video recording mode is improved by using the cameras on the two sides of the terminal for simultaneous video recording, allowing more flexible choices for video presentation and editing. For example, since the cameras on the two sides are used for simultaneous video recording, filming information from different angles on a same timeline may be obtained, thus providing multi-dimensional information to be edited for video presentation and editing easily and quickly, and reducing the complexity of information obtaining without increasing hardware cost.
In some embodiments, during video recording, because the first camera and the second camera are both turned on for video recording, the first camera and the second camera respectively generate one video image, that is, two video files are generated from one time of video recording. A picture taken by the first camera forms the first video stream, and a picture taken by the second camera forms the second video stream. Therefore, two video streams may be generated for subsequent playing and editing.
In some embodiments, an audio stream may also be obtained by video recording, and is used to be synthesized with the first video stream and/or the second video stream, so that the obtained video has corresponding audio. During video recording, one audio file and two video files are obtained in the same time period. The audio file and the two video files may be independent, that is, they do not interfere with each other. For example, a microphone may be used to obtain the audio file, and the first camera and the second camera may each obtain one video file. By obtaining the two video streams and the audio stream in corresponding time periods, more flexible choices may be provided for video presentation and editing in the later stage, so that users can implement various editing ideas. It should be understood that not only may the audio file obtained during video recording be synthesized with the corresponding video file, but also other audio files and the filmed video file may be synthesized and edited, etc. For example, other audio files include audio stream obtained by an audio recording device, other audio files stored locally or audio files obtained from the network, etc. Therefore, more flexible choices may be provided for video presentation and editing in the later stage, so that users can implement various editing ideas. In some embodiments, by taking smart phones as an example, in the embodiment of the disclosure, an audio stream may be obtained synchronously while the front camera and the rear camera are turned on to obtain two video streams. The way to obtain the audio stream is, for example, through a microphone, and the microphone may be turned on and off synchronously with the camera, so that the obtained audio stream has the same duration as the video stream. Furthermore, in some embodiments, the obtained audio stream may also be an existing audio stream, such as an audio file stored by a user or downloaded from the network. In this case, the duration of the audio file may be longer or shorter than that of the video stream, and the audio file and the video stream may be combined by editing or splicing subsequently. The obtained audio file may be specifically one or more pieces of combined background music or narration, which is not limited in the embodiment.
In some embodiments, during video recording, the terminal may display the first video stream obtained by the first camera and the second video stream obtained by the second camera, for example, when the terminal is a mobile phone, the first video stream and the second video stream are displayed in a display screen of the mobile phone. In some embodiments, the terminal simultaneously displaying the first video stream and the second video stream may include: determining display area information of the first video stream and the second video stream, and then displaying the first video stream in a first area and the second video stream in a second area according to the display area information. Specifically, the display area of each video stream may be determined by a processor of the terminal, and then the video streams are displayed in the first area and the second area according to the determined display areas. In some embodiments, a size of the first area is different from that of the second area. That is, the display areas of the first video stream and the second video stream are different in size. In some embodiments, the first area is located in the second area, for example, a picture-in-picture video, and at the moment, the first area may cover part of the second area. In some embodiments, the first area and the second area have no overlapping part. For example, the first video stream and the second video stream are displayed in a split screen manner.
For example,
In some embodiments, when the first area is located in the second area (i.e., displaying in a picture-in-picture manner), the first area may be located at a corner of the second area, or the first area may be located in an area with the least influence on the content displayed in the second area. For example, in some embodiments, when displayed in a picture-in-picture manner, a smaller picture may be absorbed onto four corners of a larger picture, for example, as shown in
In some embodiments, during video recording, by displaying the first video stream and the second video stream in the terminal at the same time, the content of the videos obtained by the cameras may be watched in time, allowing users to easily select the filming direction or content during video recording.
In some embodiments, during video recording, the display areas of the first video stream 21 and the second video stream 22 may be switched in response to a second preset operation. For example, the second preset operation may include a click trigger, a slide trigger, a voice command, etc., on the display areas of the first video stream 21 and the second video stream 22.
In some embodiments, the video processing method further comprises: positioning a display area of the second area to obtain a preset area of the display area of the second area so as to enable the first area to be located in the preset area, wherein the second area overlaps the first area, and an area of the first area is smaller than that of the second area.
In some embodiments, the first area is movable. The video processing method further includes: moving the first area to the preset area when it is recognized that the first area is moved and placed at other positions than the preset area in the display area of the second area.
In some embodiments, the preset area includes a plurality of corner positions. The video processing method further includes: moving the first area to a nearest corner position among the plurality of corner positions when it is recognized that the first area is moved and placed at other positions than the plurality of corner positions in the display area of the second area.
In some embodiments, an example that the front camera obtains the first video stream and the rear camera obtains the second video stream can be still used. For details, please refer to
In some embodiments, during video recording, corresponding time periods during which the first video stream and the second video stream are displayed in the first area or the second area as time goes on are recorded, timelines for displaying the first video stream and the second video stream are obtained, and the timelines include switching time points at which the first video stream and the second video stream are displayed in the first area or the second area. Optionally, the terminal may record the time periods to obtain the timelines, or software may run on the terminal to record the time periods to obtain the timelines. As shown in
In some embodiments, different time periods on the timelines are represented by different visual elements, and different time periods correspond to different video streams or different display areas. In some embodiments, the visual elements may include color, line form, transparency, etc. For example, the time periods during which different video streams are displayed may be distinguished by different colors, for example, one time period is in red, another time period is in yellow, etc. In addition, when the video streams displayed in the corresponding areas are switched, the visual elements change accordingly. For example, as shown in
By displaying the time period of the video stream displayed in a certain display area through timelines, the time point at which the video stream displayed in the display area is switched may be recorded, thereby facilitating that a user identifies which video stream is displayed in the current display area, and also providing a variety of flexible choices for presentation and editing modes in the later stage.
In some embodiments, during video recording, if the user switches the displayed picture or switches the output state of the displayed picture while watching the recorded video, the terminal records the latest timeline after switching. For example, during recording, the display screen of the terminal displays the first video stream and the second video stream in a picture-in-picture manner, the first video stream is displayed in a large picture in the first 10 sec, camera switching is conducted at the 10th sec, the second video stream is displayed in the large picture from the 10th sec to the 20th sec, and then the first video stream is displayed from the 20th sec to the 30th sec. During video recording, when the video is played or previewed, if the displayed picture is switched at the 5th sec, the first video stream is still be displayed in the large picture in the first 5 sec, the second video stream is displayed from the 5th sec to the 20th sec, and the first video stream is displayed from the 20th sec to the 30th sec. It should be understood that this is only exemplary, and switching may be conducted according to other rules as needed. In addition, during video recording, when the recorded video is played or previewed next time, the video may be displayed according to the latest timeline.
In some embodiments, when the recorded video is played during video recording, if the output states or display areas of the first video stream and the second video stream are switched, the terminal also records another timeline obtained after switching in addition to the timeline. That is, the terminal may record a plurality of timelines. Then, the user may select which timeline is to be used to display the first video stream and the second video stream. In some embodiments, after video recording is completed, the obtained first video stream 21 and/or second video stream 22 may be exported or shared to obtain an exported video, and the exported video may include at least one of the first video stream 21, the second video stream 22, a synthetic video with the first video stream 21 and the second video stream 22 or a picture-in-picture video with the first video stream 21 and the second video stream 22. That is, the exported video may be either a single video stream or a combined video of two video streams. In addition, these videos may be combined with audio during corresponding time periods. In the synthetic video with the first video stream 21 and the second video stream 22, the same video recording time point may include only one video stream, may also include two video streams, or a synthetic video corresponding to an audio stream obtained by synthesizing with an audio file in the corresponding time period. In a picture-in-picture video with the first video stream 21 and the second video stream 22, the first video stream 21 and the second video stream 22 are simultaneously displayed at each time point.
In some embodiments, when the exported video includes both the first video stream and the second video stream, the exported video also includes timeline information indicating whether the first video stream or the second video stream is displayed in the corresponding display area in the corresponding time period. The timeline may be the latest timeline updated by the terminal or a plurality of timelines recorded by the terminal. When the exported video is played, the user may select the corresponding timeline for play.
In addition, in the synthetic video and picture-in-picture video, there is a timeline showing which video stream is displayed in the display area. Through timeline differentiation, the user may easily know the video stream corresponding to a displayed video picture.
In addition, when users watch (e.g., play or preview) the synthetic video and picture-in-picture video, since the timeline is displayed in a manner of segments, the current video progress may be controlled by operating (e.g., clicking, dragging, etc.) the timeline, and the effect of quickly adjusting and selecting the watched video progress may also be achieved by previous-segment and next-segment options. For example, the user may click the position of the corresponding timeline to make the video quickly jump to be in the video progress at the corresponding time point. In addition, at a certain position of the timeline (for example, left, right, up, down and other appropriate positions of the timeline), previous-segment and next-segment options may be set. The user may quickly adjust the video progress through the options. In some embodiments, the segments are based on switching time points on the timeline. For example, when the previous-segment option is made, the video jumps to a start time point of a previous switching point in the current video progress. For example, the first video stream is played from the 10th sec to the 15th sec, the second video stream is played from the 15th sec to the 20th sec, the first video stream is played from the 20th sec to the 30th sec, and if the previous-segment option is made when the video is played to the 18th sec, the video jumps to the 10th sec and starts to be played from there; and if the next-segment option is made, the video jumps to the 20th sec and start to be played from there.
An embodiment of the disclosure also provides a video processing device 600, which includes a control module 601 and a video recording module 602. The control module 601 is configured to turn on both a first camera on a first side and a second camera on a second side of a terminal in response to a preset operation, wherein the first side and the second side are opposite or have different directions. The video recording module 602 is configured to use the first camera and the second camera for simultaneous recording.
In some embodiments, a multimedia data playing method is further provided, which includes: receiving multimedia data to be played, wherein the multimedia data to be played includes a first multimedia data stream, a second multimedia data stream and a corresponding timeline, and the timeline includes a time period which indicates whether the first multimedia data stream or the second multimedia data stream is output in a preset area in the corresponding time period, or whether the first multimedia data stream or the second multimedia data stream is in a preset output state in the corresponding time period. According to the timeline, the first multimedia data stream or the second multimedia data stream is correspondingly output in the preset area, or the first multimedia data stream or the second multimedia data stream is output according to the preset output state.
In some embodiments, the multimedia data may be video data or may also be audio data, for example, the first multimedia data stream may be a first soundtrack data stream, the second multimedia data stream may be a second soundtrack data stream, the first soundtrack data stream and the second soundtrack data stream are synthesized into a soundtrack data stream to be played, and the soundtrack data stream to be played is played or edited.
In some embodiments, the multimedia data includes video data, and the preset area includes a preset display area. When the multimedia data includes the video data, the multimedia data playing method may improve the processing efficiency of the picture display effect. In some embodiments, the multimedia data to be played may be the above-mentioned exported video including the first video stream and the second video stream, which will not be described in detail here. It should be understood that the timeline may be one timeline or may also be a plurality of timelines. When there are a plurality of timelines, a corresponding timeline may be selected to play the multimedia data.
In some embodiments, a time point at which an output multimedia data stream is controlled by operating the timeline, or a time point at which an output multimedia data stream in a preset output state is controlled by operating the timeline. For example, the timeline may be operated by sliding a position mark on the timeline or clicking the timeline. In some embodiments, the time point of the output multimedia data stream is controlled by selecting a previous time period and a next time period of the timeline through option buttons, or the time point of the multimedia data stream in the preset output state is controlled by selecting the previous time period and the next time period of the timeline through option buttons, and at the moment, the video may directly jump to the previous time period or the next time period through the option buttons.
In some embodiments, a multimedia data editing method is also provided, which includes: receiving multimedia data to be edited, wherein the multimedia data to be edited include at least two multimedia data streams and a corresponding timeline, and the timeline indicates which one of the at least two multimedia data streams is output in a corresponding output area in a corresponding time period or which one of the at least two multimedia data streams is in a preset output state in the corresponding time period. In some embodiments, the multimedia data to be edited may be the above-mentioned exported video including the first video stream and the second video stream, which will not be described in detail here. Then, based on the timeline and the at least two multimedia data streams, the multimedia data to be edited is edited.
In some embodiments, editing the multimedia data to be edited includes: resetting the presentation modes of the at least two multimedia data streams. For example, a synthesized video may be changed to a picture-in-picture video and vice versa. In some embodiments, editing the multimedia data stream to be edited includes: adjusting the timeline to obtain another timeline. For example, a switching time point of the display area may be changed to get a new timeline, so as to obtain multimedia data such as videos presented in a different way. In some embodiments, editing the multimedia data to be edited includes: changing a switching time point between time periods to obtain another timeline. For example, the switching time point of the first time period and the second time period is adjusted from the 3rd min to the 2nd min, so that the switching is performed at the 2nd min. In some embodiments, editing the multimedia data to be edited includes: modifying a playing effect identifier associated with the time period to obtain a multimedia data stream with a corresponding output effect. For example, if an identifier of a certain playing effect is moved from the first time period to the second time period, when the multimedia data is output, the multimedia data stream corresponding to the second time period is output according to the playing effect. The multimedia data stream may be a video stream or an audio stream. The above-mentioned multimedia data may include video data, audio data, etc.
In addition, the disclosure also provides a terminal including at least one memory and at least one processor, wherein the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the video processing method.
In addition, the disclosure also provides a computer storage medium which stores program codes for executing the video processing method.
In some embodiments, the video recording method is improved by using cameras on two sides of the terminal for simultaneous video recording, so that more flexible choices may be provided for video presentation and editing. In addition, during video recording, two video streams may be displayed at the same time, allowing the user to know and master captured pictures conveniently. Besides, by displaying multiple video streams through timelines, the user may conveniently know which video stream is played in the current area, and control the video progress and edit the video later.
Referring next to
As shown in
Typically, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration. An output device 707 of a computer, etc.; a storage device 706 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. Communication device 709 may allow electronic device 700 to communicate wirelessly or by wire with other devices to exchange data. While
In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication device 609, or from the storage device 708, or from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.
It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the client and server can use any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol) to communicate, and can communicate with digital data in any form or medium Communication (eg, communication network) interconnection. Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (eg, the Internet), and peer-to-peer networks (eg, ad hoc peer-to-peer networks), as well as any currently known or future development network of.
The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or may exist alone without being assembled into the electronic device.
The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: obtains at least two Internet Protocol addresses; A node evaluation request for an Internet Protocol address, wherein the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; wherein, the obtained The Internet Protocol address indicates an edge node in the content distribution network.
Or, the above computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device: receives a node evaluation request including at least two Internet Protocol addresses; From the at least two Internet Protocol addresses, the Internet Protocol address is selected; the selected Internet Protocol address is returned; wherein, the received Internet Protocol address indicates an edge node in the content distribution network.
Computer program code for performing operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and This includes conventional procedural programming languages—such as the “C” language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider via Internet connection).
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or operations, or can be implemented in a combination of dedicated hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Wherein, the name of the unit does not constitute a limitation of the unit itself under certain circumstances, for example, the first obtaining unit may also be described as “a unit that obtains at least two Internet Protocol addresses”.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical Devices (CPLDs) and more.
In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, provides a video processing method, comprising: turning on a first camera on a first side and a second camera on a second side of a terminal in response to a first preset operation, wherein the first side and the second side are opposite or have different directions; and performing video recording by using the first camera and the second camera simultaneously.
According to one or more embodiments of the present disclosure, wherein by the video recording, a first video stream is obtained through the first camera, and a second video stream is obtained through the second camera.
According to one or more embodiments of the present disclosure, wherein an audio stream is also obtained by the video recording, wherein the audio stream is used to be synthesized with the first video stream and/or the second video stream, so that an obtained video has corresponding audio.
According to one or more embodiments of the present disclosure, wherein during the video recording, the first video stream and the second video stream are displayed simultaneously.
According to one or more embodiments of the present disclosure, wherein displaying the first video stream and the second video stream simultaneously comprises: determining display area information of the first video stream and the second video stream, and displaying the first video stream in a first area and displaying the second video stream in a second area according to the display area information.
According to one or more embodiments of the present disclosure, wherein a size of the first area is different from that of the second area; or the first area is located in the second area; or the first area and the second area have no overlapping part.
According to one or more embodiments of the present disclosure, wherein in response to a second preset operation, display areas of the first video stream and the second video stream are switched.
According to one or more embodiments of the present disclosure, further comprising: positioning a display area of the second area to obtain a preset area of the display area of the second area so as to enable the first area to be located in the preset area, wherein the second area overlaps the first area, and an area of the first area is smaller than that of the second area.
According to one or more embodiments of the present disclosure, wherein the first area is movable, and the method further comprises: moving the first area to the preset area when it is recognized that the first area is moved and placed at other positions than the preset area in the display area of the second area.
According to one or more embodiments of the present disclosure, wherein the preset area comprises a plurality of corner positions, and the method further comprises: moving the first area to a nearest corner position among the plurality of corner positions when it is recognized that the first area is moved and placed at other positions than the plurality of corner positions in the display area of the second area.
According to one or more embodiments of the present disclosure, wherein during the video recording, corresponding time periods during which the first video stream and the second video stream are displayed in the first area or the second area as time goes on are recorded, timelines for displaying the first video stream and the second video stream are obtained, and the timelines comprise switching time points at which the first video stream and the second video stream are displayed in the first area or the second area.
According to one or more embodiments of the present disclosure, wherein the first video stream and/or the second video stream obtained by video recording is exported to obtain an exported video, which comprises at least one of: the first video stream, the second video stream, a synthetic video with the first video stream and the second video stream or a picture-in-picture video with the first video stream and the second video stream.
According to one or more embodiments of the present disclosure, wherein when the exported video comprises both the first video stream and the second video stream, the exported video also comprises timeline information indicating whether the first video stream or the second video stream is displayed in a corresponding display area in a corresponding time period.
According to one or more embodiments of the present disclosure, wherein when the first area is located in the second area, the first area is located at a corner of the second area, or the first area is located in an area with the least influence on content displayed in the second area.
According to one or more embodiments of the present disclosure, wherein different time periods on the timeline are represented by different visual elements, and different time periods correspond to different video streams or different display areas.
According to one or more embodiments of the present disclosure, wherein when output states or display areas of the first video stream and the second video stream are switched, the visual element changes accordingly.
According to one or more embodiments of the present disclosure, wherein when a recorded video is played during the video recording, in the case that the output states or display areas of the first video stream and the second video stream are switched, the terminal updates the timeline accordingly and records an updated timeline.
According to one or more embodiments of the present disclosure, wherein when a recorded video is played during the video recording, in the case that the output states or display areas of the first video stream and the second video stream are switched, the terminal also records another timeline obtained after the switching in addition to the timeline.
According to one or more embodiments of the present disclosure, wherein a time point of a displayed video is controlled by operating the timeline.
According to one or more embodiments of the present disclosure, wherein the timeline is displayed in a manner of segments, and a time point of a displayed video is controlled by selecting a previous segment and a next segment of the timeline through option buttons.
According to one or more embodiments of the present disclosure, provides a video processing device, comprising: a control module, configured to turn on a first camera on a first side and a second camera on a second side of a terminal in response to a preset operation, wherein the first side and the second side are opposite or have different directions; and a video recording module, configured to use the first camera and the second camera for simultaneous video recording.
According to one or more embodiments of the present disclosure, provides a multimedia data playing method, comprising: receiving multimedia data to be played, wherein the multimedia data to be played comprises a first multimedia data stream, a second multimedia data stream and a corresponding timeline, and the timeline comprises a time period, which indicates whether the first multimedia data stream or the second multimedia data stream is output in a preset area in the corresponding time period, or whether the first multimedia data stream or the second multimedia data stream is in a preset output state in the corresponding time period.
Outputting the first multimedia data stream or the second multimedia data stream correspondingly in the preset area according to the timeline, or outputting the first multimedia data stream or the second multimedia data stream according to the preset output state.
According to one or more embodiments of the present disclosure, wherein the multimedia data comprises video data, and the preset area comprises a preset display area.
According to one or more embodiments of the present disclosure, wherein a time point of an output multimedia data stream is controlled by operating the timeline, or a time point of an output multimedia data stream in the preset output state is controlled by operating the timeline.
According to one or more embodiments of the present disclosure, wherein a time point of an output multimedia data stream is controlled by selecting a previous time period and a next time period of the timeline through option buttons, or a time point of a multimedia data stream in the preset output state is controlled by selecting the previous time period and the next time period of the timeline through the option buttons.
According to one or more embodiments of the present disclosure, provides a multimedia data editing method, comprising:
Receiving multimedia data to be edited, wherein the multimedia data to be edited comprises at least two multimedia data streams and a corresponding timeline, and the timeline indicates which one of the at least two multimedia data streams is output in a corresponding output area in a corresponding time period or which one of the at least two multimedia data streams is in a preset output state in a corresponding time period.
Editing the multimedia data to be edited based on the timeline and the at least two multimedia data streams.
According to one or more embodiments of the present disclosure, wherein editing the multimedia data to be edited comprises: resetting presentation modes of the at least two multimedia data streams; or adjusting the timeline to obtain another timeline.
According to one or more embodiments of the present disclosure, wherein editing the multimedia data to be edited comprises: modifying a playing effect identifier associated with the time period to obtain a multimedia data stream with a corresponding output effect, or changing a switching time point between time periods to obtain another timeline.
According to one or more embodiments of the present disclosure, provides a terminal, comprising: at least one memory and at least one processor; wherein the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory to execute the video processing method above.
According to one or more embodiments of the present disclosure, provides a computer storage medium, storing program codes for executing the video processing method above.
The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, and should also cover, without departing from the above-mentioned disclosed concept, the technical solutions formed by the above-mentioned technical features or Other technical solutions formed by any combination of its equivalent features. For example, a technical solution is formed by replacing the above features with the technical features disclosed in the present disclosure (but not limited to) with similar functions.
Additionally, although operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although the above discussion contains several implementation-specific details, these should not be construed as limitations on the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable sub-combination.
Although the subject matter has been described in language specific to structural features and/or logical acts of method, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.
Number | Date | Country | Kind |
---|---|---|---|
201911047107.0 | Oct 2019 | CN | national |
201911047128.2 | Oct 2019 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2020/124038 | 10/27/2020 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2021/083146 | 5/6/2021 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
7823056 | Davey et al. | Oct 2010 | B1 |
8665333 | Sharma et al. | Mar 2014 | B1 |
8953079 | Raju et al. | Feb 2015 | B2 |
9325903 | Kim et al. | Apr 2016 | B2 |
9349414 | Furment et al. | May 2016 | B1 |
9491367 | Lee et al. | Nov 2016 | B2 |
9509916 | Li et al. | Nov 2016 | B2 |
9565333 | Kim et al. | Feb 2017 | B2 |
9578233 | Aoyama et al. | Feb 2017 | B2 |
10007476 | Glikmann | Jun 2018 | B1 |
10136069 | Kim et al. | Nov 2018 | B2 |
10200599 | Baldwin | Feb 2019 | B1 |
10511757 | Yoshizawa et al. | Dec 2019 | B2 |
10652198 | Morrison et al. | May 2020 | B1 |
10693956 | Green et al. | Jun 2020 | B1 |
10944908 | An et al. | Mar 2021 | B2 |
11012639 | Kim et al. | May 2021 | B2 |
11115591 | Wei | Sep 2021 | B2 |
11115598 | Yim et al. | Sep 2021 | B2 |
11258736 | Shelley | Feb 2022 | B2 |
11412276 | Bloch et al. | Aug 2022 | B2 |
11470051 | Berkas et al. | Oct 2022 | B1 |
11765463 | Li et al. | Sep 2023 | B2 |
20040179816 | Takehana | Sep 2004 | A1 |
20050232586 | Tsuchiya et al. | Oct 2005 | A1 |
20090141981 | Chan | Jun 2009 | A1 |
20100077289 | Das et al. | Mar 2010 | A1 |
20100251109 | Jin et al. | Sep 2010 | A1 |
20100281375 | Pendergast | Nov 2010 | A1 |
20120081392 | Arthur | Apr 2012 | A1 |
20120120186 | Diaz et al. | May 2012 | A1 |
20120268552 | Choi et al. | Oct 2012 | A1 |
20120274808 | Chong et al. | Nov 2012 | A1 |
20130111366 | Silbey et al. | May 2013 | A1 |
20130125000 | Fleischhauer et al. | May 2013 | A1 |
20130227414 | Hwang et al. | Aug 2013 | A1 |
20130235224 | Park et al. | Sep 2013 | A1 |
20130298026 | Fitzpatrick | Nov 2013 | A1 |
20130329100 | Desai et al. | Dec 2013 | A1 |
20140047371 | Palmer et al. | Feb 2014 | A1 |
20140192212 | He et al. | Jul 2014 | A1 |
20140229544 | Evans et al. | Aug 2014 | A1 |
20140232904 | Na et al. | Aug 2014 | A1 |
20140232906 | Ha et al. | Aug 2014 | A1 |
20140240551 | Kim et al. | Aug 2014 | A1 |
20140267842 | Lee et al. | Sep 2014 | A1 |
20140324605 | Steelberg et al. | Oct 2014 | A1 |
20150062434 | Deng et al. | Mar 2015 | A1 |
20150163562 | Leventhal et al. | Jun 2015 | A1 |
20150277638 | Bustamante | Oct 2015 | A1 |
20150288742 | Flynn et al. | Oct 2015 | A1 |
20150363811 | Candillier | Dec 2015 | A1 |
20160224767 | Steelberg | Aug 2016 | A1 |
20160248864 | Lola et al. | Aug 2016 | A1 |
20160249108 | Sexton | Aug 2016 | A1 |
20160284383 | Kozakura | Sep 2016 | A1 |
20160366294 | Uroskin et al. | Dec 2016 | A1 |
20170064208 | Salimpour et al. | Mar 2017 | A1 |
20170085803 | Chin et al. | Mar 2017 | A1 |
20170094019 | Ahmed et al. | Mar 2017 | A1 |
20170195615 | Han et al. | Jul 2017 | A1 |
20170201714 | Kim | Jul 2017 | A1 |
20170256288 | Ai et al. | Sep 2017 | A1 |
20170289462 | Eum et al. | Oct 2017 | A1 |
20170337652 | Sarin | Nov 2017 | A1 |
20180033153 | Hirasawa et al. | Feb 2018 | A1 |
20180234589 | Xiao | Aug 2018 | A1 |
20180376078 | Adachi et al. | Dec 2018 | A1 |
20190005253 | Floury et al. | Jan 2019 | A1 |
20190014372 | Kandagal et al. | Jan 2019 | A1 |
20190019926 | Lee et al. | Jan 2019 | A1 |
20190075066 | Cho et al. | Mar 2019 | A1 |
20190087938 | Iddings et al. | Mar 2019 | A1 |
20190174056 | Jung et al. | Jun 2019 | A1 |
20190199926 | An et al. | Jun 2019 | A1 |
20190288972 | Morrison | Sep 2019 | A1 |
20190342616 | Domm et al. | Nov 2019 | A1 |
20200099838 | Song et al. | Mar 2020 | A1 |
20200106952 | Missig et al. | Apr 2020 | A1 |
20200223454 | Fox et al. | Jul 2020 | A1 |
20200302414 | Pachera | Sep 2020 | A1 |
20210014415 | Wei | Jan 2021 | A1 |
20210021295 | Yun | Jan 2021 | A1 |
20210026511 | Ye et al. | Jan 2021 | A1 |
20210027576 | Nelson et al. | Jan 2021 | A1 |
20210051295 | Khawam | Feb 2021 | A1 |
20210067741 | Yoshizawa et al. | Mar 2021 | A1 |
20210099407 | Al Majid et al. | Apr 2021 | A1 |
20210152753 | Zhu | May 2021 | A1 |
20210297604 | Matiossian | Sep 2021 | A1 |
20220159183 | Li et al. | May 2022 | A1 |
20220239832 | Tyagi et al. | Jul 2022 | A1 |
20220294992 | Manzari et al. | Sep 2022 | A1 |
20220377254 | Wang et al. | Nov 2022 | A1 |
20230007085 | Berliner et al. | Jan 2023 | A1 |
20230076870 | Arnold et al. | Mar 2023 | A1 |
20230088720 | Wang et al. | Mar 2023 | A1 |
Number | Date | Country |
---|---|---|
101388988 | Mar 2009 | CN |
102568260 | Jul 2012 | CN |
102938825 | Feb 2013 | CN |
103745736 | Apr 2014 | CN |
104104870 | Oct 2014 | CN |
104980659 | Oct 2015 | CN |
105009566 | Oct 2015 | CN |
105103535 | Nov 2015 | CN |
105376396 | Mar 2016 | CN |
106060526 | Oct 2016 | CN |
106165430 | Nov 2016 | CN |
106210629 | Dec 2016 | CN |
106231095 | Dec 2016 | CN |
106559686 | Apr 2017 | CN |
106662965 | May 2017 | CN |
106851162 | Jun 2017 | CN |
106973234 | Jul 2017 | CN |
107105315 | Aug 2017 | CN |
107509029 | Dec 2017 | CN |
107566725 | Jan 2018 | CN |
107846547 | Mar 2018 | CN |
108234891 | Jun 2018 | CN |
108419016 | Aug 2018 | CN |
109089059 | Dec 2018 | CN |
109151537 | Jan 2019 | CN |
109167937 | Jan 2019 | CN |
109729266 | May 2019 | CN |
110166652 | Aug 2019 | CN |
110740261 | Jan 2020 | CN |
110784674 | Feb 2020 | CN |
110809100 | Feb 2020 | CN |
110830714 | Feb 2020 | CN |
111143662 | May 2020 | CN |
112004032 | Nov 2020 | CN |
112445389 | Mar 2021 | CN |
306373989 | Mar 2021 | CN |
113422903 | Sep 2021 | CN |
113497894 | Oct 2021 | CN |
114979495 | Aug 2022 | CN |
115334246 | Nov 2022 | CN |
1841225 | Mar 2008 | EP |
WO 2021136268 | Jul 2021 | WO |
Entry |
---|
International Patent Application No. PCT/CN2020/124038; Int'l Search Report; dated Jan. 11, 2021; 4 pages. |
“Android implements the View style that follows the finger drag and automatically sticks to the edge (example demo)”; https://www.jb51.net/article/102952.htm; JB51.Net Inc .; Jan. 2017; accessed Apr. 29, 2022; 7 pages (English Translation). |
Number | Date | Country | |
---|---|---|---|
20220377254 A1 | Nov 2022 | US |