Patent Grant
11463717
The present disclosure generally relates to systems and methods for processing multimedia signals, and in particular, to systems and methods for processing and transmitting multimedia signals received from a plurality of channels.
Multimedia technology has been widely used in various fields in recent years, such as computer industry, entertainment, and video monitoring. A challenge in multimedia technology is the processing and transmission of multimedia signals received from a plurality of channels. Normally, a plurality of transmission medium (e.g., a plurality of cables) is needed to transmit the multimedia signals received from the plurality of channels, which may cause a waste of transmission resources. Accordingly, it is desirable to provide systems and methods for processing and transmitting multimedia signals received from a plurality of channels more efficiently, thus saving the transmission cost.
An aspect of the present disclosure relates to a system for signal transmission. The system may include at least one storage medium including a set of instructions and at least one processor in communication with the at least one storage medium. When executing the set of instructions, the at least one processor may directed to cause the system to perform one or more of the following operations. The system may receive a composite multimedia signal, wherein the composite multimedia signal may be encoded in a frame format including an active zone and a blanking zone. The composite multimedia signal may be associated with a plurality of multimedia signals acquired by a plurality of acquisition devices. The system may insert one or more control signals in a predetermined section of the blanking zone. The system may transmit the one or more control signals to one or more target acquisition devices of the plurality of acquisition devices via a transmission medium.
In some embodiments, the composite multimedia signal may include analog signals in the active zone and digital signals in the blanking zone.
In some embodiments, each of the one or more control signals may be associated with an identity. The system may transmit the one or more control signals to the one or more target acquisition devices based on one or more identities.
In some embodiments, the system may determine a position of a frame header. The system may identify a predetermined position based on the position of the frame header and a counter. The system may insert the one or more control signals in the predetermined section of the blanking zone based on the predetermined position.
In some embodiments, the system may determine a position of a frame header. The system may identify a predetermined position based on the position of the frame header and a timer. The system may insert the one or more control signals in the predetermined section of the blanking zone based on the predetermined position.
In some embodiments, each of the one or more control signals may be associated with a control command. The control command may be configured to control a corresponding target acquisition device to adjust a working parameter.
In some embodiments, the working parameter may include at least one of an orientation of the acquisition device, an acquisition resolution, a frame rate, and/or a field of view.
In some embodiments, the system may transmit the one or more control signals to the one or more target acquisition devices in a distribution mode or a broadcast mode.
In some embodiments, the transmission medium may be a coaxial cable.
Another aspect of the present disclosure relates to a method implemented on a computing device including at least one processor and at least one storage medium. The method may include one or more of the following operations. The method may include receiving a composite multimedia signal, wherein the composite multimedia signal may be encoded in a frame format including an active zone and a blanking zone. The composite multimedia signal may be associated with a plurality of multimedia signals acquired by a plurality of acquisition devices. The method may further include inserting one or more control signals in a predetermined section of the blanking zone. The method may further include transmitting the one or more control signals to one or more target acquisition devices of the plurality of acquisition devices via a transmission medium.
In some embodiments, the composite multimedia signal may include analog signals in the active zone and digital signals in the blanking zone.
In some embodiments, each of the one or more control signals may be associated with an identity. The transmitting the one or more control signals to the one or more target acquisition devices may include transmitting the one or more control signals to the one or more target acquisition devices based on one or more identities.
In some embodiments, the inserting the one or more control signals in the predetermined section of the blanking zone may include determining a position of a frame header; identifying a predetermined position based on the position of the frame header and a counter; and inserting the one or more control signals in the predetermined section of the blanking zone based on the predetermined position.
In some embodiments, the inserting the one or more control signals in the predetermined section of the blanking zone may include determining a position of a frame header; identifying a predetermined position based on the position of the frame header and a timer; and inserting the one or more control signals in the predetermined section of the blanking zone based on the predetermined position.
In some embodiments, each of the one or more control signals may be associated with a control command. The control command may be configured to control a corresponding target acquisition device to adjust a working parameter.
In some embodiments, the working parameter may include at least one of an orientation of the acquisition device, an acquisition resolution, a frame rate, and/or a field of view.
In some embodiments, the transmitting the one or more control signals to the one or more target acquisition devices of the plurality of acquisition devices via the transmission medium may include transmitting the one or more control signals to the one or more target acquisition devices in a distribution mode or a broadcast mode.
In some embodiments, the transmission medium may be a coaxial cable.
A further aspect of the present disclosure relates to a non-transitory computer readable medium including executable instructions. When the executable instructions are executed by at least one processor, the executable instructions may direct the at least one processor to perform a method. The method may include one or more of the following operations. The method may include receiving a composite multimedia signal, wherein the composite multimedia signal may be encoded in a frame format including an active zone and a blanking zone. The composite multimedia signal may be associated with a plurality of multimedia signals acquired by a plurality of acquisition devices. The method may further include inserting one or more control signals in a predetermined section of the blanking zone. The method may further include transmitting the one or more control signals to one or more target acquisition devices of the plurality of acquisition devices via a transmission medium.
In some embodiments, each of the one or more control signals may be associated with an identity. The transmitting the one or more control signals to the one or more target acquisition devices may include transmitting the one or more control signals to the one or more target acquisition devices based on one or more identities.
Additional features will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The features of the present disclosure may be realized and attained by practice or use of various aspects of the methodologies, instrumentalities, and combinations set forth in the detailed examples discussed below.
The present disclosure is further described in terms of exemplary embodiments. These exemplary embodiments are described in detail with reference to the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures throughout the several views of the drawings, and wherein:
In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant disclosure. However, it should be apparent to those skilled in the art that the present disclosure may be practiced without such details. In other instances, well-known methods, procedures, systems, components, and/or circuitry have been described at a relatively high-level, without detail, in order to avoid unnecessarily obscuring aspects of the present disclosure. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments shown, but to be accorded the widest scope consistent with the claims.
It will be understood that the term “system,” “engine,” “unit,” “module,” and/or “block” used herein are one method to distinguish different components, elements, parts, section or assembly of different level in ascending order. However, the terms may be displaced by other expression if they may achieve the same purpose.
Generally, the word “module,” “unit,” or “block,” as used herein, refers to logic embodied in hardware or firmware, or to a collection of software instructions. A module, a unit, or a block described herein may be implemented as software and/or hardware and may be stored in any type of non-transitory computer-readable medium or other storage device. In some embodiments, a software module/unit/block may be compiled and linked into an executable program. It will be appreciated that software modules can be callable from other modules/units/blocks or from themselves, and/or may be invoked in response to detected events or interrupts. Software modules/units/blocks configured for execution on computing devices (e.g., processor 210 as illustrated in
It will be understood that when a unit, engine, module, or block is referred to as being “on,” “connected to,” or “coupled to” another unit, engine, module, or block, it may be directly on, connected or coupled to, or communicate with the other unit, engine, module, or block, or an intervening unit, engine, module, or block may be present, unless the context clearly indicates otherwise. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
The terminology used herein is for the purposes of describing particular examples and embodiments only and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “include” and/or “comprise,” when used in this disclosure, specify the presence of integers, devices, behaviors, stated features, steps, elements, operations, and/or components, but do not exclude the presence or addition of one or more other integers, devices, behaviors, features, steps, elements, operations, components, and/or groups thereof.
The term “multimedia” may refer to a means or tool for storing and delivering information that uses one content form or a combination of different content forms, such as but not limited to text, an audio, an image, an animation, a video, an interactive content, or the like, or any combination thereof. The term “multimedia signal” may refer to a signal in any signal form (e.g., a digital signal, an analog signal, a combination of digital signal and analog signal) that encodes multimedia content. The term “composite multimedia digital signal” may refer to a digital signal that combines two or more multimedia signals. The term “composite multimedia signal” may refer to an analog signal or a mixed signal of digital signals and analog signals that combines two or more multimedia signals.
An aspect of the present disclosure relates to systems and methods for processing and transmitting a plurality of multimedia signals received from a plurality of channels. The systems and methods may generate a composite multimedia digital signal by coding the multimedia signals in a frame format. The frame format may include an active zone configured to encode at least part of the multimedia signals and a blanking zone configured to encode format information. The systems and methods may covert at least a portion of the encoded multimedia signals in the active zone into analog signals to generate a composite multimedia signal. Compared with the original multimedia signals which may be transmitted via a plurality of transmission medium, the composite multimedia signal may be transmitted via a single transmission medium. In addition, the composite multimedia signal, as a mixed signal of digital signals and analog signals, may be more suitable for long-distance transmission than the composite multimedia digital signal. As such, the multimedia signals may be transmitted in a more efficient and economic manner.
The server 110 may process information and/or data relating to the multimedia system 100 to perform one or more functions described in the present disclosure. In some embodiments, the server 110 may include one or more processing engines 112 (e.g., single-core processing engine(s) or multi-core processor(s)). Merely by way of example, the processing engine 112 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction-set processor (ASIP), a graphics processing unit (GPU), a physics processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction-set computer (RISC), a microprocessor, or the like, or any combination thereof.
The server 110 may be a single server or a server group. The server group may be centralized, or distributed (e.g., server 110 may be a distributed system). In some embodiments, the server 110 may be local or remote. For example, the server 110 may access information and/or data stored in the acquisition device 130, and/or the storage device 120 via the network 150. As another example, the server 110 may be directly connected to the acquisition device 130, and/or the storage device 120 to access stored information and/or data. In some embodiments, the server 110 may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof. In some embodiments, the server 110 may be implemented on a computing device 200 having one or more components illustrated in
The storage device 120 may store data and/or instructions. The data and/or instructions may be obtained from, for example, the server 110, the acquisition device 130, and/or any other component of the multimedia system 100.
In some embodiments, the storage device 120 may store data and/or instructions that the server 110 may execute or use to perform exemplary methods described in the present disclosure. For example, the storage device 120 may store multimedia signals acquired by one or more acquisition devices 130. As another example, the storage device 120 may store a composite multimedia (digital) signal generated based on the multimedia signals. In some embodiments, the storage device 120 may include a mass storage, a removable storage, a volatile read-and-write memory, a read-only memory (ROM), or the like, or any combination thereof. Exemplary mass storage may include a magnetic disk, an optical disk, a solid-state drives, etc. Exemplary removable storage may include a flash drive, a floppy disk, an optical disk, a memory card, a zip disk, a magnetic tape, etc. Exemplary volatile read-and-write memory may include a random access memory (RAM). Exemplary RAM may include a dynamic RAM (DRAM), a double date rate synchronous dynamic RAM (DDR SDRAM), a static RAM (SRAM), a thyristor RAM (T-RAM), and a zero-capacitor RAM (Z-RAM), etc. Exemplary ROM may include a mask ROM (MROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a compact disk ROM (CD-ROM), and a digital versatile disk ROM, etc. In some embodiments, the storage device 120 may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof.
In some embodiments, the storage device 120 may be connected to the network 150 to communicate with one or more components of the multimedia system 100 (e.g., the server 110, the acquisition device 130). One or more components of the multimedia system 100 may access the data or instructions stored in the storage device 120 via the network 150. In some embodiments, the storage device 120 may be directly connected to or communicate with one or more components of the multimedia system 100 (e.g., the server 110, the acquisition device 130). In some embodiments, the storage device 120 may be part of another component of the multimedia system 100, such as the server 110, the acquisition device 130, or the output device 140.
In some embodiments, one or more components of the multimedia system 100 (e.g., the server 110, the acquisition device 130) may have a permission to access the storage device 120. For example, the server 110 or the acquisition device 130 may read and/or modify the format of a composite multimedia digital signal stored in the storage device 120.
The acquisition device 130 may be and/or include any suitable device that is capable of acquiring a multimedia signal. Exemplary acquisition devices may include a camera (e.g., a digital camera, an analog camera, an IP camera (IPC)), a video recorder, a scanner, a mobile phone, a tablet computing device, a wearable computing device, a monitoring equipment, an infrared imaging device (e.g., a thermal imaging device), a microphone, or the like. In some embodiments, the acquisition device 130 may include a mobile phone 130-1, a computer 130-2, a surveillance camera 130-3, a microphone 130-4, etc. The computer 130-2 may include but not limit to a laptop, a tablet computer, a desktop, or the like, or any combination thereof. The surveillance camera 130-3 may include but not limit to a gun camera, a dome camera, an integrated camera, a monocular camera, a binocular camera, a multi-view camera, or the like, or any combination thereof. The multimedia signal acquired by the acquisition device 130 may include a video signal, an audio signal, an image signal, a text signal, an animation signal, or the like, or any combination thereof. In some embodiments, the acquisition device 130 may include a plurality of components each of which can acquire a multimedia signal. For example, the acquisition device 130 may include a plurality of sub-cameras that can take pictures or videos simultaneously. As another example, the acquisition device 130 may include a camera and a microphone.
The output device 140 may be and/or include any suitable device that can display or output information in a human-readable form, such as text, image, audio, video, graph, animation, or the like, or any combination thereof. Exemplary output devices may include a mobile device 140-1, a computer 140-2, a display device 140-3, a loudspeaker 140-4, a headset, a microphone, a music player, an e-book reader, a printer, a projector, or the like, or a combination thereof. The mobile device 140-1 may include a mobile phone, a personal digital assistant (PDA), or the like. The computer 140-2 may include a laptop, a tablet computer, a desktop, or the like. The display deivce 140-3 may include a cathode ray tube (CRT) display, a liquid crystal display (LCD), a light emitting diode (LED) display, a plasma display panel (PDP), a 3D display, or the like. In some embodiments, the output device 140 may be connected to one or more components of the multimedia system 100 (e.g., the server 110, the storage device 120, the acquisition device 130) via the network 150, such as a wireless network or a wired network (e.g., a coaxial cable network).
The network 150 may include any suitable network that can facilitate exchange of information and/or data for the multimedia system 100. In some embodiments, one or more components in the multimedia system 100 (e.g., the server 110, the storage device 120, and the acquisition device 130) may send information and/or data to another component(s) in the multimedia system 100 via the network 150. For example, the server 110 may obtain/acquire multimedia signals from the acquisition device 130 via the network 150. In some embodiments, the network 150 may be any type of wired or wireless network, or combination thereof. Merely by way of example, the network 150 may include a cable network (e.g., a coaxial cable network), a wireline network, an optical fiber network, a telecommunications network, an intranet, an Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a wide area network (WAN), a public telephone switched network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, or the like, or any combination thereof.
In some embodiments, the multimedia system 100 may include a receiving device (not shown in the
It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. For example, the multimedia system 100 may include one or more terminals (e.g., a console) configured to receive a user input. As another example, the processing engine 112 may be integrated into the acquisition device 130. However, those variations and modifications do not depart from the scope of the present disclosure.
The processor 210 may execute computer instructions (e.g., program code) and perform functions of the processing engine 112 in accordance with techniques described herein. The computer instructions may include, for example, routines, programs, objects, components, data structures, procedures, modules, and functions, which perform particular functions described herein. For example, the processor 210 may process multimedia signals obtained from the acquisition device 130, the storage device 120, and/or any other component of the multimedia system 100. In some embodiments, the processor 210 may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application specific integrated circuits (ASICs), an application-specific instruction-set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physics processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of executing one or more functions, or the like, or any combinations thereof.
Merely for illustration, only one processor is described in the computing device 200. However, it should be noted that the computing device 200 in the present disclosure may also include multiple processors, thus operations and/or method steps that are performed by one processor as described in the present disclosure may also be jointly or separately performed by the multiple processors. For example, if in the present disclosure the processor of the computing device 200 executes both step A and step B, it should be understood that step A and step B may also be performed by two or more different processors jointly or separately in the computing device 200 (e.g., a first processor executes step A and a second processor executes step B, or the first and second processors jointly execute steps A and B).
The storage 220 may store data/information obtained from the server 110, the acquisition device 130, the storage device 120, and/or any other component of the multimedia system 100. In some embodiments, the storage 220 may include a mass storage, a removable storage, a volatile read-and-write memory, a read-only memory (ROM), or the like, or any combination thereof. For example, the mass storage may include a magnetic disk, an optical disk, a solid-state drive, etc. The removable storage may include a flash drive, a floppy disk, an optical disk, a memory card, a zip disk, a magnetic tape, etc. The volatile read-and-write memory may include a random access memory (RAM). The RAM may include a dynamic RAM (DRAM), a double date rate synchronous dynamic RAM (DDR SDRAM), a static RAM (SRAM), a thyristor RAM (T-RAM), and a zero-capacitor RAM (Z-RAM), etc. The ROM may include a mask ROM (MROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a compact disk ROM (CD-ROM), and a digital versatile disk ROM, etc. In some embodiments, the storage 220 may store one or more programs and/or instructions to perform exemplary methods described in the present disclosure.
The I/O 230 may input and/or output signals, data, information, etc. In some embodiments, the I/O 230 may enable a user interaction with the processing engine 112. In some embodiments, the I/O 230 may include an input component and an output component. Examples of the input component may include a keyboard, a mouse, a touch screen, a microphone, or the like, or a combination thereof. Examples of the output component may include a display device, a loudspeaker, a printer, a projector, or the like, or a combination thereof. Examples of the display device may include a liquid crystal display (LCD), a light-emitting diode (LED)-based display, a flat panel display, a curved screen, a television device, a cathode ray tube (CRT), a touch screen, or the like, or a combination thereof.
The communication port 240 may be connected to a network (e.g., the network 150) to facilitate data communications. The communication port 240 may establish connections between the processing engine 112 and the server 110, the acquisition device 130, the output device 140, and/or the storage device 120. The connection may be a wired connection, a wireless connection, any other communication connection that can enable data transmission and/or reception, and/or any combination of these connections. The wired connection may include, for example, an electrical cable, an optical cable, a telephone wire, or the like, or any combination thereof. The wireless connection may include, for example, a Bluetooth™ link, a Wi-Fi™ link, a WiMax™ link, a WLAN link, a ZigBee link, a mobile network link (e.g., 3G, 4G, 5G, etc.), or the like, or a combination thereof. In some embodiments, the communication port 240 may be and/or include a standardized communication port, such as RS232, RS485, etc. In some embodiments, the communication port 240 may be a specially designed communication port. For example, the communication port 240 may be designed in accordance with analog signal transmission.
The acquisition module 310 may be configured to obtain information related to the multimedia system 100. For example, the acquisition module 310 may obtain at least two multimedia signals from a plurality of channels. Each of the at least two multimedia signals may be received from one of the plurality of channels. The at least two multimedia signals (also be referred to as the multimedia signals for brevity) may be of the same type or different types of multimedia signals. For example, the multimedia signals may include a video signal, an audio signal, a combined signal of video signal and audio signal, an image signal, an animation signal, or the like, or a combination thereof. More descriptions regarding the multimedia signals may be found elsewhere in the present disclosure (e.g., operation 410 in
The generation module 320 may be configured to generate a composite multimedia digital signal based on the multimedia signals obtained by the acquisition module 310. In some embodiments, the generation module 320 may generate the composite multimedia digital signal by coding the multimedia signals in a frame format. The frame format may include an active zone and a blanking zone. The active zone may be used to encode at least part of the multimedia signals. The blanking zone may be used to encode format information. More descriptions regarding the generation of the composite multimedia digital signal may be found elsewhere in the present disclosure (e.g., operation 420 in
The conversion module 330 may be configured to convert at least part of the encoded multimedia signals in the active zone of the composite multimedia digital signal into analog signals. The converted composite multimedia digital signal may be a mixed signal of digital signals and analog signals, and be referred to as a composite multimedia signal. More descriptions regarding the conversion of the composite multimedia digital signal may be found elsewhere in the present disclosure (e.g., operation 430 in
The transmission module 340 may be configured to transmit the composite multimedia signal to a receiving device via a transmission medium. The transmission medium may include any transmission medium that can transmit analog signals and digital signals, such as a coaxial cable, a twisted pair cable, an optical fiber, or the like, or any combination thereof. More descriptions regarding the transmission of the composite multimedia signal may be found elsewhere in the present disclosure (e.g., operation 440 in
It should be noted that the above descriptions of the processing engine 112 are merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, various modifications and changes in the forms and details of the application of the above method and system may occur without departing from the principles of the present disclosure. For example, the generation module 320 and the conversion module 330 may be integrated into a module configured to generate the composite multimedia signal based on the multimedia signals. However, those variations and modifications also fall within the scope of the present disclosure.
In 410, the acquisition module 310 may receive at least two multimedia signals from a plurality of channels. Each of the at least two multimedia signals may be received from one of the plurality of channels.
The at least two multimedia signals (also be referred to as the multimedia signals for brevity) may be of the same type or different types of multimedia signals. For example, the multimedia signals may include a video signal, an audio signal, a combined signal of video signal and audio signal, an image signal, an animation signal, or the like, or a combination thereof. In some embodiments, each of the multimedia signals may include a video signal and/or an audio signal. In some embodiments, the multimedia signals may be of any signal form, such as a digital signal, an analog signal, or a combined signal of digital signal and analog signal. Different multimedia signals may be of the same signal form or different signal forms.
In some embodiments, a channel may correspond to an acquisition device 130 or an acquisition component of the acquisition device 130 from which a multimedia signal is received. For example, the multimedia signals may be received from different acquisition devices 130 (e.g., different surveillance cameras with different monitor areas). As another example, two or more of the multimedia signals may be received from different acquisition components of one acquisition device 130 (e.g., different cameras of a multi-view camera). As used herein, if two multimedia signals are received from two acquisition components of an acquisition device 130, the two multimedia signals may be regarded as being received from two channels.
In some embodiments, at least one of the multimedia signals may include a video signal. The video signal may be received from an acquisition device 130 that include a video signal acquisition unit. In some embodiments, at least one of the multimedia signals may include an audio signal. The audio signal may be received from an acquisition device 130 that includes an audio signal acquisition unit.
In 420, the generation module 320 may generate a composite multimedia digital signal by coding the at least two multimedia signals in a frame format.
The composite multimedia digital signal in the frame format may include one or more frames. The frame format of a frame may include an active zone and a blanking zone. The active zone may be used to encode at least part of the multimedia signals. The active zones of different frames may encode the same multimedia signal(s) or different multimedia signals. For illustration purposes, an active zone that encodes all the multimedia signals obtained in operation 410 is described as an example. It should be noted that the embodiments of the present disclosure, with minor modifications known by a person skilled in the art, can be applied to an active zone that encodes a portion of the multimedia signals obtained in operation 410. The blanking zone may be used to encode format information. In some embodiments, the format information may be related to the format of the frame, the active zone, and/or the blanking zone. Details regarding the frame format of a frame may be found elsewhere in the present disclosure (e.g.,
The composite multimedia digital signal may be a digital signal. In some embodiments, the multimedia signals received in operation 410 may all be digital signals. The composite multimedia digital signal may be directly generated by coding the digital signals of the multimedia signals. Alternatively, a portion or all of the multimedia signals received in operation 410 may be analog signal(s). The generation module 320 may first convert the analog signal(s) into digital signal(s), and then generate the composite multimedia digital signal by coding the converted multimedia signal(s) and the original digital multimedia signal(s) (if any).
In 430, the conversion module 330 may convert at least part of the encoded multimedia signals in the active zone of the composite multimedia digital signal into analog signals. The converted composite multimedia digital signal may be a mixed signal of digital signals and analog signals, and be referred to as a composite multimedia signal.
In some embodiments, one or more of the multimedia signals may include a video signal, the conversion module 330 may convert the portion of the composite multimedia digital signal which corresponds to the video signal(s) into analog signals. In some embodiments, one or more of the multimedia signals may include a video signal and an audio signal, the conversion module 330 may convert the portion of the composite multimedia digital signal which corresponds to the video signal(s) and the audio signal(s) into analog signal. For brevity, the portion of the composite multimedia digital signal which corresponds to the video/audio signal may be referred to as the video/audio signal. In some embodiments, the conversion module 330 may instruct a digital-to-analog converter (DAC) or any other device for digital-analog conversion to perform the digital-analog conversion.
Compared with the composite multimedia digital signal, the composite multimedia signal may be more suitable for long-distance (e.g., longer than a predetermined distance) transmission. Typically, the transmission distance of a transmission medium for digital signals, such as a video graphics array (VGA) cable or a network cable may be equal to or smaller than 100 meters. A digital signal may need to be compressed for long-distance transmission, which may result in a transmission delay. The transmission distance of a transmission medium for analog signals may be about 300 meters, or even about 500 meters.
In some embodiments, the format information encoded in the blanking zone and/or audio signal(s) in the active zone may not be converted into analog signals. The format information and/or the audio signal(s) may have a much smaller size than the video signal(s) in the active zone. For example, the size of the blanking zone for encoding the format information may be smaller than 10 bytes. The size of the audio signal(s) may be 8 bytes or 16 bytes. The small sized format information and/or audio signals, even being of digital signals, can be transmitted for a long distance at a low transmission speed. The low transmission speed may refer to a transmission speed smaller than a threshold speed (e.g., 9600 bps, 1 kps, 1.17 kps, or 10 kps).
In 440, the transmission module 340 may transmit the composite multimedia signal to a receiving device via a transmission medium.
The transmission medium may include any transmission medium that can transmit analog signals and digital signals, such as a coaxial cable, a twisted pair cable, an optical fiber, or the like, or any combination thereof.
In order to ensure the transmission of the composite multimedia signal, the maximum transmission bandwidth supported by the transmission medium may be equal to or greater than a required transmission bandwidth of the composite multimedia signal. For example, if the composite multimedia signal is generated based on two multimedia signals each of which requires a transmission bandwidth bw_s for transmission, the maximum transmission bandwidth supported by the transmission medium may have to be equal to or greater than 2*bw_s.
In some embodiments, after the receiving device receives the composite multimedia signal, the analog signals of the composite multimedia signal may be converted into digital signals. The conversion may be implemented by an analog-to digital-converter (ADC) or any other device for analog-to-digital conversion. In some embodiments, the converted composite multimedia signal may be same as or substantially similar to the composite multimedia digital signal as described in connection with operation 420. In some embodiments, the receiving device may further demodulate the converted composite multimedia signal, and transmit the demodulated signal to one or more output devices. Details regarding the processing of the composite multimedia signal may be found elsewhere in the present disclosure (e.g.,
It should be noted that the above description regarding the process 400A is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure. In some embodiments, one or more other optional operations may be added in the process 400A or one or more operations in the process 400A may be omitted.
In some embodiment, the multimedia signals received in 410 may include valid data (e.g., video signals and/or audio signals) as well as other data (e.g., blanking zones, blanking lines). The processing engine 112 may extract the valid data from multimedia signals and then generate the composite multimedia digital signal based on the valid data. In some embodiments, each of the multimedia signals may include one or more horizontal synchronization signals and/or one or more frame synchronization signals. A horizontal synchronization signal may indicate a start of an active line. A frame synchronization signal may indicate a start of a frame. In some embodiments, before encoding the multimedia signals, the processing engine 112 may detect the horizontal synchronization signal(s) and/or the frame synchronization signal(s) in each multimedia signal. The processing engine 112 may then extract valid data from the multimedia signals based on the detected horizontal synchronization signal and/or frame synchronization signal in each multimedia signal. For example, the valid data may include data (e.g., audio signals and/or video signals) encoded between two adjacent horizontal synchronization signals or two adjacent frame synchronization signals. The processing engine 112 may further generate the composite multimedia digital signal by coding the valid data in the frame format as described in connection with operation 420. The coding of the valid data may be similar to that of multimedia signals, and the descriptions thereof are not repeated here.
In some embodiments, the multimedia signals received in operation 410 may include one or more modulated multimedia signals and/or one or more unmodulated multimedia signals. In operation 420, the generation module 320 may directly generate the composite multimedia digital signal by coding the one or more modulated multimedia signals and/or one or more unmodulated multimedia signals. Alternatively, in operation 420, the generation module 320 may modulate the unmodulated multimedia signal(s), and generate the composite multimedia signal based on the modulated multimedia signal(s) and the original modulated multimedia signal(s) (if any).
In some embodiments, the conversion module 330 may compress a portion or all of the composite multimedia signal before transmitting the composite multimedia signal to the receiving device. For example, the conversion module 330 may compressed audio signals in the composite multimedia signal according to various audio compressing techniques. As another example, the conversion module 330 may compressed video signals in the composite multimedia signal according to various video compressing techniques. The receiving device may decompress the compressed portion in the composite multimedia signal after receiving the composite multimedia signal.
As shown in
The active zone 450 may include a plurality of active lines 470 (e.g., active lines 470A to 470N). The number of the active lines 470 may be any positive value. The number of the active lines 470 may be a preset parameter or be adjusted according to different application scenarios. In some embodiments, the number of the active lines 470 may be determined based on the size of the composite multimedia digital signal. The size of the composite multimedia digital signal may be related to, for example, the resolution of the video signals that form the composite multimedia digital signal. For example, if the composite multimedia digital signal is generated based on four 720p video signals whose resolutions are all 1280*720, the resolution of the composite multimedia digital signal may be 2560*1440. In that case, the number of active lines 470 may be equal to or greater than 1440.
In some embodiments, at least one of the multimedia signals may include a video signal. The video signal may be encoded in one or more of the active lines 470. In some embodiments, two or more of the multimedia signals may include a video signal. The video signals may form one or more combinations of video signals each of which is encoded in one or more active lines 470. For brevity, a combination of video signals may be referred to as a video combination. The video combination encoded in different active lines 470 may be the same or different. For example, as illustrated in
In some embodiments, a separator 475 may be inserted in an active line 470 between a pair of adjacent video signals to distinguish the two adjacent video signals. For example, as illustrated in
The active zone 450 may also include one or more horizontal blanking zones 480. Each of the horizontal blanking zone(s) 480 may be located between a pair of adjacent active lines 470. In some embodiments, the active zone 450 may include a horizontal blanking zone 480 between each pair of active lines 470. Optionally, the active zone 450 may further include an extra horizontal blanking zone 480 corresponding to the first active line 470 or the last active line 470. In that case, the number of the active lines 470 may be equal to that of the horizontal blanking zones 480. Each active line 470 may have a corresponding horizontal blanking zone 480 that is adjacent to it.
In some embodiments, each of the horizontal blanking zone(s) 480 may include a horizontal synchronization signal 485 configured to indicate the start of an active line 470. In order to distinguish the separator 475 and the horizontal synchronization signal 485, the separator 475 and the horizontal synchronization signal 485 may be assigned with different time widths. Merely by way of example, the time width of the separator 475 may be equal to the half of the time width of the horizontal synchronization signal 485.
In some embodiments, one or more of the multimedia signals may include an audio signal. In the generation of the composite multimedia digital signal, the processing engine 112 may encode the audio signal(s) into one or more horizontal blanking zones 480. Different horizontal blanking zones 480 may encode the same audio signal(s) or different audio signals. In some embodiments, the audio signal(s) may be encoded into all or a portion of the horizontal blanking zone(s) 480 of the frame 400B. In some embodiments, each audio signal of the multimedia signals may be encoded in one horizontal blanking zone 480, respectively. For example, if the number of the audio signal(s) is M, M active lines 470 and their corresponding horizontal blanking zones 480 may be designated as a cycle. Each horizontal blanking zone 480 in the cycle may encode an audio single of the M audio signal(s). Different horizontal blanking zones 480 in the cycle may encode different audio signals.
In some embodiments, each of the multimedia signals may include a video signal and a corresponding audio signal. The video signals may form one or more video combinations each of which is encoded in one or more active lines 470. The audio signals may also form one or more combinations of audio signals each of which is encoded in one or more horizontal blanking zones 480. For brevity, a combination of audio signals may be referred to as an audio combination. In some embodiments, the audio combination(s) may be formed according to the video combination(s). Merely by way of example, for an active line 470, the processing engine 112 may determine an audio combination according to the video combination in the active line 470. The audio combination may include audio signals that correspond to the video signals in the video combination. The processing engine 112 may then encode the audio combination into the horizontal blanking zone 480 corresponding to the active line 470. Take the combination of video signals 1 and 2 in the active lines 470A as an example, the processing engine 112 may determine an audio combination corresponding to the combination of video signal 1 and 2. The audio combination may include an audio signal corresponding to the video signal 1 and an audio signal corresponding to the video signal 2. The audio combination may be encoded into a horizontal blanking zone 480 corresponding to the active line 470A (e.g., the horizontal blanking zone 480 between the active lines 470A and 470B).
In some embodiments, the size of a horizontal blanking zone 480 may vary depending on the amount of audio signals encoded in the horizontal blanking zone 480. For example, a horizontal blanking zone 480 encoding fewer audio signals may have a relative smaller size than that encoding more audio signals. As another example, if the video signals in an active line A have more corresponding audio signals than that of an active line B, the horizontal blanking zone 480 corresponding the active line A may have a relative larger size than the horizontal blanking zone 480 corresponding to the active line B. As such, the horizontal blanking zone(s) 480 may satisfy the loading requirement of audio signals, and at the same time, the bandwidth utilization may be increased.
In some embodiments, the format of the active zone 450 may be indicated and/or prescribed by the format information encoded in the blanking zone 460. For example, two or more of the multimedia signals may include a video signal. The format information in the blanking zone 460 may indicate a combination form of the video signals in the active lines 470. The combination form may include a combination of the video signals encoded in each active line 470. As another example, two or more of the multimedia signal may include an audio signal. The format information in the blanking zone 460 may indicate a combination form of the audio signals in one or more horizontal blanking zones 480. For illustration purposes, an example of format information regarding the active zone 450 encoded in the blanking zone 460 is illustrated in Table. 1 below:
where “Header” refers to a code header; “M” denotes the total number of the video signals; “ID-0”, “ID-1”, . . . , and “ID-M” respectively refers to a video signal; “CRC” refers to a cyclic redundancy check code; and “SPR” refers a separator between two adjacent active lines 470 configured to distinguish the adjacent active lines 470. For example, Table. 1 shows that a combination of video signals ID-0 and ID-1, a combination of video signal ID-3 and ID-4, and a combination of video signals ID-(M-1) and ID-M are encoded in an active line 470, respectively. In some embodiments, the “SPR” may include a horizontal synchronization signal 485.
It should be noted that the above description of the frame 400B of the composite multimedia signal is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure. In some embodiments, the active zone 470 may encode any type of multimedia signals other than video signals and audio signals, such as an image signal, an animation signal, or the like, or any combination thereof. In some embodiments, the multimedia signals may be encoded in the active line 470 in any combination form.
In some embodiments, key information contained in or related to the multimedia signals may be detected, and the frame format of the composite multimedia digital signal generated based on the multimedia signals may be adjusted upon the detection of the key information. The key information may include any object (e.g., a human, a human face, a vehicle, smoke, fire) and/or event (e.g., a motion of human) that a user may be interested in. The key information may be detected by the acquisition device(s) 130 of the multimedia signals and/or the processing engine 112 by analyzing the multimedia signals. Additionally or alternatively, the key information may be detected by another component of the multimedia system 100, such as a smoke detector, a thermometer, and/or a flame detector installed near or in the acquisition device(s) 130. In some embodiments, the generation module 320 may insert a signal (e.g., an alarm signal) corresponding to the key information in the composite multimedia digital signal to indicate the existence of the key information. For example, the signal corresponding to the key information may be inserted into a blanking zone 460 or a horizontal blanking zone 480 of a frame in which the key information is included. In some embodiments, the processing engine 112 may adjust the sizes of different frames or the resolutions of different multimedia signals in the composite multimedia digital signal in response to the detection of the key information. Merely by way of example, if a certain multimedia signal is determined to contain key information in a certain frame, the frame that encodes the certain multimedia signal may be adjusted to have a larger size to support a higher resolution for the multimedia signal.
In some embodiments, the generation module 320 may insert one or more notification signals associated with the acquisition devices in a predetermined section of the blanking zone. For example, the generation module 320 may insert a notification signal indicating an alarm (e.g., a smoke alarm, a fire alarm) associated with an acquisition device in the predetermined section of the blanking zone. In some embodiments, each of the one or more notification signals may be associated with an identity (e.g., an ID, an address) which may be used to identify a corresponding acquisition device.
The receiving module 510 may be configured to receive information related to the multimedia system 100. For example, the receiving module 510 may receive a composite multimedia signal in a frame format. The composite multimedia signal be generated based on at least two multimedia signals received from a plurality of channels. The frame format may include an active zone and a blanking zone. The active zone may be configured to encode analog signals, which are converted from at least part of the multimedia signals. The blanking zone may be configured to encode format information. Details regarding the composite multimedia signal may be found elsewhere in the present disclosure (e.g., operation 430 in
The conversion module 520 may be configured to convert the analog signals in the active zone of the composite multimedia signal into digital signals. The converted composite multimedia signal may be a digital signal and referred to as a composite multimedia digital signal. In some embodiments, the conversion module 520 may instruct an analog-to-digital converter (ADC) or any other device for analog-to-digital conversion to perform the analog-to-digital conversion.
The demodulation module 530 may be configured to demodulate the composite multimedia digital signal according to the format information encoded in the blanking zone. In the demodulation, the demodulation module 530 may extract valid information (i.e., the demodulated composite multimedia digital signal) from a carrier wave. Additionally or alternatively, the demodulation module 530 may determine the structure and components of the demodulated composite multimedia digital signal according to the format information. For example, the demodulation module 530 may extract the multimedia signals encoded in the composite multimedia digital signal according to the format information. Details regarding the demodulation of the composite multimedia digital signal may be found elsewhere in the present disclosure (e.g., operation 630 in
The transmission module 540 may be configured to transmit the demodulated composite multimedia digital signal. For example, the transmission module 540 may transmit the demodulated composite multimedia digital signal to one or more output devices 140. In some embodiments, the demodulation module 530 may extract the multimedia signals encoded in the composite multimedia digital signal, and the transmission module 540 may transmit each multimedia signal to a distinctive output device 140. In some embodiments, the transmission module 540 may transmit two or more of the multimedia signals to the same output device 140.
It should be noted that the above descriptions of the receiving device 500 are merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, various modifications and changes in the forms and details of the application of the above method and system may occur without departing from the principles of the present disclosure. For example, the conversion module 520 and the demodulation module 530 may be integrated into a module to convert and demodulate the composite multimedia signal. However, those variations and modifications also fall within the scope of the present disclosure.
In 610, the receiving module 510 may receive a composite multimedia signal in a frame format.
In some embodiments, the composite multimedia signal may be generated based on at least two multimedia signals received from a plurality of channels. The at least two multimedia signals may also be referred to as multimedia signals for brevity. The multimedia signals may include a video signal, an audio signal, a text signal, an image signal, or the like, or any combination thereof. In some embodiments, a channel may correspond to an acquisition device or an acquisition component of the acquisition device 130 from which a multimedia signal is received. The multimedia signals may be substantially similar to the multimedia signals described in connection with operation 410, and the descriptions thereof are not repeated here.
The composite multimedia signal in the frame format may include one or more frames. The frame format of a frame may include an active zone and a blanking zone. The blanking zone may be configured to encode format information. The format information may include format information related to the format of the frame, the active zone, and/or the blanking zone. In some embodiments, a portion or all of the multimedia signals may be converted into analog signals in the generation of the composite multimedia signal. The active zone may be configured to encode the analog signals converted from the portion or all of the multimedia signals. Optionally, a portion of the multimedia signals may not be converted into analog signals in the generation of the composite multimedia signal. The active zone may be further configured to encode the unconverted part of the multimedia signals. For example, each of the multimedia signals may include a video signal and an audio signal. The video signals may be converted into analog signals. The audio signals and the analog signals converted from the video signals may be encoded in the active zone. In some embodiments, the composite multimedia signal may be generated based on the multimedia signals by performing operations 410 to 430 as described in connection with
In 620, the conversion module 520 may convert the analog signals in the active zone into digital signals. The converted composite multimedia signal may be a digital signal and referred to as a composite multimedia digital signal. The format of the composite multimedia digital signal may be similar to that described in operation 420, and the descriptions thereof are not repeated. In some embodiments, the conversion module 520 may instruct an analog-to-digital converter (ADC) or any other device for analog-to-digital conversion to perform the analog-to-digital conversion.
In 630, the demodulation module 530 may demodulate the composite multimedia digital signal according to the format information encoded in the blanking zone. In the demodulation, the demodulation module 530 may extract valid information (i.e., the demodulated composite multimedia digital signal) from a carrier wave.
In some embodiments, the demodulation module 530 may determine the structure and components of the demodulated composite multimedia digital signal according to the format information. For example, as described in connection with
In some embodiments, the demodulation module 530 may determine one or more parameters related to the multimedia signals, such as the brightness, the chromaticity, or the like in the signal demodulation.
In 640, the transmission module 540 may transmit the demodulated composite multimedia digital signal to one or more output devices 140.
Exemplary output device 140 may include a mobile device 140-1, a computer 140-2, a display device 140-3, a loudspeaker 140-4, a headset, a microphone, a music player, an e-book reader, a printer, a projector, or the like, or a combination thereof. In some embodiments, the demodulation module 530 may extract the multimedia signals in the demodulated composite multimedia digital signal as described in connection with operation 630. The transmission module 540 may transmit each multimedia signal to a suitable output device 140. For example, the transmission module 540 may transmit an audio signal to an audio output device. In some embodiments, the transmission module 540 may transmit each multimedia signal to a distinctive output device 140. In some embodiments, the transmission module 540 may transmit two or more of the multimedia signals to a same output device 140. In some embodiments, each of the multimedia signals may be associated with an identity (e.g., an ID, an address) which may be used to identify a corresponding output device. The transmission module 540 may transmit the multimedia signals to the output devices based on the identities.
It should be noted that the above description regarding the process 600 is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure. For example, the receiving device may include one or more output components. Additionally or alternatively, the output device(s) 140 may be integrated into the receiving device, for example, as one or more output components. The receiving device may process the composite multimedia signal to extract the multimedia signals, and output at least part of the multimedia signals by itself.
In some embodiments, the receiving device may transmit a control signal to one or more acquisition devices that acquire the multimedia signals. The control signal may control the acquisition device(s) to perform a certain action, for example, to take a picture, rotate, or stop operating. In some embodiments, when receiving the composite multimedia signal, the receiving device may determine whether currently received data is encoded in the blanking zone of the composite multimedia signal. Upon a determination that the currently received data is encoded in the blanking zone, the receiving device may transmit the control signal to the one or more acquisition device(s).
In the field of video surveillance, a video signal (e.g., an analogy video signal) is typically transmitted through a transmission medium with a transmission bandwidth of 2 k. When transmitting a plurality of video signals acquired from a plurality channels, each video signal may need a transmission medium with 2 k transmission bandwidth, which may result in a waste of transmission recourses. For example, as illustrated in
When transmitting a plurality of video signals acquired from a plurality channels, a composite video signal or a composite digital video signal (collectively referred to as a composite video signal hereinafter) may be generated based on the plurality of video signals. In some embodiments, the composite video signal may be generated by performing the methods for generating a composite multimedia signal disclosed in the present disclosure (e.g., the process 400A). The composite video signal may be transmitted via a single transmission medium. For example, as shown in
Compared with the traditional ways of transmitting video signals as described in connection with
The composite video signal 1100 may be generated based on four 720p video signals (denoted as video signal 1, 2, 3, and 4) acquired from four channels. Each video signal may include 750 lines per frame and 1600 sample periods (e.g., luma sample periods) in each line. The video signal may include an active zone 1110 and a blanking zone 1120. The active zone 1110 may include 720 active lines and 1280 samples (e.g., luma samples or RGB samples) in each active line.
In some embodiments, the composite video signal 1100 may be generated by coding the video signals in a frame format by performing the methods for generating a composite multimedia signal disclosed in the present disclosure (e.g., the process 400A). The composite video signal 1100 may include 1500 total lines per frame and 3200 sample periods (e.g., luma sample periods) in each line. The composite video signal 1100 may include an active zone 1130 and a blanking zone 1140. The active zone may include 1440 active lines and 2560 samples (e.g., luma samples or RGB samples) in each active line. The video signals 1 to 4 may be combined into one or more video combinations, which may be encoded in one or more active lines of the active zone 1130. For example, as illustrated in
The obtaining module 1210 may be configured to receive a composite multimedia signal, wherein the composite multimedia signal is encoded in a frame format including an active zone and a blanking zone described elsewhere in the present disclosure (e.g.,
The control module 1220 may be configured to insert one or more control signals in a predetermined section of the blanking zone, wherein the control signal(s) may be digital signal(s). In some embodiments, each of the one or more control signals may be associated with an identity (e.g., an ID, an address). The identity may be used to identify a corresponding acquisition device 130.
The transmission module 1230 may be configured to transmit the one or more control signals to one or more target acquisition devices of the plurality of acquisition devices via a transmission medium (e.g., a coaxial cable, a twisted pair cable, an optical fiber). In some embodiments, the transmission module 1230 may transmit the one or more control signals to the one or more target acquisition devices based on the one or more identities. In some embodiments, the transmission module 1230 may transmit the one or more control signals to the one or more target acquisition devices in a distribution mode or a broadcast mode.
The modules in
In 1310, the receiving device 1200 (e.g., the obtaining module 1210) may receive a composite multimedia signal, wherein the composite multimedia signal is encoded in a frame format including an active zone and a blanking zone. More descriptions of the frame format may be found elsewhere in the present disclosure (e.g.,
In some embodiments, as described in connection with operations 410-430, the composite multimedia signal may be associated with a plurality of multimedia signals (which may be digital signals, analog signals, or mixture of digital signals and analog signals) acquired by a plurality of acquisition devices. For example, the composite multimedia signal may be generated based on at least two multimedia signals received from a plurality of channels corresponding to the plurality of acquisition devices. The at least two multimedia signals may also be referred to as multimedia signals for brevity. The multimedia signals may include a video signal, an audio signal, a text signal, an image signal, or the like, or any combination thereof. In some embodiments, a channel may correspond to an acquisition device or an acquisition component of the acquisition device from which a multimedia signal is received. The multimedia signals may be substantially similar to the multimedia signals described in connection with operation 410, and the descriptions thereof are not repeated here.
As described elsewhere in the present disclosure, the active zone may be configured to encode the multimedia signals and the blanking zone may be configured to encode format information. Accordingly, a composite multimedia digital signal may be generated by encoding the multimedia signals (it is assumed that the multimedia signals are digital signals) in the frame format and the composite multimedia signal may be generated by converting at least part (e.g., the video signals included in the multimedia signals) of the encoded multimedia signals in the active zone into analog signals. As a result, the composite multimedia signal may include analog signals (e.g., analog video signals) and/or digital signals (e.g., digital audio signals) in the active zone and digital signals (e.g., digital signals corresponding to the key information contained in or related to the multimedia signals) in the blanking zone.
In 1320, the receiving device 1200 (e.g., the control module 1220) may insert one or more control signals in a predetermined section of the blanking zone, wherein the control signal(s) may be digital signal(s).
In some embodiments, each of the one or more control signals may be associated with an identity (e.g., an ID, an address). The identity may be used to identify a corresponding acquisition device. For example, it is assumed that the plurality of acquisition devices include an acquisition device A, an acquisition device B, and an acquisition device C, and it is assumed that the receiving device 1200 intends to provide a control signal to the acquisition device C, the receiving device 1200 may add an identity “C” to the control signal and insert the control signal together with the identity “C” in the blanking zone.
In some embodiments, as described in connection with
As illustrated in
In some embodiments, it is assumed that the available range is “ith line to jth line,” the multimedia system 100 may divide the available range into a first available range “ith line to xth line” (i.e., the predetermined section in which the notification signals may be inserted) and a second available range “(x+1)th line to jth line” (i.e., the predetermined section in which the control signals may be inserted).
In some embodiments, the receiving device 1200 may identify the predetermined position (which indicates the start of the available range of the blanking zone) based on the position of the frame header and a counter. In some embodiments, the receiving device 1200 may identify the predetermined position (which indicates the start of the available range of the blanking zone) based on the position of the frame header and a timer. As described elsewhere in the present disclosure, the frame includes a plurality of lines, each of which corresponds to an identifier. The counter and/or the timer may count and/or time from the framer header and identify the predetermined position based on the identifiers corresponding to the plurality of lines.
After identifying the predetermined position (which indicates the start of the available range of the blanking zone), the receiving device 1200 may identify the predetermined section in the available range and insert the one or more control signals in the predetermined section.
In 1330, the receiving device 1200 (e.g., the transmission module 1230) may transmit the one or more control signals to one or more target acquisition devices of the plurality of acquisition devices via a transmission medium (e.g., a coaxial cable, a twisted pair cable, an optical fiber). In some embodiments, the receiving device 1200 may transmit the one or more control signals to the one or more target acquisition devices based on the one or more identities.
In some embodiments, the receiving device 1200 may transmit the one or more control signals to the one or more target acquisition devices in a distribution mode or a broadcast mode. It is assumed that there are three control signals including a signal X, a signal Y, and a signal Z associated with an identity “X,” an identity “Y,” and an identity “Z” respectively, and there are three corresponding target acquisition devices including a device 1, a device 2, and a device 3. According to the distribution mode, the receiving device 1200 may transmit the signal X to the device 1 based on the identity “X,” transmit the signal Y to the device 2 based on the identity “Y,” and transmit the signal Z to the device 3 based on the identity “Z” successively or simultaneously. According to the broadcast mode, the receiving device 1200 may transmit all the three control signals to the three target acquisition devices.
In some embodiments, each of the one or more control signals may be associated with a control command which may be configured to control a corresponding acquisition device to adjust a working parameter. As used herein, the working parameter may include an orientation of the acquisition device, an acquisition resolution, a frame rate, a field of view, etc. After receiving the control signals, the target acquisition devices may adjust the working parameter based on the control commands.
In some embodiments, the multimedia system 100 may define a time control strategy associated with a forward transmission (i.e., a signal transmission from the acquisition devices to the receiving device) and a reverse transmission (i.e., a signal transmission from the receiving device to the acquisition devices). For example, the multimedia system 100 may assign a time division (which is less than a time threshold) to the reverse transmission, during which the forward transmission may be suspended. When the receiving device intends to execute a reverse transmission, the receiving device can transmit an impulse within the time division which indicates that the reverse transmission will be executed immediately, then during the reverse transmission, the forward transmission may be suspend, and after the reverse transmission is ended, the forward transmission may be continued. Otherwise, in response to that no impulse is detected within the time division, which indicates that no reverse transmission will be executed, then the forward transmission may be continued. As another example, the multimedia system 100 may determine a time distribution including a plurality of time divisions, wherein parts of the plurality of time divisions may be used for the forward transmission and the other parts may be used for the reverse transmission.
It should be noted that the above descriptions of the receiving device 500 are merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, various modifications and changes in the forms and details of the application of the above method and system may occur without departing from the principles of the present disclosure.
Having thus described the basic concepts, it may be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. Various alterations, improvements, and modifications may occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested by the present disclosure, and are within the spirit and scope of the exemplary embodiments of the present disclosure.
Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment,” “an embodiment,” and/or “some embodiments” mean that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment,” “one embodiment,” or “an alternative embodiment” in various portions of this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the present disclosure.
Further, it will be appreciated by one skilled in the art, aspects of the present disclosure may be illustrated and described herein in any of a number of patentable classes or context including any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof. Accordingly, aspects of the present disclosure may be implemented entirely hardware, entirely software (including firmware, resident software, micro-code, etc.) or combining software and hardware implementation that may all generally be referred to herein as a “block,” “module,” “engine,” “unit,” “component,” or “system.” Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer readable media having computer readable program code embodied thereon.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including electro-magnetic, optical, or the like, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that may communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable signal medium may be transmitted using any appropriate medium, including wireless, wireline, optical fiber cable, RF, or the like, or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB. NET, Python or the like, conventional procedural programming languages, such as the “C” programming language, Visual Basic, Fortran 1703, Perl, COBOL 1702, PHP, ABAP, dynamic programming languages such as Python, Ruby and Groovy, or other programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider) or in a cloud computing environment or offered as a service such as a software as a service (SaaS).
Furthermore, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes and methods to any order except as may be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful embodiments of the disclosure, it is to be understood that such detail is solely for that purpose, and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover modifications and equivalent arrangements that are within the spirit and scope of the disclosed embodiments. For example, although the implementation of various components described above may be embodied in a hardware device, it may also be implemented as a software-only solution—e.g., an installation on an existing server or mobile device.
Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various embodiments. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, claimed subject matter may lie in less than all features of a single foregoing disclosed embodiment.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201710992714.9 | Oct 2017 | CN | national |
This application is a continuation of International Application No. PCT/CN2018/111361 filed on Oct. 23, 2018, which claims priority of Chinese Patent Application No. 201710992714.9 filed on Oct. 23, 2017, the entire contents of which are incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4191969 | Briand et al. | Mar 1980 | A |
| 8422518 | Guan et al. | Apr 2013 | B2 |
| 20030210329 | Aagaard | Nov 2003 | A1 |
| 20040022516 | Yamashiro | Feb 2004 | A1 |
| 20040179600 | Wells | Sep 2004 | A1 |
| 20060020990 | Mceneaney | Jan 2006 | A1 |
| 20060083236 | Rachwalski | Apr 2006 | A1 |
| 20060140265 | Igler et al. | Jun 2006 | A1 |
| 20080151884 | Elberbaum | Jun 2008 | A1 |
| 20080276325 | Quan | Nov 2008 | A1 |
| 20090260043 | Tatsuta | Oct 2009 | A1 |
| 20100046557 | Guan et al. | Feb 2010 | A1 |
| 20150326884 | Bae | Nov 2015 | A1 |
| 20160232764 | Galvin | Aug 2016 | A1 |
| 20160352798 | Becker | Dec 2016 | A1 |
| 20170026680 | Sugio | Jan 2017 | A1 |
| 20190174027 | Lv et al. | Jun 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 102301730 | Dec 2011 | CN |
| 202190279 | Apr 2012 | CN |
| 102802039 | Nov 2012 | CN |
| 105791752 | Jul 2016 | CN |
| 106604097 | Apr 2017 | CN |
| 2814250 | Dec 2014 | EP |
| 2019080827 | May 2019 | WO |
| Entry |
|---|
| The Extended European Search Report in European Application No. 18869740.3 dated Sep. 21, 2020, 10 pages. |
| The Extended European Search Report in European Application No. 18869741.1 dated Sep. 15, 2020, 9 pages. |
| International Search Report in PCT/CN2018/111361 dated Jan. 22, 2019, 4 pages. |
| Written Opinion in PCT/CN2018/111361 dated Jan. 22, 2019, 5 pages. |
| International Search Report in PCT/CN2018/111362 dated Jan. 22, 2019, 4 pages. |
| Written Opinion in PCT/CN2018/111362 dated Jan. 22, 2019, 5 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20200252583 A1 | Aug 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/CN2018/111361 | Oct 2018 | US |
| Child | 16852598 | US |
