The invention will be more readily understood in view of the following description when accompanied by the below figures and wherein like reference numerals represent like elements:
Generally, the present description provides a method and apparatus for generating a demodulated multimedia signal based on a captured handheld multimedia signal formatted for visual reproduction or audible reproduction on the handheld device; and subsequently transferring the demodulated multimedia signal or a decoded multimedia signal (based on the demodulated multimedia signal) to a computer system, external to the handheld device, for visual or audio reproduction thereon. Alternatively, the demodulated multimedia signal may be based on a captured terrestrial multimedia signal formatted for visual reproduction or audible reproduction on the computer system device. In an alternate embodiment, the transferred signals may be transferred to another computer system for visual or audible reproduction thereon.
In one embodiment, the handheld device is operative to transfer multiple channels of demodulated and/or decoded multimedia signals to the computer device thereby allowing, for example, the display of two or more multimedia signals on the computer system display. In another embodiment, the multiple channels may include demodulated and/or decoded multimedia signals from one or more related or unrelated multimedia technology standards. In another embodiment, the handheld device I operative to parse or demultiplex audio and video components from the demodulated and or/decoded multimedia signals and transfer one or more of these component parts to the computer system. Other component parts may be reproduced or stored on the handheld device.
The present description also provides a method and apparatus for the receipt of one or more transferred signals from the handheld device and for the visual reproduction and/or audible reproduction of the one or more transferred signals on the computer system. The transferred signals may include handheld demodulated multimedia signals, handheld decoded multimedia signals and terrestrial demodulated multimedia signals formatted using one or more related or unrelated technology standards. In one embodiment, the transferred signals may include audio and/or video components of the signals listed above. When the transferred signals are demodulated but not yet decoded, the computer system's multimedia processor decodes the underlying audio and video information prior to reproduction thereof on the computer system display and/or at least one speaker. In one embodiment, the method and apparatus provide for the transfer of the transmitted signals to another computer system for visual or audible reproduction thereon.
Accordingly, the method and apparatus discussed herein allows for the reception of multimedia signals such as DVB-H and DVB-T signals by a handheld device for subsequent reproduction on the computer system or for transfer to another computer system.
The present disclosure can be more fully described with reference to
The tuner 130 is any suitable device capable of tuning to a desired radio frequency using the at least one antenna 108 and capturing signals from an external source (not shown) where the signals are broadcast at the tuned frequency. The desired radio frequency may be set using any suitable technique. In one example, a user inputs the desired frequency (or enters a command representing the desired frequency—e.g., a channel identifier) to which the tuner 130 should pass radio frequency waves. The user input may be entered on any suitable input/output device 120 such as, for example, a keyboard or touchpad. Thereafter and in accordance with known techniques, the tuner 130 captures at least handheld multimedia signals 138 and/or terrestrial multimedia signals 138 (individually or collectively, “broadcast multimedia signals” 138). As one having ordinary skill in the art will recognize, each of the broadcast multimedia signals 138 are modulated according to one of a plurality of known multimedia transmission standards (e.g., Digital Video Broadcast-Handheld, Digital Video Broadcast-Terrestrial, etc.) prior to transmission by the external source.
As used herein, handheld multimedia signals 138 are multimedia signals formatted for the visual reproduction of underlying video information and/or audible reproduction of underlying audio information on the handheld device, e.g., handheld device 102. In one embodiment, handheld multimedia signals 138 are Digital Video Broadcast-Handheld (“DVB-H”) signals. In another embodiment, handheld multimedia signals 108 correspond to a streaming channel broadcast over a carrier network by a service provider. Similarly, terrestrial multimedia signals 138 are multimedia signals formatted for the visual reproduction of underlying video information and/or audible reproduction of underlying audio information on an external computer system, e.g., computer system 104. In one embodiment, terrestrial multimedia signals 138 are Digital Video Broadcast-Terrestrial (“DVB-T”) signals. One having ordinary skill in the art will recognize that handheld multimedia signals 138 and terrestrial multimedia signals 138 are not limited to DVB-H and DVB-T signals and may be any broadcast video signal, audio signal or audio/video signal formatted for at least one of a handheld device or for a computer system. Other broadcast multimedia signals capable of being captured by the one or more receivers 110 include signals formatted using one of the following standards: T-DMB, S-DMB, ISDB-T segment 1, ISDB-T full segment, DVB-T2, ATSC, DSDPA, MBMS, eVDO, WiMAX, MediaFLO, etc.
It will be understood that the number of receivers, employed in the one or more receivers 110 may be a manufacturing design choice based on the type of broadcast multimedia signals the handheld device 102 is designed to capture. For instance, a single receiver may be used if the handheld device 102 is designed to capture only related broadcast multimedia signals. For example, if a user desires to only capture DVB-H and/or DVB-T broadcast multimedia signals, a single receiver may be used because both DVB-H and DVB-T are related broadcast multimedia signals formatted using a related multimedia technology standard (e.g., both are part of the DVB suite of standards). However, if the handheld device 102 is designed to capture broadcast multimedia signals formatted using unrelated multimedia technology standards, two or more receivers may be necessary. For example, if it is desired to capture at least one of DVB-H and DVB-T and at least one of T-DMB and S-DMB, two receivers may be necessary. The first receiver may be capable of capturing and demodulating the related DVB-type signals while the second receiver may be capable of capturing and demodulating the related DMB-type signals.
In an alternate embodiment, instead of having multiple receivers when capturing unrelated multimedia signals, the handheld device 102 may employ a single receiver 110 having two or more demodulators 132 where each of the demodulators 132 is only responsible for demodulating one set of related broadcast multimedia signals.
After capture, the tuner 130 passes the broadcast multimedia signals 138 to the demodulator 132, any suitable device that generates a demodulated multimedia signal 140 therefrom. Optionally, the demodulator 132 includes an analog to digital converter (“ADC”) 134 and error correction circuitry (“ECC”) 136. Although the ADC 134 and ECC 136 are illustrated as components of the demodulator 132, it is recognized that each of the ADC 134 and/or ECC 136 need not necessarily be component members of the demodulator 132, but may be stand alone components of the at least one receiver 110 or any other suitable device capable of communication with the receiver 110 and/or the tuner 130. Generally, the ADC 134 first converts the captured broadcast multimedia signal 138 into digital form using known sampling techniques prior to demodulation by demodulator 132. Prior to transfer from the receiver 110, the demodulated multimedia signals 140 undergo error correction by ECC 136.
In one embodiment, the demodulated multimedia signals 140 are transferred to the at least one memory 112 for storage therein. The at least one memory 112 may be any suitable volatile or non-volatile memory device or memory devices such as, but not limited to, system memory, frame buffer memory, flash memory, etc. In one embodiment, the at least one memory 112 is a random access memory. Thereafter, the demodulated multimedia signals 140 are transferred to the interface 116 or the multimedia processor 114 based on at least one of a user input and the type of broadcast multimedia signal 138 received by the tuner 130. If the demodulated multimedia signals 140 are transferred to the interface 116, the demodulated multimedia signals 140 are transferred over connection 106 to the at least one computer system 104. In one embodiment, the interface 116 is any suitable interface that supports for example, a dedicated physical connection and/or a wireless connection. Alternatively, if the demodulated signals 140 are transferred to the multimedia processor 114, the multimedia processor 114 generates decoded multimedia signals 142. As discussed below, in one embodiment, the route taken by the demodulated multimedia signals 140 is related to where the demodulated multimedia signals 140 will be displayed. Accordingly, suitable user input may be accepted at the one or more input/output deices 120 to control this process.
The multimedia processor 114 may correspond to any suitable programmable or dedicated processor, processing engine, hardware accelerator, or any suitable combination of programmable or dedicated processors, processing engines, and hardware accelerators. In response to the demodulated multimedia signals 140, the multimedia processor 114 generates decoded multimedia signals 142 by decoding the video information and audio information contained in the demodulated multimedia signals 140. The multimedia processor 114 may use any suitable compression-decompression (“codec”) standard such as, but not limited to, H.264 and VC-1 to decode the underlying video information. Similarly, the multimedia processor 114 may use any suitable codec standard such as, but not limited to, AAC and MP3 to decode the underlying audio information. Additionally, the multimedia processor 114 may also perform additional “error correction” (e.g., error resiliency) by correcting synchronization errors, bad frame errors, and bad packet errors associated with the demodulated multimedia signals.
As one of ordinary skill in the art will appreciate, the decoded multimedia signals 142 include decoded video information 144 and/or decoded audio information 146. The decoded video information 144 may be transferred to the at least one memory 112 for subsequent visual reproduction on the handheld display 128. Similarly, the decoded audio information 146 may be transferred to the DAC 146 where an analog audio signal 148 is generated. Based on the analog audio signal 148, the amplifier 124 generates an amplified analog audio signal 150 for subsequent audible reproduction on the at least one handheld speaker 126. As one having ordinary skill in the art will recognize, the DAC 122 and amplifier 124 may be interchanged such that the decoded audio information 146 is first amplified and then converted to digital form. Alternatively, the decoded multimedia signals 142 may be transferred to the interface 116 for transmission along connection 106 to the at least one computer system 104 for visual reproduction, on the at least one computer system 104, of the decoded video information 144 and/or for audible reproduction, on the at least one computer system 104, of the audio information 146.
As configured, the handheld device 102 further supports time-shifting of the broadcasted multimedia signals 138. In one embodiment, the demodulated (but still encoded) multimedia signals 140 are stored in the at least one memory 112 until a user desires “play back” of the stored demodulated multimedia signals 140. At that point, the demodulated multimedia signals 140 are read from the at least one memory 112 and transferred to the multimedia processor 114 for subsequent processing as described above. Alternatively, in another embodiment, the multimedia processor 142 first decodes the demodulated multimedia signals 140, as previously described, and then the decoded video information 144, the decoded audio information 146 (not specifically illustrated) or the decoded multimedia signals 142 (not specifically illustrated) is stored in the at least one memory 112 until a user desires “play back” of the stored signals. When playback is desired, the stored decoded video information 144, stored decoded audio information 146 or the stored decoded multimedia signals 142 are read from the at least one memory 112 such that the video information 144 is supplied to the handheld display 128 for visual reproduction and/or the audio information 146 is supplied (not specifically illustrated) to the DAC 122 for audio reproduction using the handheld speaker 126.
In an alternate embodiment, the at least one receiver 110 directly transfers the demodulated multimedia signals 140 to the interface 116 for immediate transfer to the computer system 104. This embodiment may be used to conserve power in the handheld device 102 by shifting all subsequent processing to the at least one computer system 104.
In one embodiment, each of the at least one receiver 110 may be implemented on a single integrated circuit. Similarly, the CPU 118, interfaces (not shown) associated with the at least one I/O devices 120, the at least one memory 112, the multimedia processor 114, the interface 116, the DAC 122, the amplifier 124 and the interfaces (not shown) associated with the at least one handheld speaker 126 and the handheld display 128 may be implemented on one or more different integrated circuits.
It will be recognized that in one embodiment, the handheld device 102 is not limited to mobile devices as previously described, but may include any suitable device or module capable of communication with computer system 104 and having at least an antenna 108, a tuner 130, a demodulator 132 and at least one memory 112.
In one embodiment, the handheld device 102 may inquire of the decoding capabilities of a computer system 104 and, based on the response, the handheld device 102 and its multimedia processor 114 may perform any necessary decoding of the demodulated multimedia signal 140. Any suitable technique may be used by the handheld device 102 to make the necessary inquiry of a computer system 104. Similarly, any suitable signal, flag or information may be submitted back to the handheld device 102 by the computer system 104 to indicate its decoding capabilities or abilities. For example, computer system 104 may not have the necessary codec or may have a less efficient or otherwise less desirable codec for performing the decoding of the broadcast multimedia signals 138 received by the handheld device 102 and thus the handheld device 102 may perform the necessary decoding of the demodulated multimedia signal 140 before transfer to the computer system 104.
As illustrated, the computer system 104 of
As discussed above, the handheld device 102 is capable of transferring a variety of signals along connection 106 to interface 152. Depending on user input (e.g., input on the at least one input/output device 102) and the broadcast multimedia signals 138 captured, connection 106 transfers demodulated multimedia signals 140 and/or decoded multimedia signals 142 (collectively “transferred signals” 172). As one having ordinary skill in the art will recognize, the transferred signals 172 may correspond to terrestrial demodulated multimedia signals (e.g., where the receiver 110 captures terrestrial multimedia signals 138 and does not decode), handheld demodulated multimedia signals (e.g., where the receiver 110 captures handheld multimedia signals and does not decode) or handheld decoded multimedia signals (e.g., where the receiver 110 captures handheld multimedia signals and does decode) or any combination thereof (e.g., where connection 106 transfers multiple channels of transferred signals 172). Generally, it is not advantageous to pass terrestrial decoded multimedia signals because of the limited resources available to most handheld devices. However, one having ordinary skill in the art will recognize that the transferred signals 172 may include terrestrial decoded multimedia signals.
Upon receipt, the transferred signals 172 are transferred to the at least one memory 154 for storage or to the multimedia processor 156 based on user inputs and/or the type of transferred signals 172. When the transferred signals 172 correspond to handheld demodulated multimedia signals, the transferred signals 172 are transferred to the multimedia processor 156 (from the interface 152 or from the at least one memory 154) for processing. Similar to the handheld multimedia processor 114, the computer system multimedia processor 156 then generates computer system-generated handheld decoded multimedia signals using known techniques. When the transferred signals 172 correspond to terrestrial demodulated multimedia signals, the transferred signals 172 are transferred to the multimedia processor 156 (from the interface 152 or from the at least one memory 154) for processing. The multimedia processor 156 then generates computer system-generated terrestrial decoded multimedia signals also using known techniques.
As illustrated, the multimedia processor 156 may comprise a scaler 158 such as a hardware scaler or any other suitable dedicated or programmable device capable of scaling the resolution of underlying video information associated with one of the transferred signals 172 to meet the specifications, characteristics or capabilities of the computer system display 164. Alternatively, the scaler 158 is separate from the multimedia processor 156 but is in communication with at least the at least on memory 154 and/or multimedia processor 156. Thus, in one embodiment, multimedia processor 156 not only generates the computer system-generated handheld decoded multimedia signals and the computer system-generated terrestrial decoded multimedia signals, but also scales: the resolution of video information associated with these signals and the resolution of video information associated with the handheld or terrestrial decoded multimedia signals.
Similar to the decoded multimedia signals 142, each of the decoded transferred signals 178 (e.g., the computer-system generated handheld decoded multimedia signals, the handheld decoded multimedia signals, the computer system-generated terrestrial decoded multimedia signals and the terrestrial decoded multimedia signals) include underlying video information and audio information. As illustrated, multimedia processor 156 transfers the video information 174 associated with decoded transferred signals to the at least one memory 154 for storage and subsequent visual reproduction on computer system display 164. Similarly, multimedia processor 156 transfers the audio information associated with decoded transferred signals 176 to the DAC 166 for subsequent audible reproduction on the at least one computer system speaker 170.
One having ordinary skill in the art will also recognize that the decoded audio information 176 may be processed by DAC 166, amplifier 168 and the at least one computer system speaker 170 in the same manner as the decoded audio information 146 was processed by DAC 122, amplifier 124 and the at least one handheld speaker 126 of the handheld device 102.
As configured, the computer system 104 similarly supports time-shifting of the transferred signals 172 in the same manner as the handheld device 102 also supported time-shifting of the broadcasted multimedia signals 138. One having ordinary skill in the art will recognize that the handheld user and/or the computer system user may desire to “play back” stored transferred signals 172 and/or stored decoded transferred signals 178 using the at least one memory 154. User input may be accepted by the at least one input/output devices 120 and/or the at least one input/output devices 162 using known techniques to control the “play back” of the signals. If input is provided to the at least one input/output devices 120, one having ordinary skill in the art will recognize that any suitable indicator, flag, or data may be transferred along connection 106 with the transferred signals 172 such that the computer system 104 and multimedia processor 156 are suitably directed to time-shift the signals.
As illustrated,
Although not illustrated, one having ordinary skill in the art will recognize that the transmission of signals among handheld device 102 components and among the computer system 104 components may be recognized under the control of the respective CPU (118, 160), the respective multimedia processor (114, 156), one or more direct memory access engines (not illustrated) or any combination therof. The physical transmissions may be recognized along any suitable connection, internal bus, communication link, or any suitable combination of connections, internal buses and communication links.
One having ordinary skill in the art will also recognize that in one embodiment, the interface 116 and the second interface 180 transfers multiple channels of transferred signals 172 or some combination of transferred signals 172 and decoded transferred signals 178. Correspondingly, interface 152 similarly receives multiple channels of transferred signals 172. The multiple channels allow the computer system display 164 to reproduce video information associated with more than one transferred signal at one time (e.g., using picture-in-picture technology). Similarly, one having ordinary skill in the art will recognize that the handheld device 128 is also configured to display more than one broadcast multimedia signal 138 at one time using similar technology.
Using the architecture of system 100 and computer system 104, it is recognized that many benefits may be realized. One feature realized is the ability of the handheld device 102 to receive both related and unrelated broadcast multimedia signals 138 and then to direct any combination of received related and unrelated broadcast multimedia signals 138 for storage and/or reproduction on any number of components and computer systems. With respect to
It may further be appreciated that similar demultiplexors might exist in multimedia processor 156 of
The method continues in block 306 where the at least one demodulated multimedia signal or at least one decoded multimedia signal, based on the demodulated multimedia signal, is transferred to a computer system for reproduction on the computer or transmission to another computer system. As illustrated, the method may include generating the at least one decoded multimedia signal based on the at least one demodulated multimedia signal as indicated in block 318. Transmission to the computer system may include, in one embodiment, transferring the at least one demodulated multimedia signal or the at least one decoded multimedia signal over a physical connection (such as a physical bus) or over a wireless connection (such as a wireless bus) as illustrated in block 320. Transmission to the computer system may also include method block 322 where multiple channels of transferred signals are transferred, wherein the multiple channels of transferred signals comprise at least one of: two or more demodulated multimedia signals; two or more decoded multimedia signals, and one or more demodulated multimedia signals and one or more decoded multimedia signals. The methods of blocks 306 and 318-222 may be implemented, in one embodiment, using at least the multimedia processor 114 and interface 116 of the handheld device 102, and connection 106. The method ends in block 308 where, for example, the computer system processes the transferred signals as described below.
In one embodiment, the method of
The method of
In one embodiment, block 604 includes receiving the transferred signal over a physical connection or over a wireless connection as illustrated in block 610. In another embodiment, block 606 includes the method of block 612 where multiple channels of transferred signals are received. Multiple channels may comprise at least one of: two or more handheld demodulated multimedia signals; two or more terrestrial demodulated multimedia signals; two or more handheld decoded multimedia signals; and two or more terrestrial decoded multimedia signals; and at least two of: one handheld demodulated multimedia signal; one terrestrial demodulated multimedia signal; one handheld decoded multimedia signal; and one terrestrial decoded multimedia signal. The methods of blocks 604 and 610-612 may be implemented, in one embodiment, using connection 106 and interface 152 of
Next, the method of
The method of
Thus, a method and apparatus has been disclosed that addresses the above needs of the prior art. Specifically, a handheld device and computer system have been described such that handheld multimedia signals may be transferred from the handheld device to the computer system for subsequent display and audible reproduction. As explained, the handheld transferred signals may correspond to handheld demodulated or decoded multimedia signals or terrestrial demodulated or decoded multimedia signals. The decision to send a particular type of multimedia signal to the computer system may be influenced by the decoding capability of the computer system and user input. For instance, one having ordinary skill in the art will recognize that based on the type of resources available on both the handheld device 102 and the computer system 104, the multimedia processor 156 may be better suited to decode the demodulated multimedia signal 140 using more advanced hardware accelerators, processors, or engines. Alternatively, the handheld device user may elect to visually reproduce and/or audibly reproduce the received signals using the handheld device resources (i.e., display and speakers) thereby providing greater flexibility for the handheld device user.
Among other advantages, the above method and apparatus enables a handheld device to receive handheld multimedia signals formatted for visual and audible reproduction on a handheld device and, through for example user input, display the multimedia signals on the handheld device or on a computer system. In one embodiment, this permits a user to take advantage of better computer system display and speakers and better decoding engines/algorithms. The apparatus and method further enables a handheld device to receive terrestrial multimedia signals formatted for visual and audible reproduction on a computer system and, through for example user input, display the multimedia signals on the computer system. In one embodiment, this permits a user to use a handheld to tune and demodulate the terrestrial multimedia signals when a computer system receiver is either unavailable or busy processing other signals. Other advantages will be recognized by one of ordinary skill in the art.
It will also be recognized that the above description describes mere examples and that other embodiments are envisioned and covered by the appended claims. For example, it is recognized that one or more components of the handheld device 102 and the computer system 104 (e.g., multimedia processor 114, 156) may be implemented in software (i.e., as stored instructions) and executed by at least one of CPU 118 and CPU 160, respectively. It will further be recognized that certain components such as, for example, amplifiers 124, 168 and error correction circuitry 136 illustrated in