1. Field of the Invention
Embodiments of the present invention generally relate to a visual source management system. More specifically, embodiments of the present invention relate to the processors or systems for simultaneous preview, control and processing of multiple simultaneous symmetric or asymmetric video sources displayed individually on multiple displays.
2. Description of the Related Art
As the growth in TV, Internet and other forms of media expand, there becomes a need to better preview and select among the broad choice of content. Additionally, more and more people choose to multi-task in a variety of ways such as watching news while analyzing and trading stocks; watching TV while social networking and gaming; or watching multiple live sports casts while enjoying friends. This invention also allows a viewer to not only see the main feed of an NBA basketball game, but also to simultaneously view multiple camera angles of the same event. Thus improving personal control over which view appears on the main screen within your home.
Previous to this invention, TV viewers used features such as “Input Selection”, “Channel Surfing”, “Electronic Program Guides” or “Picture-In-Picture”to navigate among choices of video content. Each of these required many complex or repetitive actions to use. Electronic program guides have limited or even misleading information. Picture-in-picture is a poor compromise requiring a portion of the images to be obscured or splitting precious screen-space resulting in smaller, lower-quality distorted images. Switching among video sources was slow and more often guess-work.
Previous industrial, commercial, or security solutions such as tiling, switchers, distribution amplifiers or matrix boxes failed to provide the convenience, features, functions, needs and cost of a consumer requirement typically omitting independent control of audio and video, not supporting content protected video sources, lack full resolution image quality, lacking instant one touch control of content on the primary display and/or other features.
Previous streaming content solutions such as computers, notebooks, tablets, mobile phones, routers, modems, cable-boxes or game consoles are limited by the computing resources and switching among many streams quickly cripples the responsiveness to the user. Switching web video sources caused an interruption requiring a restart, break in the action, repeated commercial advertisements, and/or many steps including authentication, synchronization and buffering of data delaying when a smooth enjoyable view can begin.
The present invention describes processors and systems for visual source management. Visual source management allows a user or group of users to enjoy multiple independent streams of full performance content. The user has easy and fast control over which video appears on the primary display among a set of displays as well as independent control or mixing of which audio stream or streams are audible.
Combinations of three sets of unique processors are incorporated into four classes of solutions. Each class of solution further breaks down into a variety of novel application solutions including but not limited to: towers, bars, or arrays for multi-display TV's or multi-display monitors. The main display may be integrated or separate. Portions of the audio system may be integrated or separate. Each logic element can be individually or in combination integrated onto a chip. Logic or control may be centralized and/or distributed to allow chaining of systems.
As individual signals have dedicated processing power, there is no performance degradation as the number or complexity of signals grows. This invention applies equally well when viewing multiple channels of TV, PC, Internet content, game consoles, BD, DVD, other sources or any combinations thereof.
In addition to multi-tasking, the user also benefits from visual preview of available content. This simplifies the task of selecting what to watch and how to select a program on your main display or TV. There is no break in the action since your attention can seamlessly shift from a preview to the main display.
Switching on the main display becomes faster since the connection to each input device is maintained by the associated dedicated display. Previous to this invention, switching to re-establish synchronization can easily take 5-7 seconds for television content and even more for streaming Internet content.
Advantage of one or more disclosed embodiments may become apparent upon reading the following detailed description and upon reference to the drawings in which:
Described herein are exemplary systems and methods for implementing visual source management. In the following description, numerous specific details are set forth to provide a thorough understanding of various embodiments. However, it will be understood by those skilled in the art that the various embodiments may be practiced without the specific details. In other instances, well known methods, procedures, components, and circuits have not been illustrated or described in detail so as not to obscure the particular embodiments.
The term “video” is used to improve readability and is presumed the reader understands that state of the art video includes but not limited to audio, data, metadata, control, handshaking, power, networking and/or content protection in either or both directions. Video may be implemented using a variety or combinations of information representation schemes such as TMDS, LVDS, HDMI, DisplayPort, Thunderbolt, USB, Light Peak, component video, YUV, RGB, dRGB, VGA, composite video, ATSC, DVB, VSB, QAM, MPEG, MPEG2, MPEG4, MP3, analog audio, digital audio, Dolby Digital, advanced audio coding, FLASH, HTML, XML, HTML5, EDID, Plug & Play, and other protocols. It is well known that video may be obtained from a variety of vehicles including but not limited to Internet, terrestrial broadcast, cable, satellite, fiber, disc, or tape. References to HDMI include solutions that are compatible to HDMI such as TMDS, DisplayPort or Thunderbolt. A display may be implemented using LCD, LED, OLED, bi-stable, plasma, projection, laser, or other technologies. Video processing reaches beyond selecting streams and include but not limited to mixing, blending or signal processing within one or among combinations of input signals down to the pixel or sub-pixel level in space and/or time. References to controls or remote controls presume an appropriate set of functions. The input signals are understood to include but not limited to antennae, cable boxes, satellite receivers, PC's, notebooks, tablets, phones, DVD's, BD's, VCR's, receivers, recorders, DVR's, routers, bridges, radios, modems, repeaters, video processors, and other devices. Communications and control links include but are not limited to remote controls, USB, serial, parallel, optical, wired and/or wireless.
Similarly, the same logic flow is repeated for a number (n) of video input signals. A second input 102, a third input 103 and so forth to nth input 104. These n signals are replicated by corresponding input processors (111, 112, 113, . . . 114) into two corresponding video signals (121, 122, 123, . . . 124, 125, 126, 127, . . . 128). One of each replicated video signal enters a video output processor (131, 132, 133, . . . 134). Each output processor produces n transformed video outputs (151, 152, 153, . . . 154) and n corresponding audio outputs (141,142,143, . . . 144).
The second of the n replicated signals (121, 122, 123, . . . 124) enters an n+1th main video output processor 120. This output processor 120 transforms one or more of the n inputs to produce a video output signal 150. Note that there are now n+1 video output signals in total. In this way any of the n input signals can be monitored on the n outputs while having simultaneous and/or independent main output 150 to an external TV or display. A preferred embodiment of the main video output is HDMI.
The n audio signals (141, 142, 143, . . . 144) enter an audio processor 145. The audio processor 145 produces a number of common audio output formats including digital audio 146 or analog audio 147. In this way any there can be simultaneous and/or independent audio outputs (146, 147).
Power enters through an external connection 106 and conversion, distribution and management is performed by power management 116. The power management 116 may selectively sleep or wake individual elements based on user settings and system information. Control, wireless and/or wired communication links 105 enter a control unit 115. User controls such as a remote control allow selection of video and/or audio in a quick single action. Connections for power and control to the individual blocks are omitted to improve readability.
Similarly, the same logic flow is repeated for a number (n) of video input signals. A second input 102, a third input 103 and so forth to nth input 104. These n signals are replicated by corresponding input processors (211, 212, 213, . . . 214) into n corresponding video signals 210. One of each replicated video signal enters a video output processor (221, 222, 223, . . . 224). Each output processor produces n transformed video outputs (241, 242, 243, . . . 244) and n corresponding audio outputs (231, 232, 234). In this way each of the n input signals (101, 102, 103, . . . 104) can appear independently and/or simultaneously on any of the n outputs (241, 242, 243, . . . 244).
The n audio signals (231, 232, 233, . . . 234) enter an audio processor 235. The audio processor 235 produces a number of common audio output formats including digital audio 236 or analog audio 237. In this way any there can be simultaneous and/or independent audio outputs.
Power enters through an external connection 206 and conversion, distribution and management is performed by power management 216. The power management 216 may selectively sleep or Wake individual elements based on user settings and system information. Control, wireless and/or wired communication links 205 enter a control unit 215. User controls such as a remote control allow selection of video and/or audio in a quick single action. Connections for power and control to the individual blocks are omitted to improve readability.
Similarly, the same logic flow is repeated for a number (k) of video input signals. These k video signals may be similar or different. A second input 302, a third input 303 and so forth to kth input 306. These k signals are replicated by corresponding input processors (311, 312, 313, . . . 316) into k×n video signals 320 where k is greater than or equal to n. One of each replicated video signal enters a video output processor (331, 332, 333, . . . 334). Each output processor produces n transformed video outputs (101, 102, 103, . . . 104). In this way each of the k input signals (301, 302, 303, . . . 306) can appear independently and/or simultaneously on any of the n outputs (101, 102, 103, . . . 104). In a preferred embodiment, a single antenna connection on 301 can produce n distinct yet simultaneous TV channels appearing on n video output signals (101, 102, 103, . . . 104). In an embodiment where input 301 is a network connection, the network access is distributed using input processor 311 that acts as a router and can produce n distinct yet simultaneous Internet sessions appearing on n video output signals (101, 102, 103, . . . 104).
Power enters through an external connection 308 and conversion, distribution and management is performed by power management 318. The power management 318 may selectively sleep or wake individual elements based on user settings and system information. Control, wireless and/or wired communication links 307 enter a control unit 317. Connections for power and control to the individual blocks are omitted to improve readability.
The source monitoring processor 100 produces an n+1th main video output 150 which is attached to a display 421. A preferred embodiment of display 421 is a larger flat panel LCD main display. The image on this main display 421 can be selected from any of the n input video signals (101, 102, 103, . . . 104) appearing on the n displays (401, 402, 403, . . . 404).
The source monitoring processor 100 produces a digital audio output 146 and/or an analog audio output 147. One or more channels of analog audio output are amplified by amplifier 411 producing powered audio 412 and are heard over speakers 413. The digital audio and/or analog audio can be selected to match with or independently of the main video output 150.
Power 106, communications and control 105 are connected to the system. Power management is used to selectively sleep and/or wake individual displays and/or system elements. User controls allow manual and/or assisted selection of which input video appears on the main video output 150, which audio appears on the digital audio output 146 and which audio appears on the analog audio output 147.
The source monitoring tower 400 combines the source monitoring processor 100, n displays (401, 402, 403, . . . 404) and the related signals (101, 102, 103, . . . 104, 105, 106, 151, 152, 153, . . . 154, 150, 146, 147). This source monitoring tower 400 would be used in conjunction with an external TV or display 421 and/or external sound system.
The source monitoring bar 410 combines the source monitoring processor 100, n displays (401, 402, 403, . . . 404), sound system (411, 412, 413) and the related signals (101, 102, 103, . . . 104, 105, 106, 151, 152, 153, . . . 154, 150, 146, 147). This source monitoring bar 410 would be used in conjunction with an external TV or display 421. The source monitoring bar 410 would be a standalone or add-on accessory that could be used with any TV or display for multi-tasking and/or improve the ease of selecting what appears on that external TV or display 421.
The source monitoring display 420 combines the source monitoring processor 100, n+1 displays (401, 402, 403, . . . 404, 421), sound system (411, 412, 413) and the related signals (101, 102, 103, . . . 104, 105, 106, 151, 152, 153, . . . 154, 150, 146, 147). This source monitoring display 420 could be used standalone or in conjunction with an external sound system. In this embodiment, a main display 421 would be larger then the other n smaller displays (401, 402, 403, . . . 404). The image on the main display would repeat the image of one of the n smaller displays based on the user's desires.
The source monitoring processor 100 produces an n+1th main video output 150 which is attached to a display 521. A preferred embodiment of display 521 is a large flat panel television. The image on this main TV display 521 can be selected from any of the k input video signals (301, 302, 303, . . . 306) of which n appear on the n displays (501, 502, 503, . . . 504). For example, the entirety of n different TV channels could appear simultaneously on n displays.
The source monitoring processor 100 produces a digital audio output 146 and/or an analog audio output 147. One or more channels of analog audio output is amplified 411 producing powered audio 412 and is heard over speakers 413. The digital audio and/or analog audio can be selected to match with or independently of the main video output 150.
Power 106, communications and control 105 are connected to the system. Power management is used to selectively sleep and/or wake individual displays and/or system elements. User controls allow manual and/or assisted selection of which input video appears on the main video output 150, which audio appears on the digital audio output 146 and which audio appears on the analog audio output 147.
The source monitoring TV tower 500 combines the source monitoring processor and TV processor (100, 300), n displays (501, 502, 503, . . . 504) and the related signals (301, 302, 303, . . . 306, 101, 102, 103, . . . 104, 105, 106, 151, 152, 153, . . . 154, 150, 146, 147). This source monitoring TV tower 500 would be used in conjunction with an external TV or display 521 and/or external sound system.
The source monitoring TV bar 510 combines the source monitoring processor and TV processor (100, 300), n displays (501, 502, 503, . . . 504), sound system (301, 302, 303, . . . 306, 411, 412, 413) and the related signals (101, 102, 103, . . . 104, 105, 106, 151, 152, 153, . . . 154, 150, 146, 147). This source monitoring TV bar 510 would be used in conjunction with an external TV or display 521. The source monitoring TV bar 510 would be a standalone or add-on accessory that could be used with any TV or display for multi-tasking and/or improve the ease of selecting what appears on that external TV or display 521.
The source monitoring television 520 combines the source monitoring processor and TV processor (100, 300), n+1 displays (501, 502, 503, . . . 504, 521), sound system (411, 412, 413) and the related signals (301, 302, 303, . . . 306, 101, 102, 103, . . . 104, 105, 106, 151, 152, 153, . . . 154, 150, 146, 147). This source monitoring television 520 could be used standalone or in conjunction with an external sound system. In this embodiment, a main display 521 would be larger then the other n smaller displays (501, 502, 503, . . . 504). The image on the main display would repeat the image of one of the n smaller displays based on the user's desires.
The source flipping processor 200 produces a digital audio output 236 and/or an analog audio output 237. One or more channels of analog audio output is amplified 611 producing powered audio 612 and is heard over speakers 613. The digital audio and/or analog audio can be selected to match with or independently of the main video output 244.
Power 106, communications and control 105 are connected to the system. Power management is used to selectively sleep and/or wake individual displays and/or system elements. User controls allow manual and/or assisted selection of which input video appears on the main video output 244, which audio appears on the digital audio output 236 and which audio appears on the analog audio output 237.
The source flipping tower 600 combines the source flipping processor 200, n−1 displays (601, 602, . . . 603) and the related signals (101, 102, 103, . . . 104, 105, 106, 241, 242, . . . 243, 244, 236, 237). This source flipping tower 600 would be used in conjunction with an external TV or display 621 and/or external sound system.
The source flipping bar 610 combines the source flipping processor 200, n−1 displays (601, 602, . . . 603), sound system (611, 612, 613) and the related signals (101, 102, 103, . . . 104, 105, 106, 241, 242, . . . 243, 244, 236, 237). This source flipping bar 610 would be used in conjunction with an external TV or display 621. The source flipping bar 610 would be a standalone or add-on accessory that could be used with any TV or display for multi-tasking and/or improve the ease of selecting what appears on that external TV or display 621.
The source flipping display 620 combines the source flipping processor 200, n displays (601, 602, . . . 603, 621), sound system (611, 612, 613) and the related signals (101, 102, 103, . . . 104, 105, 106, 241, 242, . . . 243, 244, 236, 237). This source flipping display 620 could be used standalone or in conjunction with an external sound system. In this embodiment, a main display 621 would be larger then the other n−1 smaller displays (601, 602, . . . 603). The image on the main display can be exchanged the image of one of the n−1 smaller displays based on the user's desires. A preferred embodiment would be where n=2 and the source flipping display 620 consists of one large display 621 and one small display 601.
A preferred embodiment of display 721 is a large flat panel television. The image on this main TV display 721 can be selected from any of the k input video signals (301, 302, 303, . . . 306) of which n appear on the n displays (601, 602, 603, . . . 721). For example, the entirety of n different TV channels could appear simultaneously on n displays.
The source flipping processor 200 produces a digital audio output 236 and/or an analog audio output 237. One or more channels of analog audio output is amplified 611 producing powered audio 612 and is heard over speakers 613. The digital audio and/or analog audio can be selected to match with or independently of the main video output 244.
Power 106, communications and control 105 are connected to the system. Power management is used to selectively sleep and/or wake individual displays and/or system elements. User controls allow manual and/or assisted selection of which input video appears on the main video output 244, which audio appears on the digital audio output 236 and which audio appears on the analog audio output 237.
The source flipping TV tower 700 combines the source flipping processor and TV processor (200, 300), n−1 displays (601, 602, . . . 603) and the related signals (301, 302, 303, . . . 306, 101, 102, 103, . . . 104, 105, 106, 241, 242, . . . 243, 244, 236, 237). This source flipping TV tower 700 would be used in conjunction with an external TV or display 721 and/or external sound system.
The source flipping TV bar 710 combines the source flipping processor and TV processor (200, 300), n−1 displays (601, 602, . . . 603), sound system (611, 612, 613) and the related signals (301, 302, 303, . . . 306, 101, 102, 103, . . . 104, 105, 106, 241, 242, . . . 243, 244, 236, 237). This source flipping TV bar 710 would be used in conjunction with an external TV or display 721. The source flipping TV bar 710 would be a standalone or add-on accessory that could be used with any TV or display for multi-tasking and/or improve the ease of selecting what appears on that external TV or display 721.
The source flipping television 720 combines the source flipping processor and TV processor (200, 300), n displays (601, 602, . . . 603, 721), sound system (611, 612, 613) and the related signals (301, 302, 303, . . . 306, 101, 102, 103, . . . 104, 105, 106, 241, 242, . . . 243, 244, 236, 237). This source flipping television 720 could be used standalone or in conjunction with an external sound system. In this embodiment, a main display 721 would be larger then the other n−1 smaller displays (601, 602, . . . 603). The image on the main display can be exchanged the image of one of the n−1 smaller displays based on the user's desires. A preferred embodiment would be where n=2 and the source flipping television 720 consists of one large display 721 and one small display 701.