Patent Application
20110169717
The present invention relates to a second monitor for a computer system, 5 and in particular a miniature monitor for showing a portion of the display of the larger monitor.
There are a number of systems which use multiple monitors. A number of companies produce multiple monitor systems which have a stand with two, three, or four flat panel displays mounted on them. Graphics cards have been developed to support multiple monitors. Typically, multiple parallel ports are used to used to connect to each of the monitors from the mother board or graphics card.
The Microsoft Windows 98™ software contains a dual monitor mode for allowing the driving of two separate images. For example, a Toshiba satellite XGA notebook can drive an internal and external display at the same time, one on a notebook's monitor and the other on a separate monitor, such as the user's desktop monitor. A number of software applications allows splitting of portions of the display between the two monitors. For example, PowerPoint 2000™ allows a screen show on one monitor and editing of the same show on another monitor. Outlook Express™ allows a list of e-mail messages on one monitor, and individual messages on the other. Other applications allow help screens and error messages to be displayed on a different monitor. See U.S. Pat. No. 6,018,340 for a description of the ‘virtual desktop’ that is implemented in Windows 98, in which the so-called desktop is extended across multiple monitors.
U.S. Pat. No. 5,682,486, issued to IBM, shows a system for the movement of windows, icons, etc. between multiple monitors using a “transport” region into which they are moved on a particular monitor.
U.S. Pat. No. 5,255,361, JP2190926A2, U.S. Pat. No. 5,043,919 et. al., (IBM), describe the technique of modeling a current-display and desired-display in computer memory, comparing them to determine differences, and sending update commands.
U.S. Pat. No. 4,646,261 describes a means for detecting changes to video memory and sending only the updated video information to the display. U.S. Pat. No. 5,959,686 describes a system with a primary monitor and a plurality of sub monitors, with a kind of serial daisy-chain for controlling the sub-monitors. The sub monitors receive the same video signal as the main monitor.
The present invention provides a system with a main monitor for a host computer and a second, mini monitor for displaying a portion of the display normally intended for the main monitor. In one embodiment, the mini monitor is connected to the computer over a shared, peripheral bus, such as the universal serial bus (USB). The smaller size of the mini monitor and either compression or slower refresh rates allow it to be connected to the USB just like other peripheral devices.
By displaying on the second, mini monitor windows which do not update often, the amount of bandwidth required is further reduced. For example, the smaller monitor could be used for a stock chart or tickertape, e-mail alert, a calendar, appointment book, alarm clock, etc.
In one embodiment, the existing dual monitor feature of Windows 98 is used. A custom video driver makes the device appear to be an ordinary video card and computer monitor to the Windows operating system and to application software. The mini monitor itself will include the USB interface and a video memory for storing the current screen locally, so that refreshing need not be done over the USB. A simple display controller for driving the display from the video memory is provided. The more complex video controller operations, such as updating the memory, doing rendering, etc. is done in the host computer microprocessor or video graphics processor.
In another embodiment, the mini-monitor has touch screen capability, allowing it to also function as a control pad where icons from toolbars, etc. are off the main screen. Other interaction buttons, such as “Select”, “Next”, and “Back” are included. These buttons can be used for content provided to the mini-monitor over the internet, such as pictures from a museum, stock reports, etc.
For a further understanding of the nature and advantages of the invention, reference should be made to the following description taken in conjunction with the accompanying drawings.
A bitmap memory or frame buffer 32 stores the image which is provided to the peripheral monitor. This can either be a separate area of memory, or a designated portion of the frame buffer for the main display 14. In one embodiment, an optional transmitted bitmap memory 34 stores the last video data transmitted to the peripheral monitor. Thus, bitmap 32 will be updated with current desired display information, and could be compared to what has been previously transmitted in bitmap memory 34. This comparison can be used to determine what portions of the display need to be transmitted to peripheral monitor 20 for updating.
Peripheral monitor 20 contains its own USB interface 36. The video data received is stored in a local video memory 38. A display controller 40 refreshes the display with the data in video memory 38. Display controller 40 can be a simple controller that merely reads video memory 30 and provides the appropriate pixel information to the display. Optionally, this can be under the control of a software display driver in memory in the peripheral monitor, such as a display driver 42.
In one embodiment, the screen 44 of monitor 20 (see
Video driver 30 will maintain bitmap 32, which contains the desired display image. When graphical commands are issued from the OS or an application, these commands are applied to this bitmap, commonly known as an “off-screen bitmap”. This allows, for example, quick retrieval of the value of any pixels without having to retrieve values via USB from the external device, which would slow the process and complicate the device. The video driver can keep track of which pixels, or which areas or regions of the off-screen bitmap, have been modified by graphical commands, and which parts of the off-screen bitmap have already been transmitted to the external device, and the driver can arrange to transmit just those areas that need to be sent over the USB connection to the external device. In addition, the driver can attempt to compress the transmitted data, using any number of well-known bitmap data compression techniques, such as run-length encoding (RLE). Alternately, a motion compression technique such as MPEG can be used. There is enough compute power on the host PC to attempt several different compression techniques, choosing the one that gives the best results for a given block of pixels. If the video driver maintains a second bitmap that models the current state of the mini monitor (current as opposed to desired), then the driver can examine and compare the two bitmaps to help it transmit data efficiently. For example, the processor can detect that the main change in an area is a color change, which could be transmitted very efficiently as a command of the form: “In rectangle R change all pixels having color A to color B”.
There are also many algorithms that could be applied creatively to this problem (of rapidly updating the image on the mini monitor). For example, if the entire display changes all at once, the system could transmit a half resolution image (which takes a quarter of the data), followed by the additional data to bring it up to full resolution. If the mini-monitor is being repeatedly updated, this would have the effect of adaptively dropping the resolution in order to maintain the update rate. The computer can also identify when the mouse cursor is moving over the mini monitor, and make updating the area under and near the cursor as a first priority.
In one embodiment, the driver doesn't just send every pixel as it changes. Instead, it constantly collects blocks of data to be sent, placing them in a queue which is emptied by a concurrent process that takes these queued blocks and sends them over the USB. As an optimization, if a block is queued that covers rectangle R, it would be reasonable to check that no earlier queued block is covered by R. In that case, the older block would be discarded without being sent, as its contents are obsolete.
Very few applications of this mini monitor require high-speed update of the entire display area, so doing compressed updates of only the areas that change should provide excellent speed-up, on the order of 5 x to 10 x.
The software aspects of this device extend beyond the use of a smart video driver. Existing software technology allows tracking which applications are running, and detecting when a new application is launched or shut down. For example, Logitech's Wingman™ products use this technology to adapt game controllers to whatever game the user runs, without user intervention. This technology can be applied to the mini monitor. The user can designate one or more applications whose windows should always appear on the mini monitor, and the software will detect when one of these applications is about to display a window, relocating the window instantly to the mini monitor. This technique can be extended to specific classes of windows, such as “error message windows from inside Microsoft Developer Studio”, or “Connecting to Internet” windows, and so on. There are many patterns that can be used to identify candidate windows to be redirected to the mini monitor, including the name of the parent application, the title of the window, key words in the text of the window, etc. The software can also monitor which windows the user drags into (and oft) the mini monitor, and “learn” the appropriate set of windows to relocate automatically.
As will be understood by those of skill in the art, the present invention may be embodied in other specific forms without departing from the essential characteristics thereof. Accordingly, the foregoing description is intended to be illustrative, but not limiting, of the scope of the invention which is set forth in the following claims.
This application is a continuation of U.S. patent application Ser. No. 11/404,508, filed Apr. 13, 2006, entitled “Mini Monitor on Shared Peripheral Bus;” which is a continuation application of U.S. patent application Ser. No. 09/640,168, filed Aug. 15, 2000, entitled “Mini Monitor on Shared Peripheral Bus,” both of which are incorporated by reference herein in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11404508 | Apr 2006 | US |
| Child | 12986899 | US | |
| Parent | 09640168 | Aug 2000 | US |
| Child | 11404508 | US |
