Recognition and capture of whiteboard markups in relation to a projected image

Abstract

The computer implemented method, apparatus, and computer program product for capturing markup layers on a whiteboard in relation to a projected image. A presentation page is displayed on a whiteboard as the projected image. A set of markups on the whiteboard associated with the presentation page is identified. The set of markups on the whiteboard is isolated from the projected image of the presentation page to create a user input layer. The user input layer is saved as an overlay for the presentation page.

Description

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:

FIG. 1 is a pictorial representation of a network of data processing systems in which aspects of the present invention may be implemented;

FIG. 2 is a block diagram of a data processing system in which aspects of the present invention may be implemented;

FIG. 3A is a block diagram illustrating a process for dark level filter capture of markups on a whiteboard in accordance with an illustrative embodiment of the present invention;

FIG. 3B is a block diagram illustrating the process of a white/gray strobe capture of markups on a whiteboard in accordance with an illustrative embodiment of the present invention;

FIG. 4A is a block diagram illustrating a calibration image in accordance with an illustrative embodiment of the present invention;

FIG. 4B is a block diagram illustrating the calibration image with a dark level calibration target area in accordance with an illustrative embodiment of the present invention;

FIG. 5 is a block diagram illustrating a markup image received by markup manager in accordance with an illustrative embodiment of the present invention;

FIG. 6 is a block diagram illustrating a user input layer isolated from a markup image in accordance with an illustrative embodiment of the present invention;

FIG. 7 is a graph illustrating the white/gray strobe capture process to isolate a color markup layer in accordance with an illustrative embodiment of the present invention;

FIG. 8 is a flowchart illustrating the process of dark level filter capture of markups on a whiteboard in accordance with an illustrative embodiment of the present invention; and

FIG. 9 is a flowchart illustrating the process of white/gray strobe capture of markups on a whiteboard in accordance with an illustrative embodiment of the present invention.

Claims

1. A computer implemented method for capturing markup layers on a whiteboard in relation to a projected image, the computer implemented method comprising: displaying a presentation page as the projected image on a whiteboard;identifying a set of markups on the whiteboard associated with the presentation page; andisolating the set of markups to create a user input layer, wherein the user input layer is saved as an overlay for the presentation page.

2. The computer implemented method of claim 1 wherein the set of markups is a series of black marks forming a black markup layer, and wherein the step of isolating the set of markups further comprises: capturing an image of the presentation page and the black markup layer on the whiteboard; andisolating the black markup layer from the presentation page based upon a differentiation of a first black level of the black markup layer relative to a second black level of the presentation page to form a user input layer.

3. The computer implemented method of claim 1 wherein the set of markups is a series of marks of an arbitrary color forming a color markup layer on the whiteboard, and wherein the step of isolating the set of markups further comprises: replacing the projected image of the presentation page with a projected background to illuminate the color markup layer, wherein the projected background is a white or gray background;capturing an image of the color markup layer on the whiteboard to form a user input layer; andreplacing the projected background with the projected image of the presentation page after the color markup layer is captured.

4. The computer implemented method of claim 1 further comprising: transmitting a set of user input layers associated with the presentation page to a set of remote meeting locations.

5. The computer implemented method of claim 1 wherein a set of user input layers associated with the presentation page is stored in a database, and wherein each user input layer is assigned a different color.

6. The computer implemented method of claim 1 wherein the set of markups on the whiteboard associated with the presentation page are created by a first active user, and further comprising: transferring control of a markup capture to a second active user at a remote meeting location, wherein one or more additional user input layers are captured in association with the presentation page.

7. The computer implemented method of claim 1 further comprising: updating the presentation page, wherein the updated presentation page includes a content from one or more user input layers.

8. The computer implemented method of claim 2 further comprising: projecting a calibration image onto the whiteboard, wherein the calibration image comprises a white target area on a black background;filling in the white target with a black marker; andcomparing a black level of the black marker in the target area with a black level of a projected black background on the whiteboard to establish a clip level.

9. The computer implemented method of claim 8 further comprising: utilizing the clip level to isolate the black markup layer from the presentation page.

10. The computer implemented method of claim 9 further comprising: calibrating a defect filter, wherein defect filter filters marks from a markup image received from a camera that is due to a defect in a whiteboard surface

11. The computer implemented method of claim 3 wherein the step of capturing an image of the color markup layer on the whiteboard to form a user input layer is performed by an electronic camera built into a projector.

12. The computer implemented method of claim 3 wherein a shutter control coordinates the blanking of the projected image of the presentation page and capture of the image of the color markup layer on the whiteboard.

13. The computer implemented method of claim 1 further comprising: performing an orthogonality/region calibration to determine which portion of a markup image received from a camera is within an active display image on the whiteboard.

14. A computer program product comprising: a computer usable medium having computer usable program code for capturing markup layers on a whiteboard in relation to a projected image, the computer program product comprising:computer usable program code for displaying a presentation page as a projected image on a whiteboard;computer usable program code for identifying a set of markups on the whiteboard associated with the presentation page; andcomputer usable program code for isolating the set of markups to create a user input layer, wherein the user input layer is saved as an overlay for the presentation page.

15. The computer program product of claim 14 wherein the set of markups is a series of black marks forming a black markup layer, and wherein the computer usable program code for isolating the set of markups further comprises: computer usable program code for capturing an image of the presentation page and the black markup layer on the whiteboard; andcomputer usable program code for isolating the black markup layer from the presentation page based upon a differentiation of a first black level of the black markup layer relative to a second black level of the presentation page to form a user input layer.

16. The computer program product of claim 14 wherein the set of markups is a series of marks of an arbitrary color forming a color markup layer on the whiteboard, and wherein the computer usable program code for isolating the set of markups further comprises: computer usable program code for replacing the projected image of the presentation page with a projected background to illuminate the color markup layer, wherein the projected background is a white or gray background;computer usable program code for capturing an image of the color markup layer on the whiteboard to form a user input layer; andcomputer usable program code for replacing the projected background with the projected image of the presentation page after the color markup layer is captured.

17. The computer program product of claim 16 further comprising: computer usable program code for projecting a calibration image onto the whiteboard, wherein the calibration image comprises a white target area on a black background;computer usable program code for filling in the white target with a black marker; andcomputer usable program code for comparing a black level of the black marker in the target area with a black level of a projected black background on the whiteboard to establish a clip level.

18. The computer program product of claim 17 further comprising: computer usable program code for utilizing the clip level to isolate the black markup layer from the presentation page.

19. The computer program product of claim 14 wherein the set of markups on the whiteboard associated with the presentation page are created by a first active user, and further comprising: computer usable program code for transferring control of a markup capture to a second active user at a remote meeting location, wherein one or more additional user input layers are captured in association with the presentation page.

20. An apparatus for capturing markup layers on a whiteboard in relation to a projected image, the apparatus comprising: a storage device connected to a bus, wherein the storage device contains a computer usable program product; anda processor, wherein the processor unit executes the computer usable program code to display a presentation page as a projected image on a whiteboard; identifies a set of markups on the whiteboard associated with the presentation page; and isolates the set of markups to create a user input layer, wherein the user input layer is saved as an overlay for the presentation page.