1. Field of the Invention
The present invention relates to a monitoring system and a monitoring apparatus for causing a monitoring camera to capture and record a video image of an image forming apparatus in order to determine whether a material output from the image forming apparatus has been removed by a person who instructed performance of an output operation for the output material or by a person who did not instruct performance of the output operation, and to control methods for the monitoring system and the monitoring apparatus.
2. Description of the Related Art
An image forming apparatus that is used as a multifunction machine provided with a printing function for receiving print jobs from a personal computer (PC) and performing printing, a copy function, and the like is available. Such an image forming apparatus is connected to a network and can be shared, as a common printer, among a plurality of users. Since the image forming apparatus can be used by a plurality of users both when used as a printer and when used as a copying machine, an administrator may monitor the use status of the image forming apparatus.
A system for, when a copying machine connected to a monitoring camera determines, using pattern matching, that a document is a particular copy-inhibited document, inhibiting copying of the document and starting video image capturing using the monitoring camera is described in Japanese Patent Laid-Open No 7-44777.
For an image forming apparatus that can be used by a plurality of users, a material output from the image forming apparatus may be removed by a person who is different from a user who instructed performance of an output operation for a corresponding print job or copy job. In particular, it is undesirable that such a problem occurs when an output material contains confidential information or private information.
The present invention provides a monitoring apparatus and a monitoring system for monitoring a person who removed an output sheet for a print job or a copy job from an image forming apparatus that can be used by a plurality of users. With the use of a job-start notification, a job-end notification, and a sheet-removal notification received from the image forming apparatus, a video image during a period including the time at which the sheet output from the image forming apparatus was removed by a person can be recorded, and the video image can be managed in association with job information.
According to a first aspect of the present invention, a monitoring apparatus connected to a monitoring camera capable of monitoring a user of an image forming apparatus through a communication medium includes a job-start-notification reception unit configured to receive a job-start notification from the image forming apparatus; a sheet-removal-notification reception unit configured to receive a sheet-removal notification from the image forming apparatus; and a monitor-video-image recording unit configured to acquire a video image captured by the monitoring camera and to record the video image as a monitor video image. The monitoring apparatus causes the monitor-video-image recording unit to start recording of the video image in response to the job-start notification received by the job-start-notification reception unit. The monitoring apparatus causes the monitor-video-image recording unit to stop the recording of the video image in response to the sheet-removal notification received by the sheet-removal-notification reception unit and manages the monitor video image recorded by the monitor-video-image recording unit in association with job information contained in the job-start notification.
According to a second aspect of the present invention, a monitoring system includes an image forming apparatus capable of performing copying or printing; a monitoring camera capable of capturing a video image of a user of the image forming apparatus; and a monitoring apparatus for controlling the monitoring camera. The image forming apparatus includes a job-start-notification transmission unit configured to, when the image forming apparatus receives a job and starts an image forming operation, transmit a job-start notification containing job information to the monitoring apparatus, and a sheet-removal-notification transmission unit configured to, when the image forming apparatus completes the image forming operation and detects that an output sheet has been removed from a sheet output portion, transmit a sheet-removal notification to the monitoring apparatus. The monitoring apparatus includes a job-start-notification reception unit configured to receive the job-start notification from the image forming apparatus, a sheet-removal-notification reception unit configured to receive the sheet-removal notification from the image forming apparatus, and a monitor-video-image recording unit configured to acquire the video image captured by the monitoring camera and to record the video image as a monitor video image. The monitoring apparatus causes the monitor-video-image recording unit to start recording of the video image in response to the job-start notification received by the job-start-notification reception unit. The monitoring apparatus causes the monitor-video-image recording unit to stop the recording of the video image in response to the sheet-removal notification received by the sheet-removal-notification reception unit and manages the monitor video image recorded by the monitor-video-image recording unit in association with the job information.
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Embodiments of the present invention will now be described in detail in accordance with the accompanying drawings.
In the description of the embodiments, unless it is not particularly specified, same or similar parts throughout the embodiments are represented by the same reference numerals, and the description of those same or similar parts will not be repeated.
Component parts described in the embodiments are merely provided exemplarily. Such component parts do not limit the scope of the present invention.
A configuration of an embodiment of the present invention will be described.
System Configuration
The image forming apparatus 102 has a copying function, a printing function, a facsimile function, a transmission function, and the like. The image forming apparatus 102 is capable of image forming operations, including outputting of an image obtained by scanning by a scanner, outputting of a print job issued from the client PC 105, and outputting a facsimile/transmission job transmitted through a public line.
Configuration of Image Forming Apparatus
A central processing unit (CPU) 201 controls the image forming apparatus 102. A random-access memory (RAM) 202 serves as a system work memory to be used for an operation of the CPU 201. The RAM 202 also serves as an image memory for temporarily storing image data. A read-only memory (ROM) 203 is a boot ROM. A boot program for the system is stored in the ROM 203. System software and image data are stored in a hard disk drive (HDD) 204.
An operation interface (I/F) 206 is an interface for an operation unit (UI) 212. The operation I/F 206 outputs display image data to the operation unit 212. The operation I/F 206 transmits to the CPU 201 information entered by a user through the operation unit 212.
A network interface 210 controls connection with the network (LAN) 101 and performs inputting and outputting of information from and to the network (LAN) 101. A modem 250 controls connection with a public line and performs inputting and outputting of information from an to the public line. The above-mentioned devices are arranged on a system bus 207.
An image bus interface (image bus I/F) 205 is a bus bridge that connects the system bus 207 to an image bus 208 for transmitting image data at high speed and performs conversion of a data structure. The image bus 208 is, for example, a peripheral component interconnect (PCI) bus or IEEE 1394.
The image bus 208 has a raster image processor (RIP) 260, a device IF unit 220, a scanner image processor 280, a printer image processor 290, an image rotator 230, and an image compressor 240 thereon. The RIP 260 expands a page description language (PDL) code transmitted through the network into a bitmap image. The device IF unit 220 connects the scanner 100 and the printer 300, which are image input and output devices, to the controller unit 200, so that conversion of image data can be achieved. The device IF unit 220 receives information related to various sensors provided in the scanner 100 and the printer 300, and transmits the received information to the operation unit 212 and the like.
The scanner image processor 280 performs correction, manipulation, and editing on input image data. The printer image processor 290 performs correction, resolution conversion, and the like corresponding to the performance of the printer 300. The image rotator 230 rotates image data. The image compressor 240 performs JPEG compression/decompression for multi-valued image data and performs Joint Bi-level Image Experts Group (JBIG), Modified Modified Read (MMR), or (Modified Huffman) MH compression/decompression for binary image data.
The scanner 301, which serves as an image input device, irradiates a document by a light source 310. A charge-coupled device (CCD) 343 reads an image through a reflector 311 and a lens 312. Then, the read image is converted into a digital signal. The digital signal is subjected to desired image processing and is converted into a laser recording signal. The resultant recording signal is stored in a memory.
The recording signal (print image data) stored in the memory is transferred to the print engine 313. A laser recording unit converts the recording signal into recording laser beams of four colors, yellow, magenta, cyan, and black. Photosensitive drums 316 of corresponding colors are irradiated with the laser beams, and electrostatic latent images are formed on the corresponding photosensitive drums 316. Toner development is performed using toner supplied from a toner cartridge 317. Primary transfer of a visualized image is performed onto an intermediate transfer belt 321. Then, the intermediate transfer belt 321 rotates clockwise. When a recording sheet supplied through a sheet conveying path 319 from a sheet cassette 318 or the sheet supply deck 314 reaches a secondary transfer position 320, the image is transferred from the intermediate transfer belt 321 to the recording sheet. A fixing unit 322 fixes, by pressurization and heating, the toner onto the recording sheet on which the image has been transferred, and the recording sheet is conveyed through a sheet ejection path. Then, the recording sheet is conveyed to a face-down center tray 323, is switched back and conveyed to a sheet ejector 324 leading to the finisher 315, or is conveyed to a face-up sheet ejector 325. In a case where the finisher 315 is not installed, the face-up sheet ejector 325 is used for sheet ejection to a side tray that is attached to a leading edge of the sheet ejector 325.
In accordance with a function designated by a user, the finisher 315 performs post-processing for a printed sheet. More specifically, the finisher 315 has a stapling function (single-position stapling or two-position stapling), a punching function (two-hole punching or three-hole punching), a saddle-stitch binding function, and the like. The multifunction machine shown in
The image forming apparatus 102 includes a plurality of sensors for detecting the presence of a sheet. For example, the sheet output trays 328 each include a sheet output sensor. With the sheet output sensors, the controller unit 200 is capable of determining, for example, where to output a sheet.
Monitoring Camera
The monitoring camera 103 is installed, for example, at the rear and above the image forming apparatus 102, so as to capture a video image of a user who operates the image forming apparatus 102. A video image captured by the monitoring camera 103 is transferred to the monitoring system control apparatus 104 and is stored in the monitoring system control apparatus 104. Although the monitoring camera 103 is connected to the monitoring system control apparatus 104 through the network (LAN) 101 in this embodiment, the monitoring camera 103 may be directly connected to the monitoring system control apparatus 104.
Monitoring System Control Apparatus
The monitoring system control apparatus 104 controls the monitoring system. In this embodiment, the control of the monitoring system is implemented in accordance with an application program running on a general PC including an HDD for recording data, a network I/F, and the like. In addition, the monitoring system control apparatus 104 is connected to an external apparatus through the network (LAN) 101 in this embodiment. However, the monitoring system control apparatus 104 may be implemented on the controller unit 200 of the image forming apparatus 102. Alternatively, Java implementation environment may be implemented on the image forming apparatus 102, so that the monitoring system can be implemented as a Java program.
A control method according to a first embodiment will be described with reference to a sequence diagram of
When receiving the job-start notification (402), the monitoring system control apparatus 104 starts recording of a video image captured by the monitoring camera 103. The image forming apparatus 102 performs processing for the print job, supplies a formed image to a sheet output portion, and ends the image forming operation. Then, after the sheet is removed by a user, a sheet output sensor detects the removal of the sheet. The image forming apparatus 102 transmits a sheet-removal notification to the monitoring system control apparatus 104 (403). When receiving the sheet-removal notification (403), the monitoring system control apparatus 104 stops recording of a video image captured by the monitoring camera 103. The recorded video image is stored, in association with device information and job information contained in the job-start notification, into the HDD.
The monitoring camera 103 always captures a video image near the monitoring system control apparatus 104. The monitoring system control apparatus 104 acquires the video image and records the acquired video image. The monitoring system control apparatus 104 may instruct the monitoring camera 103 to start or end capturing of a video image.
In the case of a copy job, the image forming apparatus 102 may transmit a job-start notification when a user presses a start key and processing for the job starts. Accordingly, for a copy job, a control method can be achieved with a configuration similar to that for a print job.
As described above, starting and ending of recording of a video image captured by a monitoring camera can be determined in accordance with a notification received from a device, and the acquired video image can be managed in association with job attribute information contained in the notification.
Although a method for managing the image forming apparatus 102 in a case where a single job is input has been described in the first embodiment, a case where jobs are sequentially input and output sheets are kept in a sheet output portion will be described in a second embodiment. As shown by a sequence diagram of
When receiving a notification from the image forming apparatus 102 in step S601, the monitoring system control apparatus 104 determines whether the received notification is a sheet-removal notification in step S602. If it is determined in step S602 that the received notification is not a sheet-removal notification (that is, the received notification is a job-start notification), the monitoring system control apparatus 104 internally registers, as information to be managed, attribute information of job n in step S603. In the example shown in
If it is determined in step S602 that the received notification is a sheet-removal notification, the monitoring system control apparatus 104 stops recording of a video image in step S606. Then, in step S607, the recorded video image and attribute information of the job are stored in association with each other in the monitoring system control apparatus 104. All the images to be associated with attribute information are the same and are received during the period from the reception of the first job-start notification (503) to the reception of the sheet-removal notification (505).
In the first and second embodiments, a job-start notification is used as a trigger for starting recording of a video image. However, by changing a start trigger to delay the video-image-capturing start time in accordance with the attribute of a job, the time required for identifying, in accordance with a video image, a scene in which a user removed an output sheet can be shortened. Thus, the size of a video image file can be reduced, and the efficiency of video image management can be improved. In a third embodiment, an example in which a start trigger is changed according to the type of finishing will be described with reference to a flowchart shown in
When receiving a notification in step S701, the monitoring system control apparatus 104 determines whether the received notification is a sheet-removal notification in step S702. If it is determined in step S702 that the received notification is a sheet-removal notification, the monitoring system control apparatus 104 stops recording of a video image in step S706, and the recorded video image and attribute information of a job are stored in association with each other in the monitoring system control apparatus 104 in step S707, similarly to the flow shown in
If it is determined in step S702 that the received notification is not a sheet-removal notification, the monitoring system control apparatus 104 analyzes the attribute information of the job and determines whether the type of finishing is binding in step S708. If it is determined in step S708 that the type of finishing is biding, the monitoring system control apparatus 104 determines whether the notification received in step S701 is a job-end notification in step S709. If it is determined in step S709 that the received notification is a job-end notification, the subsequent processing is performed as in the second embodiment. That is, the monitoring system control apparatus 104 internally registers, as information to be managed, attribute information of job n in step S703. Here, “n” represents a received job (in the second embodiment, “n” represents A or B). Then, the monitoring system control apparatus 104 determines whether the received notification is a first notification in step S704. If it is determined in step S704 that the received notification is a first notification, the monitoring system control apparatus 104 starts recording of a video image transmitted from the monitoring camera 103 in step S705. Then, the monitoring system control apparatus 104 waits for the next notification. If it is determined in step S704 that the received notification is not a first notification, the monitoring system control apparatus 104 waits for the next notification.
If it is determined in step S709 that the received notification is not a job-end notification, the monitoring system control apparatus 104 waits for the next notification.
If it is determined in step S708 that the type of finishing is not binding, the monitoring system control apparatus 104 determines whether the received notification is a job-start notification in step S710. If it is determined in step S710 that the received notification is a job-start notification, the monitoring system control apparatus 104 performs recording processing in steps S703 to S705. If it is determined in step S710 that the received notification is not a job-start notification, the monitoring system control apparatus 104 waits for the next notification.
The determination as to the type of finishing in step S708 may be a determination of whether job information contains a finishing attribute.
Although the case of binding has been described in the third embodiment, post-processing, such as stapling, may be performed as finishing.
As described above, by analyzing the attribute of a job, starting and ending of recording by a monitoring camera and storing of a recorded video image can be controlled in consideration of the type of finishing, such as binding. Thus, management of a video image captured by the monitoring camera can be efficiently achieved.
In the first to third embodiments, in order to manage an output material (printed sheet), job information and a video image captured by a monitoring camera are managed in association with each other. In a fourth embodiment, since owner information of a job, job information, and a video image are managed together, high-precision management can be achieved.
An example of a control method according to the fourth embodiment will be described with reference to a sequence diagram shown in
The image forming apparatus 102 performs processing for the print job, and a formed image output is transmitted to a sheet output portion. After the output sheet is removed by a user, a sheet output sensor detects the removal of the output sheet. Then, the image forming apparatus 102 transmits a sheet-removal notification to the monitoring system control apparatus 104 (804). When receiving the sheet-removal notification (804), the monitoring system control apparatus 104 stops recording of a video image captured by the monitoring camera 103. The captured video image (photography record A) is stored in association with device information, job information, and job-owner information contained in the job-start notification into the HDD of the monitoring system control apparatus 104.
Finally, the monitoring system control apparatus 104 stores job information, a video image captured by the monitoring camera 103, and owner information together. If owner information contains image information, such as a facial portrait of an owner, comparison between the facial portrait and a person who appears in the stored video image can be performed.
Accordingly, higher-level management of information on an output job and a video image captured by a monitoring camera can be achieved.
Embodiments of the present invention may be embodied, for example, as a system, an apparatus, a method, a program, a storage medium, or the like. More specifically, embodiments of the present invention may be applied to a system including a plurality of apparatuses or to an apparatus including a single device.
According to aspects of the present invention, functions of the foregoing embodiments can be attained when software programs are supplied to a system or an apparatus directly or via remote control and when a computer of the system or the apparatus reads and executes supplied program code. In this case, the supplied programs correspond to flowcharts represented in the foregoing embodiments.
Thus, in order to implement functional processing of an aspect of the present invention, a program code itself installed into the computer also implements embodiments of the present invention. That is, a computer program itself for attaining functional processing of an aspect of the present invention falls within the scope of the present invention.
In this case, the computer program may be of any type, such as an object code, a program to be executed by an interpreter, or script data to be supplied to an operating system (OS), as long as it has a function of a program.
As a recording medium for supplying a program, for example, a floppy disk, a hard disk, an optical disc, a magneto-optical disk (MO), a compact disc read-only memory (CD-ROM), a compact disc recordable (CD-R), a compact disc rewritable (CD-RW), a magnetic tape, a non-volatile memory card, a ROM, or a digital versatile disc (DVD) (including a DVD-ROM and a DVD-R) is available.
In addition, the program may be obtained by connecting to a website on the Internet using a browser of a client computer and by downloading a computer program according to an aspect of the present invention from the website to a storage medium, such as a hard disk. In this case, the program to be downloaded may be a compressed file having an automatic installation function. In addition, the program may be supplied by dividing the program code constituting the program according to an aspect of the present invention into a plurality of files and by downloading the divided files from different websites. That is, a World Wide Web (WWW) server for allowing a plurality of users to download a program file for attaining functional processing of an aspect of the present invention on a computer is also included in the present invention.
In addition, a program according to an aspect of the present invention may be encoded and stored in a storage medium, such as a CD-ROM, and may be distributed to users. Only a user who satisfies predetermined conditions may be able to download key information for decoding the encoded program from a website via the Internet. In addition, the encoded program can be executed by using the downloaded key information and can be installed to a computer.
In addition, the functions of the foregoing embodiments can be attained not only when the read program is executed by the computer but also when part or all of the actual processing is performed in cooperation with an operating system (OS) or the like running on the computer on the basis of instructions of the program. In this case, the OS or the like performs part or all of the actual processing and the functions of the foregoing embodiments can be attained by the processing.
Furthermore, the program read from the recording medium may be written to a memory arranged in a function expansion board inserted into the computer or a function expansion unit connected to the computer. The functions of the foregoing embodiments can also be attained when part or all of the actual processing is performed by the CPU or the like arranged in the function expansion board or the function expansion unit on the basis of instructions of the program after the program is written to the function expansion board or the function expansion unit.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all modifications, equivalent structures and functions.
This application claims the benefit of Japanese Application No. 2007-029354 filed Feb. 8, 2007, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2007-029354 | Feb 2007 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
7340194 | Ozawa | Mar 2008 | B2 |
7386246 | Yabe | Jun 2008 | B2 |
7609952 | Jezierski et al. | Oct 2009 | B2 |
20050111867 | Hatano | May 2005 | A1 |
20050214016 | Ozawa | Sep 2005 | A1 |
Number | Date | Country |
---|---|---|
7-44777 | Feb 1995 | JP |
11-194687 | Jul 1999 | JP |
2005142991 | Jun 2005 | JP |
Number | Date | Country | |
---|---|---|---|
20080193146 A1 | Aug 2008 | US |