Patent Application
20080068464
The preferred embodiments according to the present invention will further be described below with reference to the accompanying drawings.
In this embodiment, a system for delivering images will be explained, in which data for suspending and resuming the monitoring work is input by observers and the image combining processing is performed at the display side.
Firstly, the configuration of the system for delivering images according to the first embodiment will be explained.
Next, the operation of the system for delivering images according to the embodiment will be explained.
The respective plural cameras 102 send picked up images to the image distribution unit 11. To each of the images sent from the cameras 102, an image number indicative of one of the cameras 102 that picked up the image is appended.
For example, the monitoring state input unit 32 and the notification input unit 33 are buttons. When an observer suspends the monitoring work at the time of starting the intermission etc., the observer presses the button of the monitoring state input unit 32. Furthermore, when an observer resumes the monitoring work at the time of ending the intermission etc., the observer presses the button of the monitoring state input unit 32. When this button is pressed, the monitoring state input unit 32 sends state information that indicates that the monitoring state of the observer is changed to the observer information management unit 12. Moreover, in case it is necessary to send a notification to the job site or to security guards in emergency situations, an observer presses the button of the notification input unit 33. When this button is pressed, the notification input unit 33 sends notification information that indicates that sending a notification is necessary to the notification unit 13.
On the other hand, the monitoring state input unit 32 and the notification input unit 33 may be user interfaces displayed on the display unit 31.
The observer information management unit 12 retains a monitoring state list and a delivery image list.
The notification unit 13 that receives notification information from the notification input unit 33 sends a notification to the job site or to security guards.
Next, the operation of the delivery processing by the image distribution unit 11 will be explained. As the delivery processing, there are a first delivery processing in which the processing of combining a plurality of images to be displayed on the display unit 31 is performed by the monitoring device 103, and a second delivery processing in which this image combining processing is performed by the center system 101.
Firstly, the first delivery processing will be explained.
The display unit 31 that receives the delivery information and images from the image distribution unit 11 disposes the images based on the number of images in the delivery information to display the images. At this time, the display unit 31 determines the optimum image display size and disposition in accordance with the number of images to dispose the images. For example, in case of disposing the images in the form of a matrix, the delivery information includes image numbers, matrix size, and component numbers in the matrix. The image distribution unit 11 may determine the disposition of the images, and sends the result to the display unit 31 as the delivery information to make the display unit 31 dispose the images in accordance with the delivery information.
Next, the second delivery processing will be explained.
The display units 31 which receive the combined images from the image distribution unit 11 display the combined images.
In this embodiment, the image distribution unit 11 repeats the distribution processing. On the other hand, the image distribution unit 11 may perform the distribution processing in case of receiving the state information from the monitoring state input unit 32.
Next, the operation of above-described distribution processing will be explained. As the distribution processing, there are a first distribution processing in which images to be distributed to observers are not determined in advance, and a second distribution processing in which images to be distributed to observers are determined in advance.
Firstly, the first distribution processing will be explained.
Next, the image distribution unit 11 calculates the number of monitoring-possible observers from the monitoring state list (S22). The image distribution unit 11 reads out the monitoring state one record by one record (one observer by one observer) from the monitoring state list, and increments the number of monitoring-possible observers in case the monitoring state is “possible”. Accordingly, at the time when the image distribution unit 11 reads out the monitoring state list entirely, the number of monitoring-possible observers is set up.
Next, the image distribution unit 11 performs a pre-processing before the distribution processing (S23). In performing the pre-processing before the distribution processing, the minimum number of images and the number of surplus images are calculated using the following mathematical formulas. The minimum number of images has its fractional part truncated to be an integer number.
The minimum number of images=(the number of images to be monitored)/(the number of monitoring-possible observers)
The number of surplus images=(the number of images to be monitored)−(the minimum number of images)×(the number of monitoring-possible observers)
Then, the image distribution unit 11 reads out the monitoring state one record by one record (one observer by one observer) from the monitoring state list (S24), and judges whether or not reading out the monitoring state is ended. In case the reading out is ended (S31, Yes), this flow is ended. In case the reading out is not ended (S31, No), the processing goes to the next step. In this processing, an observer who corresponds to a read out record is set to a subject observer.
Then, the image distribution unit 11 judges whether or not the monitoring state of a subject observer is “possible”. In case of “impossible” (S32, No), the distribution processing for the subject observer is not performed (S39), returning to the processing of S24. In case of “possible” (S32, Yes), the processing goes to the next step. Next, the image distribution unit 11 judges whether or not the number of surplus images is larger than “0”. In case of being “0” (S33, No), the processing goes to S34. In case of being larger than “0” (S33, Yes), the processing goes to S36.
In case the processing of S33 is No, the image distribution unit 11 performs the processing of distributing images to the subject observer (S34). In this processing, images whose image numbers are from (the distributed image number+1) to (the distributed image number+the minimum number of images) are distributed to the subject observer. Next, the image distribution unit 11 updates the distributed image number (S35), returning to the processing of S24. The distributed image number comes to be an image number which was lastly distributed (the distributed image number+the minimum number of images).
In case the processing of S33 is Yes, the image distribution unit 11 performs the processing of distributing images to the subject observer (S36). In this processing, images whose image numbers are from (the distributed image number+1) to (the distributed image number+the minimum number of images+1) are distributed to the subject observer. Next, the image distribution unit 11 updates the distributed image number and the number of surplus images (S37), returning to the processing of S24. The distributed image number comes to be an image number which was lastly distributed (the distributed image number+the minimum number of images+1), and the number of surplus images is decremented by “1”.
By performing the first distribution processing, it is unnecessary to determine images to be distributed to the respective observers in advance, and it becomes possible to evenly distribute images to the utmost extent.
Next, the second distribution processing will be explained.
In this case, the observer information management unit 12 retains a standard monitoring image list which has been registered by the manager of the center system 101 in advance. Standard monitoring images are images which have been determined in advance, and are to be monitored by respective observers. Standard monitoring image numbers which are image numbers of the standard monitoring images are registered in the standard monitoring image list.
Next, the image distribution unit 11 calculates the number of monitoring-possible observers and the number of monitoring-impossible images from the monitoring state list, and forms the monitoring-impossible image list (S42). The image distribution unit 11 reads out the monitoring state one record by one record (one observer by one observer) from the monitoring state list, and increments the number of monitoring-possible observers in case the monitoring state is “possible”. Accordingly, at the time when the image distribution unit 11 reads out the monitoring state list entirely, the number of monitoring-possible observers is set up. In case the monitoring state is “impossible”, the number of standard monitoring images of the observer is added to the number of monitoring-impossible images, and standard monitoring image numbers of the observer are added in the monitoring-impossible image list.
Next, the image distribution unit 11 performs a pre-processing before the distribution processing (S43). In performing the pre-processing before the distribution processing, the number of addition images is calculated using the following mathematical formula. The number of addition images has its fractional part truncated to be an integer number.
The number of addition images=(the number of monitoring-impossible images)/(the number of monitoring-possible observers)
Then, the image distribution unit 11 reads out the monitoring state one record by one record (one observer by one observer) from the monitoring state list (S44), and judges whether or not reading out the monitoring state list is ended. In case the reading out is ended (S51, Yes), this flow is ended. In case the reading out is not ended (S51, No), the processing goes to the next step. In this processing, an observer who corresponds to a read out record is set to a subject observer.
Then, the image distribution unit 11 judges whether or not the monitoring state of a subject observer is “possible”. In case of “impossible” (S52, No), the distribution processing for the subject observer is not performed (S59), returning to the processing of S44. In case of “possible” (S52, Yes), the processing goes to the next step. Next, the image distribution unit 11 judges whether or not the number of monitoring-impossible images is larger than “0” (S53).
In case the number of monitoring-impossible images is “0” (S53, No), the image distribution unit 11 performs the processing of distributing the standard monitoring images to the subject observer (S54), returning to the processing of S44. The image distribution unit 11 obtains image numbers of the subject observer in the standard monitoring image list, and registers the image numbers as image numbers of the subject observer in the delivery image list.
In case the number of monitoring-impossible images is larger than “0” (S53, Yes), the image distribution unit 11 performs the processing of distributing the standard monitoring images and the addition images to the subject observer (S56). The image distribution unit 11 obtains image numbers of the subject observer in the standard monitoring image list, and registers the image numbers as image numbers of the subject observer in the delivery image list. Further, the image distribution unit 11 obtains image numbers corresponding to the number of addition images from the monitoring-impossible image list, and registers the image numbers as image numbers of the subject observer in the delivery image list. Next, the image distribution unit 11 updates the number of monitoring-impossible images and the monitoring-impossible image list (S57), returning to the processing of S44. In this processing, the image distribution unit 11 decrements the number of monitoring-impossible images by the number of addition images, and deletes the addition images from the monitoring-impossible image list.
By performing the second distribution processing, it becomes possible to designate images to be monitored for the respective observers, and the observers can keep monitoring determined images.
Next, a specific example of the operation of the system for delivering images will be explained.
Firstly, at time point “t1”, the monitoring state of observers corresponding to the monitoring devices 103a, 103b, 103α is “possible” respectively, and images A, B, C are delivered to the monitoring device 103a, images D, E, F are delivered to the monitoring device 103b, and images X, Y, Z are delivered to the monitoring device 103α. Next, at time point “t2”, in case the observer corresponding to the monitoring device 103α suspends the monitoring work (presses the button of the monitoring state input unit 32), the monitoring state of the observer corresponding to the monitoring device 103α becomes “impossible”. Accordingly, the images A, B, C, X are delivered to the monitoring device 103a, and the images D, E, F, Y are delivered to the monitoring device 103b. In this way, when the monitoring state of a monitoring device changes from “possible” to “impossible”, images which were delivered to the monitoring device come to be distributed to other monitoring devices, which makes it possible to keep monitoring the images. Next, at time point “t3”, in case the observer corresponding to the monitoring device 103α resumes the monitoring work (presses the button of the monitoring state input unit 32 again), the monitoring state of the observer corresponding to the monitoring device 103α becomes “possible”, and the images A, B, C are delivered to the monitoring device 103a, the images D, E, F are delivered to the monitoring device 103b, and the images X, Y, Z are delivered to the monitoring device 103α, as is similar to the case at time point “t1”. In this way, when the monitoring state of a monitoring device changes from “impossible” to “possible”, images are delivered to the monitoring device again, which can make the monitoring device resume monitoring the images.
According to the embodiment, images are distributed to be delivered according to the monitoring state of observers. Accordingly, it is not necessary to prepare observers for alternation with respect to one display unit, which makes it possible to dispersedly allocate observers geographically. Furthermore, it becomes possible to determine the number of observers which is suitable for the total number of images to be monitored, and it becomes unnecessary to allocate extra observers.
In this embodiment, a system for delivering images will be explained, in which monitoring devices judge the state of observers.
Firstly, the configuration of the system for delivering images according to the second embodiment will be explained.
Next, the operation of the system for delivering images according to the embodiment will be explained.
Each of the cameras 35 is so arranged as to pick up the face of an observer squarely at the time of monitoring images, and outputs thus picked up images to the monitoring state judgment unit 34 as monitoring state images. The monitoring state judgment unit 34 performs the monitoring state judgment processing of judging the monitoring state of the observer based on the monitoring state images. On the other hand, other sensors may be used to detect the monitoring state of observers instead of the cameras 35.
Next, the monitoring state judgment processing will be explained.
Firstly, a closed-state time period indicative of a time period during which an observer closes the eyelids is initialized.
Next, the monitoring state judgment unit 34 judges the direction of the face in the monitoring state image (S74). In case the direction of the face is out of a preset range around the front-facing direction, that is, in case of not paying attention to images (S75, out of range), it is determined that the monitoring work is impossible (S87), ending the flow. In case the direction of the face is within a preset range around the front-facing direction (S75, within range), the processing goes to the next step. Then, the monitoring state judgment unit 34 judges the opened/closed state of eyes in the monitoring state image (S76), judging whether or not eyes are opened (S77).
In case eyes are opened (S77, Yes), the monitoring state judgment unit 34 determines that the monitoring work is possible (S81), and initializes the closed-state time period (S82), ending the flow.
In case eyes are closed (S77, No), the monitoring state judgment unit 34 updates the closed-state time period to set a time period from a time point when the closed-state time period is initialized to the current time point as a new closed-state time period (S84), and judges whether or not the new closed-state time period is equal to or shorter than a threshold value. In case the new closed-state time period is equal to or shorter than a threshold value (S85, equal to or shorter than a threshold value), it is determined that the monitoring work is possible (S86), ending the flow. On the other hand, in case the new closed-state time period is longer than a threshold value (S85, longer than a threshold value), it is determined that the monitoring work is impossible (S87), ending the flow. The threshold value is the upper limit of a closed-state time period which can be seen as a blink.
Next, the monitoring state judgment unit 34 sends the judgment result (monitoring work is possible or monitoring work is impossible) by the monitoring state judgment processing to the observer information management unit 12 as the state information. The observer information management unit 12 updates the monitoring state list in accordance with thus received state information.
Other operation of the system for delivering images according to the embodiment is similar to that in the first embodiment.
According to the embodiment, even if an observer does not press the button, the state in which the monitoring work is impossible due to the temporary absence of the observer can be determined. Furthermore, since the state in which the monitoring work is impossible due to the lack of concentration, etc., of the observer can be determined, failure in the monitoring work can be reduced. Accordingly, delay in finding out abnormal circumstances due to the failure in the monitoring work can be reduced.
In this embodiment, a system for delivering images will be explained, in which the center system judges the state of observers.
Firstly, the configuration of the system for delivering images according to the third embodiment will be explained.
Next, the operation of the system for delivering images according to the embodiment will be explained.
Each of the cameras 35 outputs picked up monitoring state images to the monitoring state judgment unit 14 as is similar to the second embodiment. The monitoring state judgment unit 14 performs the monitoring state judgment processing of judging the monitoring state of observers based on the monitoring state images. The monitoring state judgment processing is similar to that in the second embodiment.
According to the embodiment, since the monitoring state judgment processing is performed at the center system 121, the monitoring devices 123 can be realized at low cost.
On the other hand, an image receiving unit and a delivery unit correspond to the image distribution unit 11 in these embodiments. Furthermore, a state receiving unit and a standard information receiving unit correspond to the observer information management unit 12 in these embodiments. Moreover, a monitor and a display control unit correspond to the display unit 31 in these embodiments. Yet, moreover, a state detection unit corresponds to the monitoring state input unit 32 or the camera 35 in these embodiments. Yet, moreover, a state judgment unit corresponds to the monitoring state judgment unit 14 or the monitoring state judgment unit 34 in these embodiments. Yet, moreover, an image pickup unit corresponds to the camera 102 in these embodiments.
On the other hand, an image receiving step corresponds to the processing of S11 in these embodiments. Furthermore, a state receiving step corresponds to the processing of S24, S44 in these embodiments. Moreover, a delivery step corresponds to the processing of S31 to S37, S51 to S57 in these embodiments.
The center system in these embodiments can be easily applied to an information processing device, which can enhance the performance thereof. As the information processing device, a server etc. may be included. Furthermore, the monitoring device in these embodiments can be easily applied to an information processing device, which can enhance the performance thereof. As the information processing device, a PC (personal computer), workstation, PDA (personal digital assistant), etc., may be included.
Furthermore, a program that makes a computer configuring the center system execute above-described respective steps can be provided as a program for delivering images. Being stored in a computer-readable recording medium, the program can make a computer configuring the center system execute above-described respective steps. The computer-readable recording medium may be an internal storage to be mounted in a computer such as a ROM or RAM, or a portable recording medium such as a CD-ROM, flexible disk, DVD disk, magnet-optical disk, IC card, or a database storing computer programs, or other computers and their databases, or a transmission medium on a line.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006-249252 | Sep 2006 | JP | national |
