1. Field of the Invention
The present invention relates to an image outputting system which can be used for remote monitoring with an input image, and to a control program for outputting an image.
2. Description of the Related Art
Conventionally, there are techniques related to an image displaying system for outputting and displaying images shot by a camera on a displaying unit such as a monitor or the like, in a manner which meets the requests by a user such as a purpose of the image or the like. For example, Japanese Patent Application Publication No.52-013721 discloses a technique in which a television receiver including an magnetic recording/reproducing unit displays images of television and images reproduced by the electromagnetic recording/reproducing unit such as a video tape recorder or the like, by suitably switching between both images.
In many industries such as manufacturing, distributing, financing and the like, monitoring by a camera is widely used for employing security, or for enhancing efficiency of operations as one purpose of an image displaying system. Conventionally, many of the image displaying systems used for monitoring have employed a method of recording analog image signal from an installation point of a camera in a video recorder or the like. Recently, network environments that allow high speed and high volume transmissions have become widespread, permitting remote monitoring systems to remotely monitor obtained images. Generally in a remote monitoring, image data is transmitted to a monitoring center via an IP network, Internet or the like. The image data that is transmitted is digitized and compressed in a format of MPEG (moving picture expert group), motion-JPEG or the like, in accordance with the relationship between the amount of data to be transmitted and the transmission rate of the used network, and the like.
Recently, image displaying systems have become increasingly widely employed as a form of monitoring system. Accompanying this, also a request by a user for a monitoring system which can monitor images from cameras installed at points at one monitoring center or the like in order to concentratedly monitor many branches, for example, in the case of financial institutions or a chain of stores and the like, even when points to be monitored by installing cameras increase in number. And as the points to be monitored increase in number, the load for monitoring in the monitoring center increases.
As for an image displaying system for solving the above problem, Japanese Patent Application Publication No. 2000-339923 discloses a system which detects an event requesting for the display of the image and which causes a monitor to display the image. According to a technique disclosed in the above Japanese Patent Application Publication No. 2000-339923, images whose events have occurred i.e. the images requiring the monitoring among the image signals received from a plurality of cameras are displayed preemptively on the monitor. Thereby, in a monitoring center, a user does not have to search and find the image to be interested in among the plurality of the images.
Further, Japanese Patent Application Publication No. 2001-34250 discloses a system which assigns importance to each of the images so that the images are displayed according to the importance. According to the technique disclosed in the above Japanese Patent Application Publication No. 2001-34250, the importance is determined based on the events to be occurred to subjects of cameras or the like so that the image with a greater importance is emphasized or displayed in a prescribed position, thereby making it easier for the user to pay attention to that image.
Besides, there is an image displaying system for simultaneously displaying a plurality of images by sharing one screen of a monitor. For example, sixteen images are simultaneously displayed on one monitor by dividing a screen of the monitor into areas in the same size. Alternatively, the image to be displayed is switched to another in accordance with a prescribed time interval so that images of more points are displayed on one monitor. Also, there is a system which combines and uses the method of dividing a display and the method of switching images by a prescribed time interval.
In the above image displaying systems using the method of dividing a display or the method of switching images by the time interval, it is very difficult for a single user to understand the entire situation by viewing the simultaneously displayed plural images or the images which are automatically switched by a prescribed time interval when he or she is to refer to and monitor the images. Conventionally, in order to avoid omission of monitoring, a load on one person is reduced by increasing manpower or the like. However, a broader space for systems is required to provide monitors in the greater number. Further, in the system which switches the images by a prescribed time interval, when an event occurs, the image of the event may not be displayed on the monitor.
Further, in a system disclosed in the above Japanese Patent Application Publication No. 2000-339923 in which images are switched by an occurrence of an event, the images are switched too frequently in the case that events occur frequently. As a result, there is a problem in practical use that display time for each one of the images becomes too short so that an image is switched to another before the user actually views the image and confirms the event.
It is an object of the present invention to provide an image displaying system which makes it easier for a user to actually view and confirm displayed images and a control program for displaying the image, in a system for receiving and displaying a plurality of image data.
In order to achieve the above object, an image outputting system according to the present invention comprises an outputting unit for simultaneously outputting a plurality of input image data, a storing unit for storing output management information including output starting time regarding each of image data, a detecting unit for detecting an event which requests the outputting unit to display new image data, and a determining unit for determining whether or not the new image data corresponding to the detected event can be output to the outputting unit based on the output management information regarding each piece of image data stored in the storing unit, and when it is determined that the new image data can be output to the outputting unit, the outputting unit outputs the new image data instead of a previous image data determined based on the output management information among image data previously output.
The plurality of the input image data is output to an outputting unit in parallel in time and position. When the detecting unit detects the event, it is determined whether or not the image data whose event is detected can be output based on the output management information. As for the image data whose event is detected which is determined to be able to be output, an output time to the outputting unit is ensured.
The determining unit can determine that the new image data can not be output when any of the minimum display times which have a lower limit time for which the outputting unit is made to display each piece of the image data have not elapsed from the output starting time, regarding all of the image data in the prescribed number being output to the outputting unit. For each of the image data being output to the outputting unit and the image data whose event is detected, the output time is ensured.
A recording unit can be further comprised for recording the new image data which is determined not to be able to be output by the determining unit, and the outputting unit can output the new image data recorded in the recording unit on a prescribed timing. Even when it is determined that the new image data can not be output by the determining unit, the new image data is once recorded in the recording unit and the recorded data is output later. Thereby, the output time is ensured for each piece of the image data being output to the outputting unit and the new image data determined not to be able to be output by the determining unit.
Further, when the minimum display time of any of the image data in the prescribed number being output to the outputting unit has elapsed from the output starting time, the outputting unit can stop the output of the image data being output whose minimum display time has elapsed, and can output the new image data recorded in the recording unit. The output is switched from the image whose minimum display time has elapsed to the new image data recorded in the recording unit among the plurality of the image data being simultaneously output to the outputting unit. Thereby, the outputting time is ensured for each of the image data being output and the image data recorded in the recording unit.
In addition, the present invention is not limited to the above. A control program and method of outputting image for realizing the image outputting system, and the like are also included in the present invention.
According to the present invention, in an image outputting system which can switch image data to be displayed by detecting an event, it is determined whether or not the image data whose event is detected can be output based on whether or not other image data which is currently output has been continuously output longer than a minimum time period necessary for the confirmation of the contents of the image. Thereby, a user using the system to confirm the image can confirm the image more easily because the frequency of switching of output images is not raised above the prescribed value.
Hereinafter, the preferred embodiments of the present invention will be explained in detail, referring to the drawings.
In each of the monitored points 2, a camera 21, an encoder 22, a sensor 23, a security system 24 and a storage medium 25 are provided. The camera 21 shoots an image in the monitored point 2 to be transmitted to the data center 3 and the monitoring center 4. The encoder 22 compresses the image signal obtained from the camera 21 and converts the signal to image data in a format of MPEG or the like. Examples of the censor 23 include various types of sensors, e.g. an optical sensor such as an infrared sensor and an ultrasonic sensor and the like. The sensor 23 detects an occurrence of an event such as an alarm, action and the like in the monitored point 2. The security system 24 is an equipment for monitoring states of the monitored point 2 which are not detected by the sensor 23. Examples of the security system 24 include a communicator, a lighting device and the like. The storage medium 25 stores the image data compressed by the encoder 22.
The data center 3 comprises a management server 31 and a data storage server 32. The management server 31 includes a management table for including, for example, display management information regarding the event which has occurred and the display of the image, which is the information other than the image data among the data received from the monitored point 2. The data storage server 32 stores the image data received from each of the monitored points 2 as occasion demands.
The monitoring center 4 directly receives the image data from the monitored point 2, or indirectly receives the image data which has been once stored in the data storage server 32 of the data center 3. The monitoring center 4 comprises a decoder 41 and a monitor (outputting unit) 42. The compressed image data is decompressed in the decoder 41 and is output and displayed on the monitor 42. A user of the image displaying system 1 confirms a state of the monitored point 2 by watching the image displayed on the monitor 42. The monitor 42 displays images of a plurality of the monitored points 2 on one screen being divided for example, into nine windows or into sixteen windows.
When an event is detected in the monitored point 2, a real time image obtained from the camera 21 or a recorded image is transmitted to the monitoring center 4 via the network 10 in accordance with the monitoring state in the monitoring center 4, and is displayed on the monitor 42. The monitoring state in the monitoring center 4 is determined based on whether or not each image displayed on the monitor 42 at a time when the event is detected has been displayed continuously longer than a predetermined period of time.
The switch circuit 43 conducts switching so that data from the camera 21 whose image has to be displayed on the monitor 42 among the plurality of the connected cameras 21 can be received by the controller 44, and connects the desired camera to the controller 44. The timer 45 manages time during which the image from the camera 21 is to be displayed on the monitor 42, etc. in accordance with data stored in the management server 31. The data storage server 32 stores the image data from the camera 21 as occasion demands.
The controller 44 comprises a detecting unit (detecting means) 47 and a determining unit (determining means) 48. The detecting unit 47 detects receipt of the notification of an event from the camera 21. The determining unit 48 determines whether or not the image from the camera 21 which has notified the new event is to be displayed on the monitor 42 by referring to a management table 34 and a minimum display time 33. When it is determined that the above image regarding the new event can be displayed, the determining unit 48 further stops a display of other images which are currently displayed, and displays the new image. When it is determined that the above image can not be displayed, the determining unit 48 stores the image from the camera 21 which has notified the new event in the data storage server 32. The controller 44 executes an image process for causing the monitor to display the received image data, a switch control process of the switch circuit 43, and a timer management process for displaying the image during a prescribed period of time, and the like.
In addition, the data storage server 32 as a recording device is provided in the image displaying device 5 in
The table number is an identification number to be used for identifying each of the monitored points 2. The image index includes information such as a name of point, IP address of the encoder 22 and the like to be used for identifying each of the plurality of the monitored points 2. The display position includes information which specifies the position on the monitor 42 of the monitoring center 4 regarding the image data to be displayed on the monitor 42. The occurrence time of event is a time at which an event is detected by the sensor 23 and the security system 24. The display starting time is a time at which each of the image data being displayed on the monitor 42 starts to be displayed, among the plurality of the image data.
In the image displaying system 1 according to the present invention, as for information regarding the image data on the image data management table, which is displayed on the monitor 42, in other words, as for the images to which display positions are assigned, for example, the information which is needed for displaying on the monitor 42 is read from the image data management table and the read data is stored and managed on another table which will be described later.
The display number is a number to be used for identifying each of windows which are displayed as the divided display on the monitor 42. The display position coordinate includes the position coordinates for specifying the display position on the monitor 42, for example as shown in
The monitoring center 4 determines the image to be displayed on the monitor 42 based on the information as shown in
It is assumed that an event is further detected at the monitored point 2 whose image is not currently displayed on the monitor 42 when images are displayed on the windows of the screen being divided into nine on the monitor 42, transmitted from nine points at which events were detected. In the above case, it is determined whether or not the image of the point at which the event is newly detected is to be displayed instantaneously based on whether or not the image with the oldest display starting time has been displayed on the monitor 42 continuously longer than the minimum display time δt. Hereinafter, processes to be executed in the image displaying system 1 according to the present embodiment, upon the detection of events will be explained by referring to
In the above case, the image data after the occurrence of the event is compressed by the encoder 22 and transmitted in real time to the monitoring center 4 via the network 10, and is displayed. The output of the image whose display starting time is the oldest and whose minimum display time δt has elapsed from the display starting time among the images currently displayed on the monitor 42 when the event is detected (the image of the point A in
Switching the image which is displayed in position “1” and the information about the switched image can be displayed on the monitor 42 by means of letters or the like when the image of the monitored point X starts to be displayed on the monitor 42, so that the user can easily confirm the information regarding the above switching. For example, a frame of the image of the monitored point X can be marked in a different color or the like in order to indicate that the image in the display position “1” has been switched to another. Further, in order to show the information regarding the image of the monitored point X which newly starts to be displayed, for example, the name of the monitored point X (e.g. north exit of the “A” building or the like), name of the camera, and the like can be displayed by means of letters.
As explained above by referring to
In the above case, the image data of the point Y after the occurrence time of event is compressed by the encoder 22 and recorded in the storage medium 25, or is transmitted to the data center 3 via the IP network 10 and recorded in the data storage server 32. When the minimum display time δt of the image of the point A has elapsed from the display starting time TA thereof, the recorded image regarding the point Y starts to be output from the time t=TA+δt in the display position “1” in place of the image of the point A. The image data between the time of detection of event and the minimum display time δt is recorded, and transmitted to the monitoring center 4 from the encoder 22 or from the data storage server 32. In the monitoring center 4, the compressed data is decompressed by the encoder 41 and the recorded image is displayed at least for the minimum display time δt. After the minimum display time δt has elapsed, data transmitted from the monitored point Y is displayed in real time, for example.
In addition, it is also possible that information regarding the monitored point Y at which the event is detected is displayed on the monitor 42 by means of letters even while the image of the point A is still displayed on the monitor 42, in order to notify the detection of the event at the monitored point Y to the user. Examples of displayed information include a name of the monitored point Y, a name of the camera, the detection time of the event and the like. It is the same as in
As explained above by referring to
In addition, in
Hereinabove, the outline of the configuration and the operations of the image displaying system 1 according to the present embodiment is explained. Hereinafter, the concrete process operations of the system will be explained by referring to
Firstly in the monitored point 2, the image data obtained from the camera 21 is subject to an encoding process such as compression or the like in the encoder 22, and stored in the storage medium 25. The storage medium in
When an event is detected based on the analysis of the image obtained from the sensor 23, the security system 24 or the camera 21, the event is notified to the monitoring center 4. When the event is notified, a receiving unit requests to display the image of the notified event on the monitor 42. When receiving the request, a determining unit 48 determines whether or not the image can be instantaneously displayed on one of the windows made by the divided display of the monitor, by using the result of a display area search of FIG. 8.
When it is determined that the instantaneous display is possible, the image data whose event is detected is extracted from the encoder 22 in real time. The decoder 41 decompresses the received image data, and displays the decompressed data on the monitor 42.
Conversely, when it is determined that the instantaneous display is impossible, the place, time and the like at which the event was detected are notified to the user of the system by means of letters or the like. However, the image of the event is not instantaneously displayed. A timer 45 is set in order that the timer expires when the minimum display time δt has elapsed, regarding one of the images being currently displayed. The image after the detection of the event is stored in the storage unit in the monitored point 2 until the timer 45 expires and the notification is given from the monitoring center 4.
When the timer 45 expires, i.e. when the minimum display time δt of one of the images being currently displayed (the image of the point A in the above example) has elapsed, the monitored point 2 is requested to stop the distribution of the above image. After the output of the image previously displayed is stopped, the update of information of the management table managed in the management server 31 and the setting of the timer 45 regarding the image to be newly displayed are conducted. The image of the point at which the event is detected is extracted from the storage unit and the recorded data is displayed on the monitor 42. The recorded data is displayed for the minimum display time δt.
When the recorded image has been displayed for the minimum display time δt, the timer 45 expires and the expiration of the timer is notified to the decoder 41. The monitored point 2 which has transmitted the recorded data is requested to transmit the real time image of the monitored point 2 by monitoring center 4 after the timer 45 has expired, and the real time image is received via the encoder 22 and is displayed on the monitor 42.
Firstly in step S1, the number “i” which is assigned to the image being displayed as the target of the search is initialized so that “i=1”. The number “i” corresponds to the display number in
In step S4, the values are compared between the display starting time Dt(i) and Dt(i+1). When Dt(i) is greater, the starting time Ta=Dt(i+1) is set in step S5, the display position A=i+1 is set in step S6, and the process proceeds to step S7. When Dt(i+1) is equal to or grater than Dt(i) in step S4, the process skips the steps S5 and S6, and proceeds to step S7.
In step S7, it is determined whether or not the table number “i” is smaller than a display capacity number “N” of the monitor 42. The display capacity number “N” is the maximum number of the images which can be displayed on the monitor 42 by the divided display, and in the above embodiment, N=9. When the determination result is YES in step S7, one is added to “i” in step S8, and the processes of the step S4 and the subsequent steps are executed. Thereafter, the processes from the step S4 to the step S7 are repeated until the table number “i” becomes equal to the display capacity number “N”, and when i=N is realized, the process proceeds to step s9, thereafter, a current time Tc is set as the occurrence time of event Tc, and the process is ended.
As shown in
Firstly in step S10, the display time T=Tc−Ta is set. The “Tc” here is the time of the moment which is set as the occurrence time of event in the step S9 of
As shown in
As shown in
As shown in
As above, by the image displaying system 1 according to the present embodiment, when an event is detected at a point, it is determined whether or not an image being displayed on the monitor 42 at a time of the detection of the event has been displayed longer than the minimum display time δt.
When there exists an image which has been displayed longer than the minimum display time δt, the display is switched from the above image to the image whose event is newly detected. The image to be switched has already been displayed on the monitor 42 at least for the minimum display time δt which is long enough for the user of the system to confirm the image. Accordingly, the display of the image thought to be already confirmed is stopped by being switched to the image whose event is newly detected, and the display of the image which newly requires confirmation starts so that the image of the point which newly requires the confirmation is displayed on the monitor 42.
When there does not exist an image which has been displayed on the monitor 42 longer than the minimum display time δt, the minimum display time δt for each of the images being currently displayed has to be ensured before the image whose event is newly detected is displayed. Accordingly, the images currently displayed continues to be displayed on the monitor 42 as they are, and the image whose event is newly detected is recorded from the time of the detection of the event. When the minimum display time δt of one of the images currently displayed on the monitor 42 has elapsed, the display is switched from the above image to the recorded image. The display of the image whose minimum display time δt has elapsed and whose confirmation by the user is thought to be completed is stopped, and the display of the recorded image from the detection of the event regarding the event which newly requires the confirmation is stared so that the image from the time from which the confirmation started to be required is displayed on the monitor 42, regarding the point requiring the confirmation.
Further, in the above embodiment, the case that images in the plurality of the monitored points are simultaneously displayed on the monitor 42 by the divided display is explained. However, the present invention is not limited to the above embodiment. For example, a configuration where an image in only one point among the plurality of the monitored points is displayed on the monitor 42 is also possible, and the above method of displaying an image is executed.
In the above embodiment, the suitable images i.e. images which have to be displayed are determined and displayed on the monitor 42 which can display the plurality of images by the divided display, by referring to the management table storing the information regarding the images from the plurality of the monitored points 2. Both of the plurality of the monitored points 2 and the windows on the divided screen of the monitor 42 weight equally. However, actually, there is the case or the like that a point which has to be monitored with a greater importance is included in the plurality of the monitored points 2 when a remote monitoring is conducted by using the image displaying system 1. In such a case, a particular monitored point which has to be monitored with a greater importance (referred to as a particular point, hereinafter) can be processed with a greater importance than the other monitored points. Hereinafter, an embodiment of the case of the particular point with a greater importance is explained.
In this case, different minimum display times are set between the particular points and the other points, for example. The minimum display time δtp for the particular points is set as a longer time than the minimum display time δto for the other points.
In the example of
In addition, concrete values are stored as the minimum display times, in the example of
Further, as another embodiment, a particular number of particular areas out of the areas made by the divided display of the monitor 42 are assigned to images for the particular points in advance. For example, in the case that the screen of the monitor is divided into nine windows as shown in
When the event is detected, the corresponding display area information is read from the management table of
Alternatively, it is also possible that the management tables are configured for each of the display areas, and when a process is executed on a sequence of
For example, it is assumed that there are one hundred monitored points. Ten points with high frequencies of event detection among the one hundred points are specified as the particular points. In this case, four windows of the nine windows displayed by the divided display are assigned to show images of the ten particular points, and the remaining five windows of the windows made by the divided display are assigned to the images of the remaining ninety monitored points. The area for displaying the images of the particular points on the monitor 42 is indicated to the user beforehand so that the user can confirm the event more easily.
Number | Date | Country | Kind |
---|---|---|---|
2005-022636 | Jan 2005 | JP | national |
Number | Date | Country |
---|---|---|
S52-013721 | Feb 1977 | JP |
2000-339923 | Dec 2000 | JP |
2001-034250 | Feb 2001 | JP |
2001-231028 | Aug 2001 | JP |
2003-9142 | Jan 2003 | JP |
Number | Date | Country | |
---|---|---|---|
20060170959 A1 | Aug 2006 | US |