1. Field of the Invention
The subject invention relates to analysis of business processes using video cameras.
2. Related Art
Security and surveillance video cameras are well known in the art. It is also known in the art to use motion detection to activate the cameras, so that video capturing is performed only when a motion is detected in the field of view of the camera. As is known, such systems are used for security purposes, especially in places such as banks, jewelry and department stores, office buildings, etc.
Another relevant art is that of business process analysis and development. That is, occasionally in the prior art there is a need to analyze and perhaps improve on a certain business process. A business process is a set of logically related business activities that can be integrated to deliver value (products, services, etc.) to the customer. To analyze the tactical perspectives of a business process, investigators seek to understand the activities that support the process, and output a streamlined comprehensive model of how a business delivers value to the customer. The final product of such a project may comprise a set of processes and activities that take place within the organization, a text description of each process and activity, workflow diagrams, listings of inputs and outputs for each process, and key performance indicators for each process. The text description may contain detailed information about each process' purpose, triggers, timing, duration, resource requirements, etc.
The traditional manner of performing such a project is labor intensive and requires interviewing the persons involved in the business process, observing the personnel as they perform their business tasks, etc. As can be understood, such a project is highly time consuming, and much of the time can be spent while contributing little to the understanding of the business process. To illustrate, assuming that the activity investigated is the opening of a new bank account—a process that may take 10 minutes to complete. However, the investigator may have to wait a long time until a customer comes into the bank to open a new account. This waiting period does not contribute to the investigator's understanding of the process. Additionally, the presence of the investigator observing the process may cause the workers to deviate from their normal procedures, e.g., to demonstrate efficiency that normally is not utilized. Accordingly, there is a need in the art to provide a method that would enable business process investigation in an unobtrusive manner and which reduces the time required for the investigation.
According to various embodiment of the invention, video recording technology is utilized to enable business process investigation in an unobtrusive manner and which reduce the time required for the investigation.
According to various embodiment of the invention, video cameras are placed in a manner that the field of view covers the area subjected to the business process. The cameras are then operated, either in a continuous manner or during trigger of motion detection. The video recording is then analyzed to obtain meaningful information about the business process investigated. According to various embodiments, data relating to each transaction is recorded, such as, for example, the transaction's time, duration, spatial position, etc. According to other embodiments, statistical methods are applied to the data of the transaction to provide, e.g., clustering of transactions, frequency of occurrence, etc. Additionally, by applying statistical methods, outliers can be identified, such as transactions taking an abnormally long period, transactions that occur rarely or abnormally frequently, etc.
According to yet other features of the invention, screen trackers are provided. The screen trackers follow a motion detected in the field of view and, consequently, depict the motion of each moving object in the process. These motions can be plotted and analyzed. Statistical methods can be applied to the collection of motions to provide analytical information regarding the processes analyzed. According to some embodiments, the tracker is activated only when the motion is determined to be of an object beyond a threshold size and/or velocity. According to yet other embodiments, representation of the surveillance area is provided on a monitor, and a graphical representation identifies the field of view of each monitoring camera. Consequently, the screen can be set to show the entire monitored area, and the coverage of each surveillance camera overlaid on the screen.
According to further aspect of the invention, a method for analyzing process flow is provided, the process comprising determining physical areas affected by the process flow; generating a video recording using least one video camera having a field of view covering the physical area; designating at least one region of interest (ROI) in the field of view of the video recording; determining a background image in the ROI; and segmenting the video recording into process segment sessions by detecting motion in the ROI, each of the segment beginning upon detection of motion and ending upon cessation of motion.
According to yet another aspect of the invention, a method for detecting a motion in a video stream is provided, the method comprising obtaining a video stream; applying sum of absolute difference (SAD) analyses to the video stream to obtain SAD results; applying Lucas-Kanade Optical Flow (LKF) analyses to the video stream to obtain LKF results; applying Normalized Correlation (NC) analyses to the video stream to obtain NC results; and, combining the SAD results, the LKF results, and the NC results to obtain motion detection. According to another aspect, the method further comprises applying a supervised learning of a binary classifier to the SAD results, the LKF results, and the NC results.
Other aspects and features of the invention would be apparent from the detailed description, which is made with reference to the following drawings. It should be appreciated that the detailed description and the drawings provide various non-limiting examples of various embodiments of the invention, which is defined by the appended claims.
To perform the study, according to this embodiment of the invention, various cameras, 150A-150D are located in various locations and each cover a defined field of view. While not shown, additional coverage can be obtain by using ceiling cameras that are aimed down to cover a floor area as a filed of view. For each camera, a region of interest (ROI) within the field of view is defined. For best results, the ROI should be chosen so that no dynamic background appears within the ROI. The background image is determined for each ROI. Then, various known methods can be used to detect motion in comparison to the background image, such as, e.g., sum of absolute difference (SAD), Lucas-Kanade Optical Flow (LKF), normalized correlation (NC), etc. That is, the motion in the ROI is detected by detecting difference in the current frame and the background frame. The motion can be tracked so as to plot the trajectory of the motion. Using the motion detection, the video can be segmented into sessions of detected motions. An index of these sessions can be generated to assist the investigator in navigating the sessions. Also, a timeline can be provided, e.g., in a graphical form on the monitor screen, to assist the investigator in navigating the sessions. One surveillance tracking algorithm that can be adapted to be used in this invention is the Reading People Tracker, which was developed by Nils T. Siebel at the University of Reading in the United Kingdom. Full description of this algorithm can be found on the university's website.
According to one embodiment, the comparison to the background frame to detection of motion is done in the red-green-blue (RGB) color space, while according to another it is performed in the hue-saturation-intensity (HIS) space. According to one embodiment, the SAD method is applied in the hue channel only so as to reduce induced noise. According to yet another embodiment, the method is modified so that a weighted sum of the difference in the hue channel is calculated. According to one embodiment the weight is correlated to the saturation value of the current pixel in the current image.
According to yet another embodiment, the noise is canceled by normalizing the signal in relation to the variation in the intensity channel. The normalized correlation (NC) method can be used for this purpose.
The methods and systems described herein were tested at two locations and various business methods were studied using the video captured in these two locations. For example,
A second measure is the length of customer transaction.
Various tasks can also be analyzed for determining employee distribution. For example,
The inventive method is also used to study repeat and rework issues. That is, by analyzing the video streams, it is possible to note transactions that take repeat actions to complete. Such processes can be potentially improved by consolidating actions so as to avoid repetition of actions. Similarly, inefficiency and quality improvements can be studied by analyzing processes that led to repeat reworks to correct previous errors.
Thus, while only certain embodiments of the invention have been specifically described herein, it will be apparent that numerous modifications may be made thereto without departing from the spirit and scope of the invention. Further, certain terms have been used interchangeably merely to enhance the readability of the specification and claims. It should be noted that this is not intended to lessen the generality of the terms used and they should not be construed to restrict the scope of the claims to the embodiments described therein.