The present invention relates to a cell image processing apparatus, a cell image processing method, and a computer program product, for processing a cell image obtained by imaging a specimen smeared on a slide glass.
Conventionally, for example, in U.S. Pat. No. 4,761,075, there is disclosed a cell image classifying apparatus which magnifies and images a stained blood smeared on a slide glass by using a microscope and analyzes the obtained image so as to carry out classification and counting of the blood cells.
In U.S. Pat. No. 4,761,075, there is disclosed a cell classifying apparatus which images a normally stained specimen (May Giemsa stain), classifies the white blood cells and the red blood cells from the obtained image, counts reticulocytes from an image obtained by imaging a supravital stained specimen, and detects abnormal white blood cells from an image obtained by imaging a peroxidase stained specimen. When data of all stained specimen is in a normal range, the cell classifying apparatus classifies this specimen into a normal specimen group. When any of the data of the all stained specimen is not in the normal range, the cell classifying apparatus determines whether or not there is a need to carry out a detailed analysis. In addition, the cell classifying apparatus implements an automatic detailed reexamination for increasing the analytical precision further more on a quasi-positive specimen difficult to determine whether it is normal or abnormal.
In the cell image classifying apparatus as described above, when the stain has not been normally carried out on the blood smeared on the slide glass or when an imaging unit including a light source and a camera is something wrong, it is difficult or impossible to carry out the classification, the count and the like of the blood cells with good accuracy. For this reason, in order to normally carry out the classification and count of the blood cells all the time, there is a need to keep the stained state of the smeared blood and the state of the imaging unit in a normal state. However, in the cell classifying apparatus disclosed in U.S. Pat. No. 4,761,075, there are not provided functions for a user to confirm the stained state of the smeared blood and the state of the imaging unit. Therefore, for example, the user compares the classification/count result of the blood cells obtained by a cell classifying apparatus with the classification/count result of the blood cells obtained by a visual check by the user using a microscope so as to confirm the stained state of the smeared blood and the state of the imaging unit. Such a confirmation task makes the burden too heavy for the user, and deviations in results may occur according to the skill and experience of the user carrying out the visual check.
The scope of the present invention is defined solely by the appended claims, and is not affected to any degree by the statements within this summary.
A first aspect of the present invention is a cell image processing apparatus comprising:
an imaging unit for imaging a specimen smeared on a slide glass, and obtaining a cell image of a cell included in the smeared specimen;
a display; and
a processing unit being configured to perform operations comprising:
A second aspect of the present invention is a cell image processing method comprising:
imaging a plurality of specimens each smeared on a slide glass, and obtaining a plurality of cell images, each of the plurality of cell images respectively relating to a cell included in each of the smeared specimens;
obtaining a plurality of characteristic values based on the plurality of cell images, each of the plurality of characteristic values respectively representing a predetermined characteristic of each of the plurality of cell images; and
displaying a screen showing a fluctuation in the characteristic values on a display.
A third aspect of the present invention is a computer program product comprising:
a computer readable medium; and
instructions, on the computer readable medium, adapted to enable a general purpose computer to perform operations comprising:
obtaining a plurality of cell images, each of the plurality of cell images respectively relating to a cell included in each of specimens each smeared on a slide glass;
obtaining a plurality of characteristic values based on the plurality of cell images, each of the plurality of characteristic values respectively representing a predetermined characteristic of each of the plurality of cell images; and
controlling a display so as to display a screen which shows a fluctuation in the characteristic values.
Hereinafter, exemplary embodiments according to the invention will be described with reference to the drawings.
A specimen processing system according to this embodiment is provided, in which a blood smear slide is prepared from a blood specimen; the stained blood smear slide is magnified and imaged by a microscope; by processing the obtained blood cell image, a characteristic value indicating the characteristic of the blood cell image is calculated; and a fluctuation in the characteristic value is displayed on a screen.
[Configuration of Specimen Processing System]
<Configuration of Smear Slide Preparing Apparatus>
The smear slide preparing apparatus 2 (for example, a smear slide preparing apparatus SP-1000i made by Sysmex Corporation) aspirates a blood specimen and drops the blood specimen onto the a slide glass 100 on which the blood specimen is spread thin and dried, and supplies a stain solution to the slide glass 100 to stain the blood on the slide glass 100. In this manner, a smear slide is prepared. Further, the smear slide preparing apparatus 2 can process and prepare 120 smear slides per 1 hour.
In addition, as shown in
The specimen dispensing section 21 includes an aspiration tube (not shown). The aspiration tube is stuck into the rubber stopper 151a of the test tube 151 in the specimen rack 150 transported by the specimen transport apparatus 5 to aspirate the blood specimen from the test tube 151. The specimen dispensing section 21 is configured to drop the aspirated blood specimen onto a slide glass 100. The smearing section 22 is configured to smear and dry the blood specimen dropped onto the slide glass 100 and perform printing on the slide glass 100.
The slide glass transport section 23 is provided to accommodate the slide glass 100 on which the blood specimen is smeared by the smearing section 22 in a cassette (not shown) and to transport the cassette. The staining section 24 supplies a stain solution to the slide glass 100 in the cassette transported to a staining position by the slide glass transport section 23. The control section 25 controls the specimen dispensing section 21, the smearing section 22, the slide glass transport section 23 and the staining section 24 so as to perform the above smear slide preparing operation. The smear slide prepared in this manner is delivered to a specimen transport apparatus 6.
<Configuration of Specimen Transport Apparatus>
As shown in
<Configuration of Specimen Imaging Apparatus>
The specimen imaging apparatus 3 includes a microscope unit 3a for imaging a magnified image of a blood smear slide which is focused by auto-focusing, an image processing unit 3b for processing a captured image to classify white blood cells in blood and performing a counting operation for each classification of the white blood cell, and a blood cell image display unit 3c which is connected to the image processing unit 3b and displays the captured image, analysis results and the like. The image processing unit 3b and the blood cell image display unit 3c may not be provided independently of each other, but integrally with each other. The above-described specimen transport apparatus 6 is disposed near the specimen imaging apparatus 3 and a blood smear slide prepared by the smear slide preparing apparatus 2 is automatically supplied to the microscope unit 3a by the specimen transport apparatus 6.
<Configuration of Microscope Unit 3a>
A plurality of the slide glasses 100 are stacked and accommodated in a slide cassette 35. The slide cassette 35 is transported by a transporting section (not shown) which is controlled by a cassette transport driving circuit 36 so as to be driven. The XY stage 31 is provided with a chuck section 37 (see
A lamp 38 as a light source is disposed below the slide glass 100, and light from the lamp 38 passes through the blood on the slide glass 100, and via half mirrors 39 and an interference filter 310 arranged on an optical path, enters a line sensor 311 for auto-focusing in which plural pixels are arranged in a line, a sensor 312 for white blood cell (WBC) detection in which plural pixels are arranged in a line and a CCD camera 313. A white blood cell detecting section 314 composed of an FPGA, an ASIC or the like is connected to the sensor 312 for white blood cell detection and is set up to provide the output signal of the sensor 312 to the white blood cell detecting section 314. A focus calculating section 315 composed of an FPGA, an ASIC or the like is connected to the sensor 311 for auto-focusing and is set up to provide the output signal of the sensor 311 to the focus calculating section 315. White blood cell detection is performed by the white blood cell detecting section 314 on the basis of an output signal in accordance with the incident light of the sensor 312. Information to be used for the auto-focus operation is calculated by the focus calculating section 315 on the basis of an output signal in accordance with the incident light of the sensor 311. The auto-focus operation is performed on the basis of this information.
In addition, the microscope unit 3a includes a control section 316 and communication interfaces 317 and 318. The control section 316 includes a CPU and a memory, and is connected to the XY stage driving circuit 33, the objective lens driving circuit 34, the cassette transport driving circuit 36, the white blood cell detecting section 314, the focus calculating section 315 and the communication interfaces 317 and 318 so as to communicate therewith. When the control section 316 executes a control program stored in the memory, the above-described mechanisms are controlled.
The communication interface 317 is an Ethernet (registered trade name) interface. The communication interface 317 is connected to the image processing unit 3b via a communication cable so as to perform data communication therewith. In addition, the communication interface 318 is connected to the CCD camera 313 via an A/D converter 313a and is connected to the image processing unit 3b via a communication cable. An image signal (analog signal) output from the CCD camera 313 is ND converted by the A/D converter 313a and image data (digital data) output from the A/D converter 313a is provided to the communication interface 318 to be transmitted to the image processing unit 3b.
Moreover, the microscope unit 3a includes a two-dimensional bar-code reader 319. As described above, a two-dimensional bar-code indicating a specimen ID is printed on a frosted section 100a of the slide glass 100 and the two-dimensional bar-code of the slide glass 100 introduced into the microscope unit 3a is read by the two-dimensional bar-code reader 319. In this manner, the read specimen ID is provided to the control section 316.
<Configuration of Image Processing Unit 3b>
Next, the configuration of the image processing unit 3b will be described.
The CPU 321a can execute a computer program loaded to the RAM 321c. The CPU 321a executes an image processing program 324a to be described later, so that the computer 320 functions as the image processing unit 3b.
The ROM 321b is composed of a mask ROM, a PROM, an EPROM, an EEPROM or the like, and the computer program which is executed by the CPU 321a and data used or the like for the computer program are recorded therein.
The RAM 321c is composed of a SRAM, a DRAM or the like. The RAM 321c is used to read the image processing program 324a recorded in the hard disk 321d. Moreover, the RAM is used as an operating area of the CPU 321a when the CPU 321a executes a computer program.
In the hard disk 321d, various computer programs for execution by the CPU 321a, such as an operating system and an application program, and data which are used to execute the computer programs are installed. The image processing program 324a to be described later is also installed in the hard disk 321d.
The hard disk 321d is provided with a blood cell image folder 325 for storing blood cell images. In the blood cell image folder 325, a folder is provided for each specimen and blood cell images obtained as described later are stored in the folder. The folder provided for each specimen has a folder name including a specimen ID, and the folder corresponding to a desired specimen ID can be specified by the specimen ID. The blood cell image folder 325 is set up so as to share data with the blood cell image display unit 3c and the blood cell image display unit 3c can access files stored in the blood cell image folder 325.
Further, the hard disk 321d is provided with a specimen database DB1 for storing information relating to specimens, a blood cell database DB2 for storing results of the classification of white blood cells by image processing, and a characteristic value history database DB3 for storing an average nucleus G-value which is a characteristic value relating to the staining and an average background G-value which is a characteristic value relating to the microscope unit 3a.
The reading device 321e is composed of a flexible disk drive, a CD-ROM drive, a DVD-ROM drive or the like and can read the computer program or data recorded in a portable recording medium 324. In the portable recording medium 324, the image processing program 324a is stored which prompts the computer to function as the image processing unit 3b. The computer 320 can read the image processing program 324a from the portable recording medium 324 and install the image processing program 324a in the hard disk 321d.
The image processing program 324a is not only provided by the portable recording medium 324 but can be also provided from an external device, which is connected to the computer 320 by an electric communication line (which may be wired or wireless) to communicate therewith via the electric communication line. For example, the image processing program 324a may be stored in the hard disk of a server computer on the internet and the computer 320 may access the server computer to download the computer program and install the computer program in the hard disk 321d.
Furthermore, in the hard disk 321d, for example, a multitasking operating system is installed such as Windows (registered trade name) which is made and distributed by Microsoft Corporation in America. In the following description, the image processing program 324a according to this embodiment operates on the above operating system.
The I/O interface 321f is composed of, for example, a serial interface such as USB, IEEE1394 or RS-232C, a parallel interface such as SCSI, IDE or IEEE1284, and an analog interface including a D/A converter, an ND converter and the like. The input section 323 is composed of a keyboard and a mouse and is connected to the I/O interface 321f, and the user uses the input section 323 to input data to the computer 320. In addition, the CCD camera 313 provided on the microscope unit 3a is connected to the I/O interface 321f, so that the images obtained by the CCD camera 313 can be captured.
The communication interfaces 321g and 321h are Ethernet (registered trade name) interfaces. The communication interface 321g is connected to the blood cell image display unit 3c via a LAN. The computer 320 can perform transmission and reception of data with the blood cell image display unit 3c, which is connected to the LAN by using a predetermined communication protocol, and a host computer 7 by the communication interface 321g. In addition, the communication interface 321h is connected to the communication interface 317 of the microscope unit 3a via a communication cable so as to perform data communication therewith.
The communication interface 321i is connected to the communication interface 318 of the microscope unit 3a via a communication cable to perform data communication therewith. Accordingly, images captured by the CCD camera 313 are received by the communication interface 321i.
The image output interface 321j is connected to the image display section 322 composed of an LCD, a CRT or the like to output a picture signal corresponding to the image data provided from the CPU 321a to the image display section 322. The image display section 322 displays an image (screen) in accordance with an input picture signal.
<Configuration of Blood Cell Image Display Unit 3c>
The blood cell image display unit 3c is configured from a computer. The blood cell image display unit 3c is connected to the image processing unit 3b via a LAN to read and display blood cell images in the blood cell image folder 325 provided in the hard disk 321d of the image processing unit 3b.
In the hard disk 331d, various computer programs for execution by the CPU 331a, such as an operating system and an application program, and data which are used to execute the computer programs are installed. A blood cell image display program 334a to be described later is also installed in the hard disk 331d.
The reading device 331e is composed of a flexible disk drive, a CD-ROM drive, a DVD-ROM drive or the like and can read the computer program or data recorded in a portable recording medium 334. In the portable recording medium 334, the blood cell image display program 334a is stored which prompts the computer to function as the blood cell image display unit 3c. The computer 330 can read the blood cell image display program 334a from the portable recording medium 334 and install the blood cell image display program 334a in the hard disk 331d.
The I/O interface 331f is composed of, for example, a serial interface such as USB, IEEE1394, SAS, SATA or RS-232C, a parallel interface such as SCSI, IDE or IEEE1284, and an analog interface including a D/A converter, an ND converter and the like. The input section 333 composed of a keyboard and a mouse is connected to the I/O interface 331f and the user can use the input section 333 to input data to the computer 330.
The communication interface 331g is an Ethernet (registered trade name) interface. The communication interface 331g is connected to the image processing unit 3b via a LAN. Via the communication interface 331g, the computer 330 can perform transmission and reception of data with the image processing unit 3b connected to the LAN by using a predetermined communication protocol.
Since the other configurations of the blood cell image display unit 3c are the same as the configurations of the above-described image processing unit 3b, the description thereof will be omitted.
<Configuration of Blood Cell Analyzing Apparatus>
The blood cell analyzing apparatus 4 as an optical flow cytometry type multiple blood cell analyzing apparatus obtains the side-scattered light intensity, the fluorescent intensity and the like of blood cells included in a blood specimen, classifies the blood cells included in the specimen on the basis of the above intensities, and counts the number of blood cells for each type. Moreover, the blood cell analyzing apparatus 4 creates a scattergram in which the classified blood cells are color-coded for each type, and displays the scattergram. The blood cell analyzing apparatus 4 includes a measuring unit 41 for measuring a blood specimen and an information processing unit 42 for processing measuring data output from the measuring unit 41 and displaying an analysis result of the blood specimen.
The specimen dispensing section 411 includes an aspiration tube (not shown) and the aspiration tube is stuck into the cap section 151a of the test tube 151 in the specimen rack 150 which is transported on a measuring line of the specimen transport apparatus 5 to aspirate a blood specimen from the test tube 151. The measuring specimen preparing section 412 includes a mixing container (not shown) to mix and stir the blood specimen dispensed by the specimen dispensing section 411, a reagent and a diluent and prepare a measuring specimen.
The optical detecting section 413 includes a flow cell (not shown) to form a narrow flow of the measuring specimen by supplying the measuring specimen to the flow cell and exposes the measuring specimen to light to obtain a side-scattered light signal, a forward-scattered light signal and a fluorescent signal by an optical sensor. These signals are output to the signal processing circuit 414. The signal processing circuit 414 processes an electric signal output from the optical detecting section 413. The signal processing circuit 414 obtains parameters such as peaks and pulse widths of the side-scattered light signal, the forward-scattered light signal and the fluorescent signal.
The control section 415 includes a CPU and a memory, and is connected to the specimen transport apparatus 5 so as to perform data communication therewith. The control section 415 controls the specimen dispensing section 411, the measuring specimen preparing section 412, the optical detecting section 413 and the signal processing circuit 414 in accordance with an analysis item provided from the specimen transport apparatus 5, and performs a measurement operation corresponding to the analysis item. In addition, the control section is configured to transmit measuring data including the parameters obtained by the signal processing circuit 414 to the information processing unit 42.
Next, the configuration of the information processing unit 42 will be described. The information processing unit 42 is composed of a computer.
In the hard disk 421d, various computer programs for execution by the CPU 421a, such as an operating system and an application program, and data which are used to execute the computer programs are installed. In addition, an analyzing program 424a which analyzes the measurement data output from the measuring unit 41 to obtain an analysis result of the specimen is also installed in the hard disk 421d.
The communication interface 421g is an Ethernet (registered trade name) interface. The communication interface 421g is connected to the measuring unit 41 via a LAN. The computer 42a can perform transmission and reception of data with the measuring unit 41, which is connected to the LAN using a predetermined communication protocol, by the communication interface 421g. In addition, the communication interface 421g is connected to the host computer 7 via the LAN so as to perform data communication therewith.
Since the other configurations of the information processing unit 42 are the same as the configurations of the above-described image processing unit 3b, the description thereof will be omitted.
[Operation of Specimen Processing System 1]
Next, the operation of the specimen processing system 1 according to this embodiment will be described.
<Operation of Blood Cell Analyzing Apparatus 4>
First, the operation of the blood cell analyzing apparatus 4 will be described.
In Step S102, the CPU 421a transmits order request data including the specimen ID included in the aspiration instruction data to the host computer 7 via the communication interface 421g (Step S102) to inquire about a measuring order from the host computer 7. Then, the CPU 421a stands by to receive the measuring order (No in Step S103). When the measuring order transmitted from the host computer 7 is received by the communication interface 421g of the information processing unit 42 (Yes in Step S103), the CPU stores the received measuring order in the hard disk 421d (Step S104).
Next, the CPU 421a transmits measurement start request data including the analysis item included in the stored measuring order to the measuring unit 41 (Step S105). The control section 415 of the measuring unit 41 receives the measurement start request data, and thus the blood specimen is measured with respect to the analysis item included in the measurement start request data. After the measurement, the control section 415 of the measuring unit 41 transmits the measuring data (raw data) reflecting the side-scattered light intensity and the fluorescent intensity obtained by the measurement to the information processing unit 42. The CPU 421a stands by to receive the measuring data (No in Step S106). When the measuring data is received by the communication interface 421g (Yes in Step S106), the CPU performs a process to analyze the measuring data (Step S107), classifies the blood cells included in the specimen and counts the number of blood cells for each type to create a scattergram in which the classified blood cells in this way are color-coded for each type. In the measuring data analyzing process, abnormalities, such as an abnormality of a white blood cell scattergram (scattergram for classifying white blood cells for each type), an abnormality of an NRBC scattergram (scattergram for detecting a nucleated red blood cell), a neutropenia abnormality indicating that the number of neutrophils falls below a predetermined normal range, a neutrophilia abnormality indicating that the number of neutrophils is more than the normal range, a monocytosis abnormality indicating that the number of monocytes is more than a predetermined normal range, an eosinophilia abnormality indicating that the number of eosinophils is more than a predetermined normal range, a basophilic leukocytosis abnormality indicating that the number of basophils is more than a predetermined normal range, a leucopenia abnormality indicating that the total number of white blood cells falls below a predetermined normal range, a leukocytosis abnormality indicating that the total number of white blood cells is more than a predetermined normal range, and an erythroblastosis abnormality indicating that the number of erythroblasts is more than a predetermined normal range, are detected, and an abnormality flag indicating that an abnormality is detected is added to the analysis result data generated by the analyzing process. The analysis result data generated by the measuring data analyzing process is stored together with the patient information and the like included in the measuring order in the hard disk 421d (Step S108) and is transmitted to the host computer 7 (Step S109). The host computer 7 integrates the analysis result data and the above-described measuring order and stores the result thereof in the hard disk. After the process of Step S109, the CPU 421a completes the process.
<Blood Cell Image Registration Operation>
Next, a blood cell image registration operation will be described in which the smear slide preparing apparatus 2 prepares a blood smear slide, and the specimen imaging apparatus 3 images a blood cell in the blood smear slide, and the blood cell image is stored. As described above, the specimen rack 150 accommodating the specimen which is supplied to the blood cell analyzing apparatus 4 for analysis is transported to the smear slide preparing apparatus 2 by the specimen transport apparatus 5. The smear slide preparing apparatus 2 aspirates the specimen accommodated in the test tube 151 which is transported as described above, and drops and spreads the specimen on the slide glass 100. By dipping the slide glass 100 in a stain solution, the blood smear slide is prepared. Further, the stain which is implemented on the specimen by the smear slide preparing apparatus 2 includes May Grunwald Giemsa stain (May Giemsa stain), Wright Giemsa stain, or Wright stain. The specimen rack 150 accommodating the test tube 151 in which the specimen is aspirated by the smear slide preparing apparatus 2 is transported to the downstream by the specimen transport apparatus 5. The test tube 151 is held in a cool box by a user.
The blood smear slide (slide glass 100) prepared as described above is automatically supplied to the microscope unit 3a from the smear slide preparing apparatus 2 by the specimen transport apparatus 6.
In Step S202, the control section 316 transports the slide cassette 35 accommodating the received slide glass 100 to a predetermined bar-code reading position and the specimen bar-code is read by the two-dimensional bar-code reader 319 (Step S202). Next, the control section 316 transmits the specimen ID obtained in Step S202 to the image processing unit 3b via the communication interface 317 (Step S203).
The specimen ID transmitted from the microscope unit 3a is received by the communication interface 321h of the image processing unit 3b (Step S221 of
In Step S222, the CPU 321a transmits order request data including the received specimen ID to the host computer via the communication interface 321g (Step S222). The order transmitted from the host computer includes the specimen ID, the patient's name, the patient's sex, hospital ward information, comments, analysis results of the blood cell analyzing apparatus 4 (numerical data such as the number of white blood cells and the number of red blood cells), various pieces of abnormality information detected by the blood cell analyzing apparatus 4 (white blood cell scattergram abnormality flag, NRBC scattergram abnormality flag, neutropenia abnormality flag, neutrophilia abnormality flag, monocytosis abnormality flag, eosinophilia abnormality flag, basophilic abnormality flag, leucopenia abnormality flag, leukocytosis abnormality flag, erythroblastic abnormality flag, etc.), and the data of the number N of white blood cells counted. The CPU 321a stands by to receive the order (No in Step S223). When the order is received (Yes in Step S223), the CPU 321a transmits measurement start instruction data including the count number N of white blood cells which is included in the order, to the microscope unit 3a (Step S224) by the communication interface 321h, and sets the variable indicating the number of the analyzed blood cell images to 1 (Step S225).
Herein, the microscope unit 3a stands by to receive the measurement start instruction data (No in Step S204 of
Next, the white blood cells in the blood applied to the slide glass 100 are detected (Step S207). The detection is carried out using the sensor 312. The sensor 312 is a line sensor and has a field of view of about 400 μm.
Red blood cells do not absorb much of the red color component of light, but the nucleus of a white blood cell does absorb a large amount of the red color component of light. Accordingly, by detecting the red color component, the white blood cells and the red blood cells can be easily distinguished.
Next, the control section 316 performs an auto-focus operation (Step S208). As shown in
The line sensor 311a which is one of the two line sensors 311a and 311b for auto-focusing is disposed in front of (close to the objective lens on the optical path) a focus position (a position which is in focus), and the other line sensor 311b is disposed behind (far from the objective lens on the optical path) the focus position. In addition, the position of the objective lens is adjusted on the basis of a value which is obtained by the integral of the difference between the output signals of the two line sensors, so that the focus of the objective lens is on the specimen on the slide glass.
Next, the control section 316 instructs the communication interface 318 to capture and transmit the image of the CCD camera 313. Thus, the image of the white blood cell detected in Step S207 is captured (Step S209) and the blood cell image is transmitted to the image processing unit 3b (Step S210). After that, the control section 316 determines whether the required counted number of the white blood cells has been satisfied, that is, whether j is equal to or greater than N (Step S211). When j is less than N (No in Step S211), the control section increments j by 1 (Step S212) and returns the process to Step S207 to repeat the detection of the white blood cells. On the other hand, when j is equal to or greater than N in Step S211 (Yes in Step S211), the control section 316 completes the process.
After Step S225 described above, the CPU 321a stands by to receive the blood cell image (NO in Step S226 of
Next, the CPU 321a specifies areas of cytoplasm and a nucleus in the corrected blood cell image (Step S230).
Next, the CPU 321a calculates various characteristic parameters of the white blood cell on the basis of the corrected blood cell image (Step S231). The characteristic parameters include the area, the number of nuclei, irregularity, the tone and concentration (unevenness) of a white blood cell's nucleus, the area, tone and concentration (unevenness) of a white blood cell's cytoplasm, and the area ratio and the concentration ratio between the nucleus and the cytoplasm, which can be obtained on the basis of color signals (G, B, R) of the image.
Next, using the obtained characteristic parameters, the CPU 321a identifies the type of the white blood cell (Step S232). Specifically, for example, the CPU 321a sequentially compares several characteristic parameters of the white blood cell with judgment criteria values which are determined for various parameter values in advance so as to gradually narrow down the type of the white blood cell. In this manner, the imaged white blood cell is classified as a mature white blood cell such as a lymphocyte, a monocyte, an eosinophil, a basophil or a neutrophil (bacillary, lobulated), as an immature white blood cell such as a blast cell, a young granulocyte or an atypical lymphocyte, or as an erythroblast.
As described above, the specimen imaging apparatus 3 according to this embodiment carries out the white blood cell classification using color information of the blood cell image. Here, when a stained state of the blood smear slide is changed, for example, when the stain solution of the smear slide preparing apparatus 2 is degraded, the color of the white blood cell image is changed. In addition, when an imaging state is changed, for example, when the lamp light intensity of the microscope unit 3a is decreased, the color of the uncorrected blood cell image is changed totally. Therefore, when the stained state of the blood smear slide and the state of the imaging unit of the microscope unit 3a are changed, it is difficult to carry out the blood cell classification with high accuracy, so that the reliability of the classification result of the specimen imaging apparatus 3 is degraded.
The description will be made with reference to the drawing.
In this embodiment, in order to provide information to a user to confirm the stain state and the state of the imaging unit as described above, the image processing unit 3b performs the following process. First, the CPU 321a obtains the G value (brightness value of the green component) of each pixel in the background area in the uncorrected blood cell image, that is, the area other than the blood cell area among the uncorrected blood cell images, calculates an average value of the obtained G values, and stores the obtained value (hereinafter, referred to as “background G-value”) in the RAM 321c (Step S233).
Next, the CPU 321a determines whether or not the white blood cell relating to the blood cell image is classified into the neutrophil as a result of Step S232 (Step S234). When the white blood cell is classified into the neutrophil (YES in Step S234), the CPU 321a obtains the G values of the nucleus pixels in the nucleus area of the white blood cell in the corrected white blood cell image, calculates an average value of the obtained G values, and stores the obtained value (hereinafter, referred to as “nucleus G-value”) in the RAM 321c (Step S235). Thereafter, the CPU 321a makes the procedure proceed to Step S236.
On the other hand, in Step S234, when the white blood cell relating to the blood cell image is not classified into the neutrophil (NO in Step S234), the CPU 321a moves the process to Step S236.
In Step S236, the CPU 321a determines whether the required counted number of the white blood cells has been satisfied, that is, whether i is equal to or greater than N (Step S236). When i is less than N (No in Step S236), the CPU 321a increments i by 1 (Step S237), returns the process to Step S226, and stands by to receive another blood cell image.
On the other hand, when i is equal to or greater than N in Step S236 (Yes in Step S236), the CPU 321a calculates a first average background G-value BA which is an average value of the background G-value stored in the RAM 321c (Step S238). In addition, the CPU 321a calculates a first average nucleus G-value NA which is an average value of the nucleus G-value stored in the RAM 321c (Step S239).
Next, the CPU 321a determines whether or not the first average background G-value BA is greater than a predetermined reference value TB (Step S240). When the first average background G-value BA is equal to or less than the reference value TB (NO in Step S240), the CPU 321a sets the lamp light intensity abnormality flag, which is provided at the RAM 321c, to 1 (Step S241). The CPU 321a displays an error screen for notifying the occurrence of the lamp light intensity abnormality on the image display section 322 (Step S242), and moves the process to Step S244.
On the other hand, when the first average background G-value BA is greater than the reference value TB (YES in Step S240), the CPU 321a sets the lamp light intensity abnormality flag to 0 (Step S243), and moves the process to Step S244.
In Step S244, the CPU 321a determines whether or not the first average nucleus G-value NA is greater than a predetermined lower limit reference value TN1 and smaller than a predetermined upper limit reference value TN2 (Step S244). When the first average nucleus G-value NA is equal to or less than the lower limit reference value TN1 or the first average nucleus G-value is equal to or more than the upper limit reference value TN2 (NO in Step S244), the CPU 321a sets the staining abnormality flag, which is provided at the RAM 321c, to 1 (Step S245). In addition, the CPU 321a displays the error screen for notifying the occurrence of the staining abnormality to the image display section 322 (Step S246), and moves the process to Step S248.
In the error screens E1 and E2 as described above, a user operates the input section 333 to select the OK button 83, and the display is completed.
On the other hand, when the first average nucleus G-value NA is greater than the lower limit reference value TN1 and smaller than the upper limit reference value TN2 (YES in Step S244), the CPU 321a sets the staining abnormality flag to 0 (Step S247), and moves the process to Step S248.
In Step S248, the CPU 321a registers the information relating to the specimen and the classification result as obtained above at the specimen database DB1 and the blood cell database DB2 of the hard disk 321d (Step S248), and completes the process. In this process, the first average nucleus G-value calculated in Step S239 is stored in the first average nucleus G-value field F18 of the specimen database DB1. The first average background G-value calculated in Step S238 is stored in the first average background G-value field F19 of the specimen database DB1.
<Blood Cell Image Display Operation>
Immediately after the initiation of the blood cell image display program 334a, a login input screen is displayed which prompts the input of a user name and a password (Step S301 in
In Step S303, the CPU 331a performs a user authentication process. When the user authentication fails (No in Step S304), the CPU 331a completes the process. When the user is successfully authenticated by using the login process (Yes in Step S304), the CPU 331a prompts the communication interface 331g to transmit the requested data of that date's measured specimen information to the image processing unit 3b (Step S305).
The requested data transmitted from the blood cell image display unit 3c is received by the communication interface 321h of the image processing unit 3b (Step S401 of
In Step S402, from the specimen database DB1, the CPU 321a obtains the specimen information measured at the date (Step S402). Next, the CPU 321a transmits the obtained specimen information to the blood cell image display unit 3c via the communication interface 321g (Step S403) and completes the process.
After transmitting the requested data of the specimen information, the CPU 331a of the blood cell image display unit 3c stands by to receive the specimen information (No in Step S306 of
In Step S502, the CPU 331a transmits blood cell image transmitting request data, including the specimen ID of the specimen for which the instruction is made, to the image processing unit 3b via the communication interface 331g (Step S502).
The request data transmitted from the blood cell image display unit 3c is received by the communication interface 321h of the image processing unit 3b (Step S601 of
In Step S602, the CPU 321a obtains classification result information from the blood cell database DB2 corresponding to the specimen ID (Step S602). The classification result information includes white blood cell IDs specifying the white blood cells, the types (monocyte, neutrophil, basophil, eosinophil, lymphocyte, etc.) as the result of the white blood cell classification, and information indicating whether or not the classification can be carried out. In addition, in the classification result information, the type information or the unclassifiable information of the white blood cells is associated with the white blood cell ID. That is, with the classification result information, the types of the white blood cells can be specified or the white blood cell can be specified as being unclassifiable or not from the white blood cell ID.
Next, the CPU 321a transmits the obtained classification result information to the blood cell image display unit 3c via the communication interface 321g (Step S603).
After transmitting the request data of the classification result information, the CPU 331a of the blood cell image display unit 3c stands by to receive the classification result information (No in Step S503 of
After transmitting the classification result information, the CPU 321a of the image processing unit 3b stands by to receive the image transmitting request data (No in Step S604 of
The CPU 331a of the blood cell image display unit 3c transmits the image transmitting request data, and then stands by to receive the blood cell image (NO in Step S506 of
<Shutdown Operation of Image Processing Unit 3b>
Next, the shutdown operation of the image processing unit 3b of the specimen imaging apparatus 3 will be described.
In Step S702, the CPU 321a displays a summary dialogue (not shown) in the image display section 322 (Step S702). In the summary dialogue, there are provided a summary button for instructing the image processing unit 3b to calculate the second average nucleus G-value and the second average background G-value which are each obtained by averaging the first average nucleus G-value and the first average background G-value, and a cancel button for performing the shutdown process without calculating the second average nucleus G-value and the second average background G-value. The summary button and the cancel button can be selected by the operation of the input section 323. When the summary button is selected in the summary dialogue (YES in Step S703), the CPU 321a moves the process to Step S704. When the cancel button is selected (NO in Step S703), the CPU 321a moves the process to Step S713.
In Step S704, the CPU 321a refers to the specimen database DB1 and the blood cell database DB2 so as to select the specimen in which the neutrophil is included in the blood cell type and the analysis result by the blood cell analyzing apparatus 4 is normal among the specimens measured at the date (Step S704). Specifically, in the process of Step S704, the specimen is selected in which the date stored in the measurement date field F15 of the specimen database DB1 is the current date, the values of the fields F12, F13, F14, . . . for storing various pieces of abnormality information detected by the blood cell analyzing apparatus 4 are “0(Normal)”, and the neutrophil (“SEG” or “BAND”) is included in the field F22 of the blood cell database DB2.
Next, the CPU 321a reads out the first average nucleus G-values and the first average background G-values of all the selected specimens from the specimen database DB1 (Step S705). The CPU 321a takes an average of all the read first average nucleus G-values and calculates the second average nucleus G-value. In addition, the CPU 321a takes an average of all the read first average background G-values and calculates the second average background G-value (Step S706).
In addition, the CPU 321a refers to the specimen database DB1 and the blood cell database DB2 so as to obtain the number of the specimens which cannot be classified among the specimens measured at the date and the classification fail rate which is a rate to the number of all the specimens measured at the date (Step S707). That is, in this process, the number SN of all the specimens of which the date stored in the measurement date field F15 of the specimen database DB1 is the current date, and the number UN of the specimens of which the value of the reconfirmation object field F23 of the blood cell database DB2 among these specimens is “1” are counted, and a percentage (classification fail rate) of the number UN of the specimens to the number SN of all the specimens is calculated.
The CPU 321a registers the date, the calculated second average nucleus G-value, the calculated second average background G-value, and the classification fail rate at the characteristic value history database DB3 (Step S708).
In addition, the CPU 321a reads the date before the present month, the second average nucleus G-value, the second average background G-value, and the classification fail rate from the characteristic value history database DB3 (Step S709). The CPU 321a prepares an accuracy management screen (Step S710), and displays the accuracy management screen on the image display section 322 (Step S711).
In the example shown in
In the example shown in
The user selects the shutdown continuation button BT in a state where the accuracy management screen CW is being displayed. Therefore, the user can issue an instruction for performing the shutdown process to the imaging processing unit 3b. The CPU 321a stands by to receive the instruction for performing the shutdown (NO in Step S712). When the CPU 321a receives the instruction for performing the shutdown process (YES in Step S712), the shutdown process is performed (Step S713). In the shutdown process, there is performed a termination process of displaying the accuracy management screen CW, a termination process of the image processing program 324a and the like. When the shutdown process is ended, the CPU 321a completes the process.
With such a configuration, when the image processing unit 3b is shut down such as at the time of terminating the operation of a day's specimen process, the accuracy management screen CW is securely displayed. Therefore, it can be prevented that the user forgets to check the stained state of the smear slide preparing apparatus 2 and the state of the imaging unit of the microscope unit 3a. In addition, the maintenance of the specimen processing system 1 is easily carried out.
In addition, the second graph GR2 showing the temporal fluctuation in the first characteristic value, and the third graph GR3 showing the temporal fluctuation in the second characteristic value are included in the accuracy management screen CW. Therefore, only by just confirming the accuracy management screen CW, the user can carry out the accuracy management of the microscope unit 3a and the smear slide preparing apparatus 2.
Further, in the above-described embodiments, the configuration has been described relating to the specimen processing system provided with the specimen imaging apparatus which images the blood smear slide so as to obtain the blood cell images, but the invention is not limited thereto. The specimen processing system provided with the specimen imaging apparatus may be configured such that tissue is gathered and sliced from a human body, attached to a slide glass, and then stained by a stain solution so as to obtain a specimen which is imaged to acquire a cell image including a cell shape.
In addition, in the above-described embodiments, the configuration has been described in which the accuracy management screen CW is displayed which includes the second graph GR2 showing the temporal fluctuation in the first characteristic value relating to the stained state of the specimen and the third graph GR3 showing the temporal fluctuation in the second characteristic value relating to the lamp state to be used for imaging are displayed, but the invention is not limited thereto. The second graph GR2 and the third graph GR3 may be displayed in separate screens. In addition, it may be configured such that the first characteristic value is calculated and displayed in the second graph GR2, but the second characteristic value is not calculated and not displayed in the third graph GR3. On the contrary, it may be configured such that the second characteristic value is calculated and displayed in the third graph GR3, but the first characteristic value is not calculated and not displayed in the second graph GR2.
In addition, in the above-described embodiments, the configuration has been described in which the staining abnormality of the specimen and the lamp light intensity abnormality to be used for imaging are detectible for each smear slide, but the invention is not limited thereto. It may be configured such that the staining abnormality of the specimen and the lamp light intensity abnormality are not detected. In addition, it may be configured such that the staining abnormality of the specimen is detectible but the lamp light intensity abnormality is not detectible. Alternatively, it may be configured such that the lamp light intensity abnormality is detectible but the staining abnormality of the specimen is not detectible.
In addition, in the above-described embodiments, the configuration has been described in which the second average nucleus G-value relating to the G value of the nucleus area of the blood cell image is used as the first characteristic value displaying the characteristic of the nucleus area of the blood cell image so as to display the second graph GR2 indicating the fluctuation in the first characteristic value, but the invention is not limited thereto. Instead of the second average nucleus G-value, it may be configured such that a value (the first average nucleus B-value or the first average nucleus R-value) obtained by averaging the B values or the R values of the nucleus area of the blood cell image for each specimen is obtained, a value (the second average nucleus B-value or the second average nucleus R-value) obtained by averaging the first average nucleus B-values or the first average nucleus R-values for the plural specimens processed in a day is calculated, and displays a graph showing the fluctuation in the first characteristic value by using the second average nucleus B-value or the second average nucleus R-value as the first characteristic value.
In addition, in the above-described embodiments, the configuration has been described in which the second average background G-value relating to the G value of the background area of the blood cell image is used as the second characteristic value displaying the characteristic of the background area of the blood cell image so as to display the third graph GR3 indicating the fluctuation in the second characteristic value, but the invention is not limited thereto. Instead of the second average background G-value, it may be configured such that a value (the first average background B-value or the first average background R-value) obtained by averaging the B values or the R values of the background area of the blood cell image for each specimen is obtained, a value (the second average background B-value or the second average background R-value) obtained by averaging the first average background B-values or the first average background R-values for the plural specimens processed in a day is calculated, and displays a graph showing the fluctuation in the second characteristic value by using the second average background B-value or the second average background R-value as the second characteristic value.
In addition, in the above-described embodiments, the configuration has been described in which the blood cell image of the specimen analyzed as normal by the blood cell analyzing apparatus 4 is used to obtain the first characteristic value and the second characteristic value, but the invention is not limited thereto. The nucleus state of the blood cell of the abnormal specimen may be different from that of the normal specimen in some cases. Therefore, the first characteristic value to be obtained using the nucleus area of the blood cell image may be calculated using the blood cell image of the specimen which is normal as the analysis result of the blood cell analyzing apparatus 4. Further, the second characteristic value to be obtained using the background area of the blood cell image, which is considered to have no difference in the abnormal specimen and the normal specimen, may be calculated using the blood cell image of all the specimens in which the blood smear slides are prepared. In addition, the first characteristic value or both the first characteristic value and the second characteristic value may be calculated using the specimen other than the specimens in which the abnormality affecting the nucleus color of the blood cell is detected, among all the abnormalities detected by the blood cell analyzing apparatus 4.
In addition, in the above-described embodiments, the configuration has been described in which the first characteristic value and the second characteristic value are obtained using the blood cell image of the neutrophil, but the invention is not limited thereto. It may be configured such that the first characteristic value and the second characteristic value are obtained using other kinds of white blood cells such as the monocyte, the eosinophil, the basophil, or the lymphocyte instead of the neutrophil. In this case, since the number of the neutrophils is maximum in the white blood cell included in a healthy person's blood, the first characteristic value and the second characteristic value, in which the stained state and the state of the imaging unit are accurately reflected using the blood cell image of the neutrophil, can be obtained. In addition, since all the white blood cells are stained by a stain solution, it may be configured such the first characteristic value indicating the characteristic of the stained state of the white blood cell is calculated using the white blood cell area in the blood cell image. In addition, it may be configured such that the first characteristic value and the second characteristic value are calculated using the blood cell images of all kinds of blood cell types instead of the blood cell image relating to a specific blood cell type.
In addition, in the above-described embodiments, the configuration has been described in which the first characteristic value and the second characteristic value are calculated using the plural smear slides of a normal specimen (which is a specimen gathered from a human subject), but the invention is not limited thereto. It may be configured such that, when a predetermined stain is implemented, a smear slide is prepared from a standard specimen showing a predetermined nucleus G-value and a predetermined background G-value, the plural blood cell images are obtained by imaging the smear slide, the first nucleus G-value and the first background G-value are obtained by averaging the nucleus G-values and the background G-values of the plural blood cell images, the first nucleus G-value is used as the first characteristic value and the first background G-value is used as the second characteristic value.
In addition, in the above-described embodiments, the configuration has been described in which the first characteristic value relating to the stained state of the smear slide and the second characteristic value relating to the state of the lamp are calculated by prompting a computer to perform an image processing program so as to serve as the image processing unit 3b, and the temporal fluctuation in the first characteristic value and the temporal fluctuation in the second characteristic value are displayed, but the invention is not limited thereto. It may be configured such that a dedicated hardware such as FPGA, ASIC or the like capable of performing the same process as that of the image processing program are employed so as to calculate the first characteristic value and the second characteristic value, and the temporal fluctuation in the first characteristic value and the temporal fluctuation in the second characteristic value are displayed.
In addition, in the above-described embodiments, the configuration has been described in which the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed by the image processing unit 3b, but the invention is not limited thereto. It may be configured such that the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed by the blood cell image display unit 3c which is provided independently of the image processing unit 3b. In addition, it may be configured such that the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed by one unit having the function of the image processing unit 3b as well as the function of the blood cell image display unit 3c.
In addition, in the above-described embodiments, the configuration has been described in which the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed at the time of shutdown of the image processing unit 3b, but the invention is not limited thereto. It may be configured such that the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed at the time of starting the image processing unit 3b. Therefore, when the image processing unit 3b starts, a user can confirm the accuracy management screen. Further, it can be prevented that the user forgets to check the stained state of the smear slide preparing apparatus 2 and the state of the imaging unit of the microscope unit 3a. In addition, the maintenance of the specimen processing system 1 is easily carried out. In addition, it may be configured such that the image processing unit 3b can receive the display instruction of the accuracy management screen from the user, and when the display instruction of the accuracy management screen is given by the user, the first characteristic value and the second characteristic value are calculated and the accuracy management screen is displayed.
In addition, before the shutdown of at least the image processing unit 3b is performed, it is preferable that the fluctuation in the first characteristic value and the fluctuation in the second characteristic value be displayed. That is, it may be configured such that, when an instruction is given to shut down the entire specimen imaging apparatus 3 instead of the shutdown of only the image processing unit 3b, the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed. Alternatively, it may be configured such that, when an instruction is given to shut down the entire specimen processing system 1, the fluctuation in the first characteristic value and the fluctuation in the second characteristic value are displayed.
In addition, in the above-described embodiments, after an instruction is given to shut down the image processing unit 3b, the CPU 321a averages the first average nucleus G-values and the first average background G-values in a day so as to calculate the second average nucleus G-value and the second average background G-value, and displays the accuracy management screen CW on the image display section 322, but the invention is not limited thereto. It may be configured such that the CPU 321a averages the first average nucleus G-values and the first average background G-values in a day, which are obtained at the point of time before an instruction is given to shut down the image processing unit 3b, so as to sequentially calculate the second average nucleus G-value and the second average background G-value. When the shutdown instruction is given, the CPU 321a displays the accuracy management screen CW prepared using the finally calculated second average nucleus G-value and second average background G-value on the image display section 322.
In the above-described embodiments, the configuration has been described in which all the processes of the image processing program 324a are executed by the single computer 320. However, the invention is not limited to this. A distribution system also can be employed for distributing the same processes as the above-described image processing program 324a to plural apparatuses (computers) and executing the processes.
In the above-described embodiments, the configuration has been described in which all the processes of the blood cell image display program 334a are executed by the single computer 330. However, the invention is not limited to this. A distribution system also can be employed for distributing the same processes as the above-described blood cell image display program 334a to plural apparatuses (computers) and executing the processes.
In addition, in the above-described embodiments, the smear slide preparing apparatus 2 and the specimen imaging apparatus 3 are separately configured from each other, but the invention is not limited thereto. It may be configured by one unit having the function of the smear slide preparing apparatus 2 as well as the function of the specimen imaging apparatus 3.
In addition, in the above-described embodiments, when the first average background G-value BA shows an abnormal value, the error screen for notifying the occurrence of the lamp light intensity abnormality is displayed on the image display section 322, and when the first average nucleus G-value NA shows an abnormal value, the error screen for notifying the occurrence of the staining abnormality is displayed on the image display section 322, but the invention is not limited thereto. A warning beep for notifying the occurrence of the lamp light intensity abnormality and a warning beep for notifying the occurrence of the staining abnormality may blow.
Number | Date | Country | Kind |
---|---|---|---|
2009-011303 | Jan 2009 | JP | national |