The present invention relates to a method and a corresponding device for quickly and non-invasively estimating the state of anaemia in a subject, thanks to capturing and subsequently processing a digital image of the palpebral conjunctiva.
Anaemia is the most common blood disorder that can be found in the population, as the WHO estimates that around 2 billion people worldwide are affected by it. Anaemia is defined as the pathological reduction in the number of circulating red blood cells in the blood or as the decrease in the concentration of haemoglobin below normal levels and has, as a direct consequence, a reduced capacity of the blood to carry oxygen. In most cases, this condition sets in slowly and progressively and is accompanied by symptoms such as a feeling of tiredness, weakness, shortness of breath and/or poor physical exercise ability.
The anaemia condition can be determined by several factors, which may have a nutritional-type origin (e.g. iron, vitamin and/or mineral deficiency), an infectious-type origin (e.g. malaria, intestinal parasites) or a genetic-type origin (e.g. haemoglobinopathies). These factors may occur alone or, more frequently, in combination with each other.
In particular, the anaemia caused by iron deficiency is the most common nutritional deficiency and is also considered to be responsible also for the increase in morbidity and mortality in pre-school children and pregnant women.
In current medical practice, one of the most commonly employed parameters for the diagnosis of anaemia as well as for the subsequent determination of patients' response to treatment is the measurement of haemoglobin levels in the blood. In particular, subjects with a haemoglobin value below 13 g/dL or 12 g/dL, respectively, for male or female adult subjects are considered to be at risk of anaemia, although these thresholds are much discussed in the literature. Moreover, the thresholds vary with age, pregnancy status, cigarette smoking and other factors. Patients in the most critical conditions should repeat this test very frequently, by undergoing blood samples to evaluate the possible need for a transfusion if values fall too far below the alert level. The most accurate determination of the anaemia status, therefore, requires a venous blood sample and the use of dedicated laboratory instrumentation. It is therefore an invasive examination with a non-negligible cost, especially if one takes into account the healthcare personnel that must necessarily be involved.
In recent years, alternative approaches have also been proposed, which are mainly based on the observation and evaluation of the colour of the palpebral conjunctiva. These methods include, in the simplest case, visual evaluation by the treating physician who, based on his or her experience, can decide whether or not the patient is in a condition of severe anaemia. This method is widespread and used in medical practice especially in areas of the earth where carrying out laboratory investigations is difficult or too onerous. It is a quick and inexpensive method but it clearly brings with it numerous disadvantages, which are mainly related to the fact that it is a method that cannot in any case give reliable qualitative results and that is strongly influenced both by the experience of the physician performing the evaluation and by the quality and quantity of ambient light present at the time of the observation.
Other approaches, such as e.g. the one described in US2003002722, are based on the possibility of simultaneously capturing a digital image of the palpebral conjunctiva and a standard colour sample card with a camera, and then evaluating the shade of the conjunctiva in comparison to the standard thanks to the use of a personal computer equipped with software for image analysis. This method is certainly less influenced by the skill and experience of the operator than the previous method described above but, even in this case, some disadvantages remain which are mainly related to the fact that the method of US2003002722 can be influenced by ambient light and requires additional instrumentation (personal computer) and qualified personnel capable of manipulating the image in order to capture the measurement correctly.
The possibility of using a smartphone, and in particular its camera, to capture the image of the palpebral conjunctiva, in order to perform a determination of the level of possible anaemic pathology in a subject, was also proposed. IT102017000043624 describes the use of a particular spacer, which can be coupled to LEDs and electrical connectors placed on the outside of said spacer, to be connected to the same smartphone, which allows to at least partially decrease the influence of ambient light during the capture of the image of the palpebral conjunctiva. Said spacer must, however, be continuously assembled and disassembled from the main body of the smartphone and connected thereto through cables. The system and device described in IT102017000043624 therefore do not completely solve the problem of the influence of ambient light in the evaluation of the colour of the palpebral conjunctiva. In fact, the system described cannot be perfectly adapted to the different types of smartphones, nor to the specific facial characteristics of the subject whose haemoglobinaemia is to be evaluated. Moreover, said measuring system is complex and not self-sufficient, as it necessarily implies the use of a second external apparatus, i.e. the smartphone, without which it would not be able to function.
The need is therefore still felt to have a system that allows the evaluation of the haemoglobin value of the blood that is low-cost, can be easily carried and used even in areas of the world where clinical facilities are scarcely available in which to carry out laboratory investigations.
There is an equally strong need for a system that is easy to employ and carry, that allows the evaluation of the haemoglobin value in blood, that is not influenced by ambient light, that does not require specialised personnel for its use and, above all, that does not need to be coupled to a second or additional piece of equipment in order to function, but is self-sufficient.
There is also a need for a method that allows the evaluation of haemoglobin concentration in blood, that is not influenced by ambient light, that does not require specialised personnel for its implementation and that is based on the use of a simple and reliable device.
It is an object of the present invention to provide a new device for quickly estimating the possible anaemia condition in a patient, which is non-invasive and inexpensive.
It is also an object of the present invention to provide a new device for mass screening to diagnose anaemia, especially in areas of the earth with limited economic resources and availability of analysis laboratories.
It is still the object of the present invention to provide a device that is capable of functioning autonomously and without the need for the aid of other external equipment or technologies and that can also be used without the need for specific training courses. Still another object of the present invention is the use of the new device to carry out a quick estimation of the haemoglobin concentration in a subject.
This and other purposes are achieved by the object of the present invention, which has as its subject matter a non-invasive device for estimating the haemoglobin concentration in a subject and the consequent evaluation of possible forms of anaemia.
Object of the present invention is a device which non-invasively and quickly allows to estimate the condition of possible anaemia in a subject, by means of the capture of an image of the palpebral conjunctiva and subsequent analysis of its colour hue and/or intensity by software integrated within the same device.
Object of the present invention is also to provide a method for evaluating the haemoglobin concentration in a subject and the corresponding evaluation of a possible form of anaemia in the same subject, which provides for the use of the device above. According to the present invention, the “estimation/measurement of haemoglobin concentration”, which can be directly obtained by means of the device and method according to the invention, can be correlated to the possible anaemia condition of the subject on whom the measurement is performed, thus allowing to evaluate whether or not an anaemia condition of the same subject is present.
The device that is the object of the present invention, mainly consists of:
It should be noted that in the present document the terms “adapter” and “spacer” are used interchangeably as synonyms.
In the present document, the term “combined”, when related to a device element, refers to its possible mechanical coupling with the part to which it is assembled/connected. The term miniature video camera b) means an image sensor which can be connected to the computerised processing unit referred to in point a), e.g. by means of a cable, preferably connected to the CSI port as illustrated in
It should be noted that the terms “video camera” and “camera” are used interchangeably as synonyms in the present document.
The algorithms, referred to in point a), allow the following operations to be performed:
Said operations can be performed by the algorithms specially installed in, and executable by, the computer processing unit referred to in point a), on which the images captured by the miniature video camera are also stored as well as the values meanr, meang, meanb, meanL*, meana*, meanb*, HHR, E, B, G1, G2, G3, G4, G5 obtained by the extraction of the pixels, in addition to the age and sex of the patient and the estimation of the haemoglobin level. The device of the invention, thanks to the imaging unit and the computerised processing unit with the respective algorithms installed, is therefore capable of recording and measuring 14 parameters which, together with the characteristics of the patient (age and sex), constitute 16 distinct parameters that allow to predict, with a high degree of precision, the anaemia condition of the subject undergoing analysis.
The images captured, the patient's data and the values estimated by the device can be sent to the physician for a further check, either by using the same device or by means of a personal computer or other digital processing/communication device.
The display, referred to in point c), is preferably a touchscreen-type display, preferably 3.5 inch LED with a resolution of 320×480 pixels. As illustrated in
The spacer/adapter, referred to in point e) above, has specific characteristics which make it unique and particularly advantageous in its use, due to the fact that it allows the instrument to rest on the periocular area, by adapting perfectly to its shape and further allowing the area enclosed therein shot by the video camera to be isolated from the ambient light. Said spacer/adapter for capturing digital images of the palpebral conjunctiva is an object having shape and characteristics adapted to capture digital images of the human palpebral conjunctiva by means of a miniature video camera and a macro lens. Said spacer/adapter comprises a hollow body having a supporting surface and a cavity. Said supporting surface is configured, in use, to be placed in contact with the periocular area of the subject to be evaluated. The model has an original and ergonomic shape (
According to an aspect of the invention, in use the spacer/adapter is interposed between the back casing containing the electronic circuitry and the orbital cavity, by laying it on the latter. Its shape allows the geometric plane containing the palpebral conjunctiva to be aligned with the geometric plane containing the camera and therefore allows the optimal capture of digital images of the same conjunctiva in a non-invasive manner. In other words, the axis of the spacer/adapter, due to its special shape, is perpendicular to the plane containing the palpebral conjunctiva.
Moreover, the spacer/adapter, made of opaque material, allows the image of the palpebral conjunctiva to be captured from a fixed distance and excluding the influence of ambient illumination. These characteristics make it adapted to capture images of the palpebral conjunctiva for diagnostic purposes.
The lighting unit, referred to in point f), consists of one or more, preferably more than one, LEDs mounted inside the spacer/adapter, referred to in point e). Said LEDs may, e.g., be arranged in a circle around the macro lens. In particular, said lighting unit is combined with said cavity of the body of the spacer/adapter and is configured to illuminate a space inside the cavity, which, when the device is positioned in contact with the periocular area of the subject to be evaluated, is in the dark. Advantageously, the positioning of the LEDs mounted inside the spacer/adapter allows to minimise the areas of reflection, typically white in colour, due to moisture in the conjunctival mucosa that could alter the colour of the area being shot and thus avoiding the need for post-processing the images to eliminate such areas of reflection.
According to an embodiment of the invention, the adapter/spacer can be removed and replaced with one having shape adapted to the individual patient, if the latter has a particularly different conformation of the periocular area than the norm, i.e. when the patient is very young and the periocular area is very small compared to the norm: in these cases, the shape and dimensions of the adapter can be further customised by specially designing and printing the adapter in a short time with low-cost technologies, such as 3D printing.
The device object of the present invention, thanks to the algorithms installed on, and implementable by, the computerised processing unit referred to in point a), is capable of estimating the haemoglobin concentration values in blood, by means of a calculation operation.
Said calculation operation, performed by the aforesaid algorithms starting from the selected portion of the image captured by means of the miniature video camera, is made accurate by means of a preliminary calibration of the same algorithms, which is performed during the designing step. According to a preferred aspect of the invention, this calibration consists in training a classifier, e.g. RUSBoost of a known type, used to determine whether the image of the conjunctiva belongs to a patient suffering from anaemia or not.
According to another aspect of the present invention, said software training can be performed not only upstream of the first use of the device but can also be repeated at subsequent times, in order to further increase the precision of the device dynamically during its use and the more frequently it is used.
Further object of the present invention is a method for the quick estimation of the haemoglobin concentration in a subject. Said method, which may be advantageously based on the use of said device, still according to the present invention, comprises the following steps:
Due to its simplicity, the use of the device and/or method according to the invention can also be performed by subjects without specific knowledge or training. In particular, in some cases it is the same subject who can employ the device for a self-measurement by following all the steps previously described.
According to an aspect of the present invention, the selection of the area of the photograph referred to in step iii) is initially made by the operator with less precise contours, by simply employing a finger or a suitable tool directly on the surface of the display and, subsequently, the software will proceed to delineate it more precisely thanks to the image analysis algorithms referred to in point a).
According to another aspect of the present invention, the selection of the area of the photograph referred to in step iii) is performed fully automatically by the device and the integrated software by identifying and selecting a conjunctiva image portion that the device deems sufficient to perform the calculations necessary to estimate the level of anaemia.
The operation of selecting the area occupied by the palpebral conjunctiva, on which the calculation of the values meanr, meang, meanb, meanL*, meana*, meanb*, HHR, E, B, G1, G2, G3, G4, G5 in the pixels will subsequently be performed, can be repeated, even several times, in case the operator does not consider it to have been performed correctly by the software.
According to an aspect of the present invention, step iv) provides for performing image analysis algorithms through extraction of information from said image and artificial intelligence algorithms for the estimation of the anaemia level in said subject to be evaluated.
In other words, the values meanr, meang, meanb, meanL*, meana*, meanb*, HHR, E, B, G1, G2, G3, G4, G5 in the pixels of the selected area are finally extracted and processed by the algorithms installed on, and implemented by, the computerised processing unit to obtain the estimation of the haemoglobin concentration and, consequently, the indication of a possible anaemic pathology.
The invention object of the present application allows to obtain numerous advantages compared to devices of the known art. In particular, the object of the invention is a stand-alone device which does not need to be coupled to other equipment in order to perform its function. In fact, the device according to the invention can be handled and correctly used even by non-healthcare personnel without special training. In some cases, it is the same subject who can employ the device for a self-measurement. Similarly, the method according to the present invention allows to evaluate the level of haemoglobin in the blood of a subject and thus to simultaneously evaluate a possible anaemic pathology by using the device of the invention, with the advantage of thus having available a fast, reliable, objective and reproducible method, which is not affected by subjective evaluations that could significantly influence the results and consequent evaluations.
The particular shape of the spacer/adapter mentioned in point e) allows the perfect adherence to the patient's periocular area and the total exclusion of ambient light inside the area that will be subjected to measurement, thus increasing the precision of the detection and its standardisation. These advantages are further guaranteed and implemented by the presence of the lighting unit that provides light of a constant and repeatable intensity and colour in the various measurements. The lighting unit of the present device further allows to minimise reflections due to moisture in the conjunctival mucosa, which appear in the image as white areas. The area shot by the imaging unit is consequently unaltered, thus eliminating the need for post-processing the images.
Moreover, the device of the invention does not need to have, within the palpebral conjunctiva image that is captured, the colour reference normally used in the technologies known so far. In fact, the particular shape of the spacer referred to in point e), allowing the perfect adherence to the periocular area of the patient, allows to exclude the influence of the ambient light inside the area that will be subjected to measurement and the inner illumination of the same spacer, which is obtained by means of simple LED bulbs mounted therein, allows to carry out both the training step and the actual measurement with the same type of illumination.
The device of the invention, in fact, is characterised by the absence of devices and/or systems and/or a colour table or a reference card to perform the comparison with standard colours during the capture of the image, in order to recalibrate the colour depending on the ambient light. This peculiarity allows the image to be used without changing the original colours, thus allowing a more reliable estimation.
Finally, the simple and compact structure of the device that is the object of the invention and its low cost make it easy to use and carry even in particular situations and/or remote locations where it would be difficult to perform laboratory analyses, such as those normally used for the determination of haemoglobinaemia in venous blood.
The device that is the object of the invention can be produced at very low costs and sold at much lower prices than, e.g., systems which provide for the use of smartphones, thus allowing for mass diffusion.
Assuming that the portion of the conjunctiva extracted for the analysis, ROI (Region Of Interest), is of N×M dimensions, then meanr, meang and meanb are respectively represented by the following equations [1-3]:
wherein Pixelred[i][j], Pixelgreen[i][j] Pixelblue[i][j] denote the red, green and blue components of Pixel[i] [j], respectively.
The erythema index (EI) is defined as:
The values meanL*, meana* and meanb* are extracted from the CIELAB colour space and represented by the following equations [4-6]:
wherein PixelL*[i][j], Pixela*[i][j] Pixelb*[i][j] denote the brightness (L*) and the chromatic coordinates (a* and b*) of Pixel[i][j], respectively.
The HHR (High Hue Ratio) value is expressed by the equation [7]:
where nH represents the number of high-hue pixels in an image that has a total number of pixels N. A high HHR value denotes a red area of greater amplitude. Consequently, the image that has a high HHR value identifies an image that does not show the presence of anaemia. The pixel threshold value for defining a pixel having high hue is set at 0.95.
The Entropy (E), calculated on the image converted to grayscale, is defined according to the equation [8]:
where P(Xt) represents an estimated probability of occurrence of the i-th grey level Xt from the image histogram after the histogram equalisation. P(Xt) is a non-zero value. The B value is an index of brightness (the average grayscale of the image).
The values G1, G2, G3, G4, G5 are useful for characterising the pixels in which blood vessels are present or not. First, the software calculates values based on the grey level, which depend on the differences between the grey level in the pixel considered and a statistical value representative of the surrounding area. In particular, considering the grayscale image of the segmented conjunctiva, it was observed that the blood vessels appear darker, have a lower grey level than the surrounding area. Therefore, a sliding window was identified on the grayscale image, with dimensions of 3×3 pixels and stop motion, to calculate said values for each pixel of the conjunctiva according to the following equations.
The equation [9] represents the difference between the intensity level I(x,y) at the pixel with co-ordinates (x,y) and the minimum intensity recorded in the 3×3 window S3x,y centred in the pixel with co-ordinates (x,y) and allows the blood vessel to be highlighted against the background.
The equation [10] represents the difference between the maximum intensity within the 3×3 S3x,y window considered and the intensity of the pixel with co-ordinates (x,y) to highlight the background against the blood vessel.
The equation [11] represents the difference between the intensity of the pixel with co-ordinates (x,y) and the average of the pixel intensities of the 3×3 S3x,y window considered.
The equation [12] represents the standard deviation of the pixel intensities in the 3×3 window considered.
The equation [13] represents the intensity of the central pixel of the 3×3 window considered.
Once the five grayscale values have been calculated for each pixel, the software is able to apply the equation [14] as follows:
The device that is the object of the present invention has been shown to be capable of accurately estimating the presence of a possible anaemic pathology in a subject. Specifically, the software was trained, according to the RUSBoost procedure illustrated above, by using a set of images of the conjunctivas of 123 patients whose haemoglobin value had been concurrently measured in the laboratory by means of blood sampling according to normal, current laboratory protocols.
The threshold value established to define a patient in a “severe anaemia” condition corresponds to a haemoglobin (Hgb) value≤10.5 g/dL.
After the software training step of the device object of the present invention, measurements of the haemoglobin concentration were performed on subjects from whom a blood sample was taken to check the good quality of the measurement. The Pearson correlation index for the value of a* in the area of the palpebral conjunctiva with respect to the haemoglobin values measured by venous blood sampling was found to be 0.69, which corresponds to a strong correlation value, as stated in the literature. In order to provide an objective comparison, the same parameter was calculated by taking measurements on the same number of subjects and using the instrument described in IT102017000043624. In this case, a Pearson correlation index of 0.49 (moderate correlation) was derived for the value of a* in the area of the palpebral conjunctiva with respect to the haemoglobin values measured by means of venous blood sampling, which was significantly lower than that obtained thanks to the device of the invention.
Number | Date | Country | Kind |
---|---|---|---|
102021000017078 | Jun 2021 | IT | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2022/056041 | 6/29/2022 | WO |