The modern world is characterized by numerous trends in the healthcare sector. The percentage of the aged population is on the rise in many countries. At the same time, the number of diseases is growing, including, but not limited to cardiovascular, infectious, gastroenterological as well as endocrine diseases, urology diseases including but not limited to urinary tract infections (UTI), benign prostatic hyperplasia (BPH), overactive bladder, immune-mediated rheumatic diseases, including arthritis, inflammatory diseases of the spine, connective tissue diseases and vasculitis, bacterial infections, for early detection of which the possibility of using different methods of medical diagnostics is being studied. Blood tests are the gold standard for diagnostics, although diagnostic methods based on sweat, saliva, exhaled air as well as urine and feces have been gaining popularity in recent years. It is known that the listed diseases lead to the appearance of either characteristic biomarkers or metabolic changes in general. Thus, the types of biomaterials listed above, such as urine, feces, sweat, saliva, and exhaled air, allow measurements to be carried out non-invasively, regularly, even at home. In addition, they are often much more affordable.
The operating principle of such diagnostic methods is based on the control of metabolic changes in general or on the appearance of certain chemical biomarkers (or their combinations). In particular, the analysis of volatile organic compounds that may be contained in urine, feces, sweat, saliva, and exhaled air, has become widespread. Many of them have already received the status of biomarkers and are actively used in the diagnosis of diseases.
From the perspective of the diagnostic devices themselves, a smart toilet or toilet-integrable systems may be provided that turns the natural voiding process into constant collection of vital health information. Having created such a solution, early diagnosis and control of diseases can organically fit into a person's habitual procedures and will not require any additional actions and time/efforts.
Embodiments of the present disclosure relate to person identification, and more specifically, to identifying individual people based on the chemical composition of biomaterial associated with that person. Embodiments of the present disclosure may operate in environments that may be optimized by personalized medical treatment, disease screening, health screening, clinical diagnostics, and/or personalized health status analysis such as wellness diagnostics.
The purpose and advantages of the disclosed subject matter will be set forth in and apparent from the description that follows, as well as will be learned by practice of the disclosed subject matter. Additional advantages of the disclosed subject matter will be realized and attained by the methods and systems particularly pointed out in the written description and claims hereof, as well as from the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the disclosed subject matter, as embodied and broadly described, the disclosed subject matter includes a system for automated identification of a person by the unique chemical composition of a biomaterial includes a biomaterial sample intake port in fluid communication with a sampling reservoir. The system includes a proximity sensor configured to detect the presence of a person at said biomaterial sample intake port and to produce a signal indicative thereof. The system includes at least one sensor in fluid communication with said sampling reservoir and configured to receive said signal from said proximity sensor and in response, determine a timeframe to analyze said biomaterial sample and extract at least one datum from said biomaterial sample during said timeframe. Said system includes a computing node that is configured to receive said at least one datum from said sensor, extract a first feature from said at last one datum, compare said first feature to a stored feature associated with said person, thereby identifying said person.
To achieve these and other advantages and in accordance with the purpose of the disclosed subject matter, as embodied and broadly described, the disclosed subject matter includes a method for automated identification of a person by the unique chemical composition of a biomaterial. Said method includes receiving a biomaterial sample at a biomaterial sample intake port in fluid communication with a sampling reservoir. Said method includes extracting at least one datum from said biomaterial sample via at least one sensor disposed in said sampling reservoir. Said method includes extracting a first feature from said at least one datum. Said method includes comparing said first feature to a stored feature, wherein said stored feature is retrieved from at least one database. Said method includes identifying said person.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and are intended to provide further explanation of the disclosed subject matter claimed.
The accompanying drawings, which are incorporated in and constitute part of this specification, are included to illustrate and provide a further understanding of the method and system of the disclosed subject matter. Together with the description, the drawings serve to explain the principles of the disclosed subject matter.
A detailed description of various aspects, features, and embodiments of the subject matter described herein is provided with reference to the accompanying drawings, which are briefly described below. The drawings are illustrative and are not necessarily drawn to scale, with some components and features being exaggerated for clarity. The drawings illustrate various aspects and features of the present subject matter and may illustrate one or more embodiment(s) or example(s) of the present subject matter in whole or in part.
Reference will now be made in detail to exemplary embodiments of the disclosed subject matter, an example of which is illustrated in the accompanying drawings. The method and corresponding steps of the disclosed subject matter will be described in conjunction with the detailed description of the system.
For the purposes of this disclosure, person identification may include person re-identification (ReId). For the purpose of this disclosure, “person re-identification” is the task of associating new data belonging to a person with previous information collected, stored, and retrieved from the that person. The described embodiments are aimed at creating the possibility of complete automation of all types of medical diagnostic systems. With embodiments of the invention, the identification of a person can be performed automatically with high accuracy. Identification is performed by comparing the characteristics of a taken biomaterial sample with the data set of an individual subject available in one or more system databases. Biomaterial samples include but are not limited to urine, feces, exhaled air, saliva, sweat, and their gas phases.
Automatic identification of a person by the unique chemical composition of a biomaterial, like urine odor (VOCs concentration and/or chemical structure), and automatically comparing it with the information in the database and resulting association of a new sample with the concrete user in some embodiments, may be used as a part of fully automated medical screening or/and a diagnostic system. Such a system would benefit from the identification function when it is combined with one or more (but not limited to) of the following: automated detection of the subject in the testing place, manual initiation system, an automated system to detect the right sampling moment, automated sampling system, information extraction system, a system that will evaluate health conditions and a system that can present results to a user or share it with other medical information systems.
The methods and systems presented herein may be used for identification of a person by a biomaterial sample analysis. The disclosed subject matter is particularly suited for analysis of extracted data of a biomaterial sample associated with a person and matching said extracted data with stored data associated with the person, thereby identifying the person by the biomaterial sample. For the purposes of explanation and illustration, and not limitation, an exemplary embodiment of the system in accordance with the disclosed subject matter is shown in
Person identification includes a plurality of steps and methodologies in varying order and implementations. One embodiment thereof can include delivering one or more biomaterial samples to one or more sensors, extracting data from the biomaterial sample based on the measurements of the one or more sensors, pre-processing the extracted data to extract meaningful features, and then matching the biomaterial based on the extracted meaningful features to data and/or features retrieved from a database of a pre-identified person.
The device modules, solutions and subsystems can be assembled in one device or stand-alone solutions or they can operate together being physically divided. The operation of hardware subsystems can be designed using any one or more microcontrollers, and in some embodiments, using ESP32, ESP32-S and ESP32-C. The device modules, solutions, and subsystems can be powered by a battery or by a rechargeable accumulator or be connected to the power supply. The device modules, solutions and subsystems can be assembled in any form-factor and additionally have specific mounting devices to clip to a toilet bowl or any other place in which the described system is deployed.
The device can be additionally equipped with buttons, LEDs, beepers, monitors, speakers, and sensing panels. Mentioned elements can form antidotal product subsystems aimed to provide additional functions for users such as, but not limited to, data and results presentation, operation, on/off/reset functions, process steps indications, errors indications, and manual person identification. This subsystem can be integrated with other product subsystems or form a stand-alone module for users' convenience. In particular, in the case of a urine analyzer, it might be prudent to place this product module on the wall near a toilet bowl so the user will not have to stop in order to operate the device (e.g., push buttons, read the information on the monitor panel).
The device and all other solution subsystems can be a part of a bigger solution or infrastructure. In particular the solution may include systems or methods that push results to other IT systems, medical information systems, Internet of Things (IoT) devices, smartphones or be controlled in another manner.
Now referring to
Embodiments of system 100 can be a software and hardware complex for automatic identification of a person by the unique chemical composition of a biomaterial, predominantly utilizing biomaterial samples such as urine, feces, sweat, saliva, and exhaled air. Moreover, the claimed system and method are adapted for the identification of a person based on biomaterials of the mentioned types in various states of aggregation (phases), in particular in solid, liquid, or gaseous phases or a combination thereof. Such a software and hardware complex and its one or more algorithms allow automating the processes of personalized medicine, e.g., determining the quality of drug metabolization, medical diagnostics, in particular, clinical diagnostics, and diagnostics of a person's health status (wellness diagnostics).
With continued reference to
Proximity sensor 104 may include a manual switch such as a button disposed on or near the rest of system 100. Proximity sensor 104 is configured to trigger one or more other components of system 100 as described below. For example, person 108 may be preparing to use the restroom to submit a biomaterial sample in the form of urine. Person 108 may then press the button, activate the switch, actuate a lever, pull a string, or other manual interface that connects one or more circuits, relays, or the like to activate another component of system 100. Proximity sensor 104 may be one or more smartphone applications loaded onto person 108 smartphone that tracks location utilizing GPS technology that in turn triggers one or more components when person 108 is within a predetermined distance from proximity sensor 104. Proximity sensor 104 may be one or more of the above described technologies used in concert or sequentially. Proximity sensor 104 may be a pyroelectric infrared (PIR) motion sensor. The PIR sensor may be disposed in a restroom where system 100 is located. PIR sensor may be adjustable to trigger at differing distances. For example, and without limitation, the PIR sensor may be configured to generate electrical signals to activate one or more other electrical components of system 100 when person 108 reaches 20 centimeters (cm) to 2 meters (m) from the PIR sensor.
Proximity sensor 104 may be configured to generate one or more signals in response to detection of person 108. For example and without limitation, proximity sensor 104 may be configured to generate an electrical signal and convey said signal to another sensor such as the sensor 128 (described below). Proximity sensor 104 may be electrically coupled to one or more computing devices, processors, controllers, or other electronic devices as described herein. Proximity sensor 104 may be electrically coupled to one or more remotely located servers and/or cloud technologies such as those described below. According to embodiments of the disclosed subject matter, any of the described elements may produce electrical, optical, radio, or other types of signals to communicate with another one or more components of system 100.
With continued reference to
With continued reference to
For example, a biomaterial sample can be, urine, which contains volatile organic compounds (VOC) which are organic chemicals that have a high vapor pressure at room temperature. In other words, they can be turned into a gas without any additional action. Therefore the biomaterial sample may be a liquid and the gases it produces or changes phases into. Examples are ammonia, acetone, nitrogen oxides, and/or some aldehydes, etc. VOCs occur in human specimens, in particular urine, due to metabolization process, physical activity, diet, and/or diseases, among others. For example and without limitation, more than 500 VOCs can be present in human urine. The VOC concentration and combination are unique or at least, markedly different for each person because of personal metabolic processes, among other factors.
With continued reference to
With continued reference to
Referring to
In embodiments there may be a plurality of sampling reservoirs 124, pumps, valves, connectors, and other elements aimed to make the sampling and sample analysis more efficient or meet product application requirements e.g., simultaneous intake of biomaterial sample 112 from one or more person 108, such as an embodiment integrated into a smart building.
With continued reference to
Referring now to
Referring back now to
A plurality of sensors 128 or sensory systems can be used either in a static mode when the supply signal does not change over time or in a dynamic mode when the signal changes according to a certain pattern, which makes it possible to increase their specificity and sensitivity, in embodiments. These technologies and methods are used for determining both the biomarkers and the chemical composition of liquids and gases may be known as “Electronic nose”, “Electronic tongue”, “Artificial nose”, “e-nose” and “eNose” to those of ordinary skill in the art.
In some embodiments, the Electronic nose systems (eNose, Artificial Nose systems), and thus sensor 128 can be built using Micro-electromechanical systems (MEMS) Metal-Oxide semiconductor sensors (MOS) such as Mems Nitrogen Dioxide Gas Sensor N02 Gas Detector GM-102b or TC-1326. This sensor consists of sensing material that changes resistance (conductivity) while interacting with some gas molecules, for instance, volatile organic compounds (VOCs from above) and comprise a heating element to provide a certain temperature of mentioned sensing element. The heating element is controlled by a voltage applied to thereto. By applying different voltage different temperature ranges can be achieved as those discussed above. Various temperatures can provide the conditions for sensing elements such as sensor 128 to be sensitive to various chemical components. The heating element may be inside (integrated with) the MOS sensor. The heating element integrated with the MOS sensor is configured to heat sensing elements (semiconductor) to a certain temperature when said sensing element is efficiently interacting with a certain chemical molecule. By varying the temperature modes a single sensor (MOS) may be configured to be sensitive to a broad range of chemical elements (VOCs). According to embodiments of the disclosed subject matter, one of the possible modes at which the MOS sensor is heated to may be 150-550 degrees Celsius. According to embodiments of the disclosed subject matter, one of the possible modes at which the MOS sensor is heated to may be 50-750 degrees Celsius.
The mentioned MOS sensors can be operated in the so-called static mode, when the heating element heats the sensing element of sensor 128 up to a certain temperature which is stable during the measurement process. The MOS sensors can be operated in temperature-modulated mode, when the voltage applied to the heating element is varied and therefore the heating element temperature changes according to some relationship that can be measured and predicted, respectively. Additionally or alternatively, the temperature may be set and conductivity of the MOS is measured consistent with the description of MOS sensors herein.
In embodiments, a single sensor such as sensor 128, or a plurality thereof, can be placed in sampling reservoir 124. Biomaterial sample 112 in gaseous form as described in previous sections can be transferred to the sampling reservoir. A plurality of sensors 128 can work in parallel mode providing separate measurements and information from each of them which can be further compared or combined to obtain higher specificity, sensitivity and accuracy. According to various embodiments, voltages may be applied to sensors including heating elements in steps, periodically or for certain amounts of time. For example and without limitation, in particular, to achieve the objectives of embodiments of the present disclosure, voltage may be applied to the heating element of sensor 128 four times during a measurement cycle: 0.8 volts (V) for 20 seconds (s), 1.2V for 20 s, 2V for 20 s and 2.4V for 20 s. Applying voltage to the heating element provides for reaching temperatures within the range of about 150° C. to 550° C. of the sensing element surface. Voltages may be applied to a plurality of sensors simultaneously at varying levels and for varying amounts of time, in steps, in patterns, or in sequences configured to measure a plurality of chemicals and VOCs. During a measurement cycle, the data extraction systems measure the resistance of the sensor during each voltage (temperature) mode. One of ordinary skill in the art would appreciate these temperature ranges, voltages, and times are merely exemplary embodiments and a plurality of ranges of those inputs can be changed to achieve the intended results. Additionally, embodiments of the present disclosure may inform the temperatures, voltages, times, types of sensors, types of biomaterial samples, and the like.
According to embodiments, sensor 128 may receive other data along with receiving data from MEMS MOS. Additional parameters of biomaterial sample 112 in the sampling reservoir 124 such as pressure, temperature, and humidity to describe biomaterial gas samples can be obtained. For example and without limitation, Adafruit BME280 I2C or SPI Temperature Humidity Pressure Sensor may be utilized to collect these environmental parameters. The measurement cycle can be conducted once for each user's urination or several times per urination or in any other way. In addition to that one probe or sample can be measured (tested) a needed amount of times. After the measurement is conducted the sample transport assembly 120 can release biomaterial sample 112 and clean the chamber as described above. According to embodiments the release of biomaterial sample 112 may be released in different methods. For example and without limitation, liquid biomaterial sample 112 may be flushed down the toilet, pumped through pipes, mains, or the like, or evaporated out of the system. If biomaterial sample 112 is solid, it may be flushed down the toilet, ejected by means of a mechanical actuator like a plunger, trapdoor, blender, crusher, or the like. If biomaterial sample 112 is gaseous, it may be expelled into the atmosphere to dissipate, condensed and ejected in another container, or the like.
According to embodiments of the present disclosure, the information from MEMS MOS, pressure, temperature, and humidity sensors can be saved and processed on the device or transferred to remote computing capacities including cloud computing for advanced feature extraction and person re-identification.
With continued reference to
For example and without limitation, the device for determining the time of biomaterial sampling can be build using a wide range of sensors including sensor 128, sonars, PIR motion sensor, temperature sensors, pyrometers, light sensors, vibration sensors, time-of-flight (TOF) sensors, weight sensors, sound detection sensors. The sampling time may be an optimal sampling time according to one or more detected physical phenomena. The determination of sampling time may also be launched or operated using manual controllers (buttons, switches, pressure sensors, Bluetooth technology and/or GPS-based sensing technology) or via connected devices such smartphones as described herein. All mentioned physical sensors can be supplied with software placed directly on the device or on other computing solutions (e.g. cloud/remote computation infrastructure) or both.
For example and without limitation, embodiments of the disclosed subject matter may be part of a breath analyzer, a sampling system can use an airflow detection sensor to receive the information that the user has already exhaled and there is enough biomaterial sample 112 in the form of exhaled air that can be transferred and analyzed.
For example and without limitation, embodiments of the disclosed subject matter may be part of a urine volatile organic compound (VOC) analyzer (urine chemical structure, urine chemical composition, urine odor) placed in the restroom, the detection of the right moment of urination can be built using an ultrasound sonar sensor such as HC-SR04 Ultrasonic Sensor Distance Module or time-of-flight sensor such as VL53L0X TIME-OF-FLIGHT DISTANCE SENSOR—30 TO 1000MM GY-530, according to some embodiments. One or more elements of system 100 may indicate that the proper moment for sampling is when there is enough or maximum biomaterial sample in the form of urine in the toilet bowl, which in this case is the biomaterial sample intake port 116 and sampling reservoir 124.
Referring to
Referring to
According to embodiments of the disclosed subject matter, the signal from mentioned sensors can be processed using cloud/remote computing or embedded (on device) software. The sampling system such as sensor 128 may be in the form of a standalone device, be integrated with other solutions or devices, or a combination thereof, which will be described in further detail herein.
With continued reference to
With continued reference to
Computing node 136 is configured to receive at least one datum of extracted data 132 from the biomaterial sample in the form of one or more signals, electrical signals or the like. Computing node 136 may include, but is not limited to one or more devices having hardware and/or software configured for receiving, transmitting and storing data, which can be implemented using both wired and wireless data transmission technologies, including Wi-Fi technology, mobile radio communications using 2G, 3G, 4G, and 5G standards. The configuration of the data transfer device provides for the transfer of data either to one or more local processors, or to one or more cloud systems, or to one or more remote servers. Alternatively, the device for receiving, transmitting and storing data can be designed with the data processing device as a single device or can be integrated with any of the previously listed devices herein.
Computing node 136 includes hardware and/or software configured to extract a first feature 140 from extracted data 132. First feature 140 may be the first of a plurality of extracted features, and in no way limits the number of collection of features intended to be extracted according to embodiments of the disclosed subject matter. First feature 140 may include a feature vector formulated from the extracted data according to the disclosed subject matter or another methodology. First feature may include one or more elements of computer-readable data, human readable data, matrices, listings of numbers, or the like. First feature 140 may include the results of one or more optimization problems, one or more coefficients of one or more polynomials and/or one or more roots of the one or more polynomials according to the disclosed subject matter. First feature 140 may include one or more unique parameters and/or values that describe the composition of a biomaterial sample 112. First feature 140 may include numerical values representing macroscopic parameters corresponding to chemical and/or physical properties of biomaterial sample 112. First feature 140 may be computer interpretable or human interpretable. First feature 140 may include one or more parameters representing a concentration of a chemical compound or group of compounds, in embodiments.
Such a feature extraction device can be integrated into the sampling system or analyzer or be used as an external device connected to the sampling system or to the analyzer by digital data transmission channels. Also, the feature extraction device can be connected by data transmission channels to external data sources or external data processing resources.
Feature extraction can be processed on one or more devices having computing capacities, such as ESP 32 microcontroller, and/or transferred to remote computing capacities.
According to embodiments of the present disclosure, computer node 136 may include a plurality of subsystems, one of which may be a designated feature extraction system. For example and without limitation, the incoming extracted data 136 for the feature extraction system can be a time series of measured values of, for example, conductivity of the sensing element of sensor 128, in particular a plurality of MEMS MOS sensors, under a given change in external influence on the sensitive element of the sensor. Such influences may include, but are not limited, to sensor temperature, sensor voltage or sensor light exposure, among others. External influences are divided into one or more phases in which the dependence of the influencing quantity can be a constant or change according to a given law (e.g., influence modulation).
Computing node 136 then, from the extracted data 132, for each phase, or several phases together, features are extracted, according to the totality of which, for all phases or some of their subsets, a feature vector is built for further use in applications including but not limited to person 108 identification at a later date, disease detection and chemical mixtures classification, among other implementations.
According to embodiments, first feature 140 may be presented in the form of a numerical vector that can be obtained from the input data, by means of transformation such as integral transformation, linear transformation, optimization problem solution, or transformation coefficients of which are determined as a result of the learning process, on a data sample.
In one approach computing node 136 may include a feature extractor that can be implemented as follows:
The initial data for each mixture of substances (biomaterial specimen) is a set S=(S1(t), . . . , SM(t)) of M curves
S1(t),t∈[0,T1]; . . . ; SM(t),t∈[0,TM], Equation 1
each of which describes the changes of the conductivity of the sensor over time, when the sensor is being exposed to this mixture during one of the M phases, where TJ—duration of J-th phase. Each phase is characterized by a certain temperature modulation (as described above—influence modulation).
It is assumed that the response SJ(t),t∈[0,TJ] of sensor at time t is a linear combination
S
J(t)=k1Jθ1J(t)+ . . . +kNJθNJ(t) Equation 2
where N—number of inclusions in the mixture, θiJ(t)—fraction of adsorption centers of the sensitive surface of the sensor occupied by molecules of i-th substance at a time t, k1, . . . J,kNJ—some positive constants.
The dynamics of filling the sensor surface with mixture substances can be described by differential equations
with initial condition θij(0)=cij, 0≤cij<1, Σcij≤1.
Where θJ(t)=θ1J(t)+ . . . +θNJ(t)—total fraction of occupied surface adsorption sites at a point in time t, αiJ—concentration coefficients proportional to concentration i-th substances, ψiJ(t)—a function describing the residence time of an adsorbed molecule i-th substances on the sensor surface before it is desorbed.
As a function ψiJ(t) you can choose, for example,
ψiJ(t)=βiJδ(t),ψiJ(t)=βiJe−β
where βiJ—some constant. Note that when ψiJ(t)=βiJδ(t) turns into the classical Langmuir equation for a multicomponent mixture
Analysis of Equation 3 shows that in the case when ψiJ(t)=βiJδ(t) or when ψiJ(t)=βiJe−β
where
A
2N
J(λ)=a0Jλ2N+ . . . +a2NJ,a0J>0 Equation 7
and
B
2N+1
J(λ)=λ2N+1+b1Jλ2N+ . . . +b2NJλ,biJ≥0 Equation 8
Equation 6 means that, provided that all the roots of the polynomial B2N+1J(λ) are different, the response SJ(t), can be represented as
S
J(t)=ΣDkJexp(γkJt), Equation 9
where
γ1, . . . J,γ2N+1J—polynomial roots B2N+1J(λ), a
Equation 9 can be rewritten as
and Uk are defined recursively
The vector fJ=(V0, . . . J,VrJ) of r coefficients V0, . . . J,VrJ characterizing the behavior of the first r derivatives of the curve SJ(t) at zero in expansion of Equation 10 is used as a feature vector for training a classifier.
The coefficients of the polynomials A2Nj(λ),B2N+1j(λ) can from Equation 6 also be used as features fJ=(a0, . . . J,a2NJ,b1J, . . . , b2NJ).
Alternatively the set γ1, . . . J,γ2N+1J of polynomial roots of B2N+1J(λ) from Equation 9 can be used: fJ=(γ1, . . . J,γ2N+1J).
Characteristics vector f=(f1, . . . ,fM)∈RMr can further be used for solving the problem of re-identification, classification of a sick/healthy person, and other tasks of data analysis based on an analysis of the chemical composition.
A weighted classifier can also be built from the classifiers trained separately on individual fJ. In particular, if yJ(xJ(t))—classifier for phase J of a new observation x=(x1(t), . . . , xM(t)),
The values of coefficients of polynomials in (3) A2NJ(λ),B2N+1J(λ) are determined by solving the minimization problem
I
J(N)=|SJ(λ)B2N+1J(λ)−A2NJ(λ)|22→min Equation 15
with the limitation bij≥0, i=1, . . . , 2N; a0J>0.
The optimal value N of the number of substances in the mixture is found from the condition
N{circumflex over ( )}=argminNΣIJ(N) Equation 16
Polynomial coefficients A2NJ(λ),B2N+1j(λ) can also be found using the Vector Fitting Algorithm or Steiglitz-McBride Approximation iterative procedure or any other similar solution.
In another approach, computing node 136 may include a feature extractor that solves the optimization problem to fit the measured time series of one or more phases with a predefined function. The determined coefficients of the function or a subset thereof is used as a feature vector of different phases and may be used separately or combined into a joint feature vector.
In another embodiment, computing node 136 may include a feature extractor that uses machine learning to determine the transformation to be applied to input data to produce a feature vector. Either approach may be used alone or in combination.
Processing the information from these sensors is often accompanied by the use of special pattern recognition algorithms, in particular those typical of machine learning (“ML”) technologies, which are used to determine the amount and classification of chemicals detected by the above-mentioned sensors. Such algorithms and mathematical models include, without limitation, pattern recognition algorithms, principal component analysis (PCA), linear discriminant analysis (LDA), support vector machines (SVM), artificial neural networks (ANN), and deep learning.
According to embodiments of the invention, adjusting, refining, or tuning of the system can take place according to the following algorithm. When training the system, the user interacts with the system, each time using various technical means, e.g., presses a button and thereby provides the system with information (control signal) affirming or denying that the taken sample is identified with him/her (person 108). Using machine learning technologies (supervised and/or unsupervised), the system is trained to separate the samples collected from different people 108, and after a certain number of cycles the training process ends and the operational stage begins. At this stage, the system itself determines the belonging of a sample to a specific person 108 by comparing the chemical characteristics of the new sample with the information about the chemical characteristics in the one or more databases 148 of the device for receiving, transmitting and storing data (which may be referral values that have been previously established, for example, by machine learning techniques). The formation of a database 148, which contains data on the chemical characteristics of samples of a biomaterial of a particular subject, is carried out by creating an initial record of the chemical characteristics of samples of a subject's biomaterial sample 112. The recording can be performed by pressing a “manual addition of sample” button integrated in a biomaterial sample intake port 116, a sampling system (such as a control signal from system 100), as well as assigning an identifier to the subject of the record. In the further sampling, the correlation of a new sample of biomaterial sample 112 with the data in database 148 is carried out either automatically or in manual mode by again, pressing the “manual addition of sample” button.
With continued reference to
Database 148 may include elements of stored feature 144 associated with person 108 based on one or more chemical characteristics of samples previously submitted to the system or transferred electronically from one or more medical data systems. Database 148 may include processed stored feature 144 such as feature vectors associated with the chemical composition of a previously submitted biomaterial sample 112 or other biologically-identifiable data.
Database 148 may include a database management system (DBMS), which is the software that interacts with end users such as computer node 136 and medical personnel or other electronic systems, applications, and the database itself to capture and analyze the data. The DBMS software additionally encompasses the core facilities provided to administer the database. The sum total of the database, the DBMS and the associated applications can be referred to as database 148.
Object identification (ReID) is used in various areas of math and applied solutions in particular the domain of computer vision where visual features are used as a source. In background mathematics, there's no significant difference in what type of feature source is used if feature distributions are compatible with the one or more algorithms employed therein. Consequently, some computer vision-based object identification approaches can be used for person identification based on the chemical structure of biomaterial. Therefore, the proposed system and its method of operation are based on comparing the obtained biomaterial samples 112 of a person 108 with referral data that is stored in the system database (the so-called primary sampling of a subject's biomaterial) and which takes into account the characteristics of the chemical composition of the biomaterial (urine, feces, sweat, saliva, and exhaled air) and the process of automatic identification of a person based on the comparison of the specified data and, as a result, ensuring the complete automation of the medical diagnostics process.
Referring to
An alternative way is to find similarity in abstract latent space 816 where vectorized representation has no direct physical mapping for each first feature 140 in the vector or their associations are unknown. In this case usage of embedding, vectors can take its place. In data science, these types of vectors are also known as fingerprints.
According to embodiments of the disclosed subject matter, data is processed by comparing the probabilistic distribution of the whole or for a certain zone of first feature 140 of the values of an individual measurement of a biomaterial sample 112 and the probabilistic distribution of these physical quantities on referral data such as stored feature 144, that has been previously obtained, for example, by training the system. Using one or more processors, a similarity score may be calculated between the first and second probability distributions for different zones or for the entire measurement in general. The similarity score can be calculated iteratively using a plurality of algorithms sequentially or by a single process. The process of determining the similarity score can consist of the stages of creating approximating functions and then lowering the dimension of the resulting vector using machine learning algorithms, in embodiments.
The data processing device, using the same processor device or another processor device, also performs identification of a subject by comparing the first probability distribution of a separate measurement of the chemical composition of the biomaterial sample 112, calculated as a referral value, and the second probability distribution of a separate measurement of the chemical composition of the biomaterial sample obtained. The one or more processors perform a similarity determination between the first and the second distribution, e.g., as a function of similarity based on machine-derived weighting factors, whereupon person 108 may be identified.
Data processing can take place in real-time mode or with a time delay between any stages. Alternatively, the identification system can be supplemented with a user interaction system, e.g., in the form of a software application for an external computer device running on the basis of such operating systems as Windows®, MacOS®, iOS®, Android®, etc. Such a user interaction system can receive data from a data processing device and/or an analyzer of chemical characteristics of biomaterial samples or other system data through a device for receiving, transmitting and storing data and can transmit them to a computer device, as well as diagnose or control the identification system through a software application installed on a computer device. Also, the identification system can be supplemented with an integration system with an interface for demonstrating the results of a person's re-identification, which can be designed as specialized medical equipment with a data visualization tool, such as a monitor, a display, and the like.
After the feature extraction phase identification could be processed using such methods as Deep Multi-biometric Fusion for Audio-Visual User identification and Verification, Deep learning-based person identification methods, SphereReID (Deep Hypersphere Manifold Embedding for Person Re-Identification), Deep Cosine Metric Learning for Person Re-Identification, Unsupervised Person identification via Softened Similarity Learning, Person identification with Deep Similarity-Guided Graph Neural Network, Domain adaptation for person identification on new unlabeled data using AlignedReID++, Cross-domain latent space projection for person re-identification, Weakly Supervised Text-based Person Re-Identification.
In some embodiments, the identification function can be made using approaches based on embedding vectors in latent space that makes it possible to detect to which person a measurement belongs to by evaluating cosine or Euclidean distances between those measurements.
Referring now to
With continued reference to
With continued reference to
With continued reference to
With continued reference to
With continued reference to
The results of identification of person 108 may be applied to local or shared processes via API or other IT systems. For example and without limitation, automated assignment of one or more diagnostic measurements to person 108 may be performed based on the identification. The one or more diagnostic measurements may be specified based on person's 108 medical history and/or analysis of biomaterial sample 112. The automated assignment of further diagnostic measurements may simplify and streamline the process of determining a person's 108 medical needs and current status. Additionally or alternatively, after the identification process is complete, the one or more extracted data, features, medical histories, identification information, and/or health metrics may be transferred to one or more downstream systems. For example and without limitation, these downstream systems may include Medical Information systems, Electronic Health Records, Electronic Medical Records, and the like. Data may be added, subtracted, manipulated, or otherwise communicated based on the identification. Additionally or alternatively, after the identification process the system or one or more connected systems may prompt person 108 to navigate more personal health monitoring systems based on the identification and analysis of biomaterial sample 112. For example and without limitation, after identification of person 108, the system may prompt person 108 to navigate personalized diagnostic plans or administer one or more personalized treatments based on the identification.
Additionally or alternatively the analysis of biomaterial sample 112 may include identifying social health risks such as tuberculosis treatment, air-borne virus, or the like. The system described herein may automatically share health information with one or more social workers, medical professionals and local law enforcement or emergency services, among others. The data extracted and contextual information learned regarding person 108 may be shared with one or more relevant medical providers such as doctors, nurses, specialists, or at home caregivers and support staff thereof.
In some embodiments, the identification function can be made using approaches based on embedding vectors in latent space that makes it possible to detect to which person measurement belongs to by evaluating cosine or Euclidean distances between observations. The chemical structure of biomaterial (e.g. urine) related to one person, distances between corresponding vectors are much smaller than between vectors of different people.
Referring now to
In computing node 910 there is a computer system/server 912, which is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well-known computing systems, environments, and/or configurations that may be suitable for use with computer system/server 912 include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of the above systems or devices, and the like.
Computer system/server 912 may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, and so on that perform particular tasks or implement particular abstract data types. Computer system/server 912 may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
As shown in
Bus 918 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, Peripheral Component Interconnect (PCI) bus, Peripheral Component Interconnect Express (PCIe), and Advanced Microcontroller Bus Architecture (AMBA).
Computer system/server 912 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer system/server 912, and it includes both volatile and non-volatile media, removable and non-removable media.
System memory 928 can include computer system readable media in the form of volatile memory, such as random access memory (RAM) 930 and/or cache memory 932. Computer system/server 912 may further include other removable/non-removable, volatile/non-volatile computer system storage media. By way of example only, storage system 934 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a “hard drive”). Although not shown, a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a “floppy disk”), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a CD-ROM, DVD-ROM or other optical media can be provided. In such instances, each can be connected to bus 918 by one or more data media interfaces. As will be further depicted and described below, memory 928 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the disclosure.
Program/utility 940, having a set (at least one) of program modules 942, may be stored in memory 928 by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data. Each of the operating system, one or more application programs, other program modules, and program data or some combination thereof, may include an implementation of a networking environment. Program modules 942 generally carry out the functions and/or methodologies of embodiments as described herein.
Computer system/server 912 may also communicate with one or more external devices 914 such as a keyboard, a pointing device, a display 924, etc.; one or more devices that enable a user to interact with computer system/server 912; and/or any devices (e.g., network card, modem, etc.) that enable computer system/server 912 to communicate with one or more other computing devices. Such communication can occur via Input/Output (I/O) interfaces 922. Still yet, computer system/server 912 can communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and/or a public network (e.g., the Internet) via network adapter 920. As depicted, network adapter 920 communicates with the other components of computer system/server 912 via bus 918. It should be understood that although not shown, other hardware and/or software components could be used in conjunction with computer system/server 912. Examples, include, but are not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives and data archival storage systems, among others.
The present disclosure may be embodied as a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.
The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions for carrying out operations of the present disclosure may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.
Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
The descriptions of the various embodiments of the present disclosure have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
While the disclosed subject matter is described herein in terms of certain preferred embodiments, those skilled in the art will recognize that various modifications and improvements may be made to the disclosed subject matter without departing from the scope thereof. Moreover, although individual features of one embodiment of the disclosed subject matter may be discussed herein or shown in the drawings of the one embodiment and not in other embodiments, it should be apparent that individual features of one embodiment may be combined with one or more features of another embodiment or features from a plurality of embodiments.
In addition to the specific embodiments claimed below, the disclosed subject matter is also directed to other embodiments having any other possible combination of the dependent features claimed below and those disclosed above. As such, the particular features presented in the dependent claims and disclosed above can be combined with each other in other manners within the scope of the disclosed subject matter such that the disclosed subject matter should be recognized as also specifically directed to other embodiments having any other possible combinations. Thus, the foregoing description of specific embodiments of the disclosed subject matter has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosed subject matter to those embodiments disclosed.
It will be apparent to those skilled in the art that various modifications and variations can be made in the method and system of the disclosed subject matter without departing from the spirit or scope of the disclosed subject matter. Thus, it is intended that the disclosed subject matter include modifications and variations that are within the scope of the appended claims and their equivalents.
This application is a Bypass Continuation of International Application No. PCT/US22/33838, filed on Jun. 16, 2022, which claims the benefit of U.S. Provisional App. No. 63/211,801, filed on Jun. 17, 2021. Each of these prior applications are hereby incorporated by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
63211801 | Jun 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US22/33838 | Jun 2022 | US |
Child | 18538877 | US |