The use of sensors is a well known practice to gather a wide variety of data measuring a physical characteristic or parameter. Pressure sensors detect the application of physical force at a point in space. Using more than one pressure sensor creates a set or subset of data points that measure both absolute and relative pressure at each sensor location. By assembling large groups of sensors on or around an object, typically referred to as arrays, the data that is assembled from the sensors, both individually and collectively, and as assembled over time, provides a composite and more detailed picture of the physical environment of the object.
Additionally, the absolute and relative orientation of the sensors can provide a three dimensional picture and a detailed measurement of the environment in which a target object or structure exists. By continuous tracking of the sensor data, a detailed composite representation of position, orientation, and movement of the sensed object can be assembled from the data.
The advent of wireless sensors interconnected to a database and a data collection system enables remote monitoring of a target object and the sensored data, so assembled and monitored, can provide extensive information regarding the position and behavior of a target object in space and over time. By comparison to known values, both absolute and relative sensor data can be used to develop substantial information regarding a sensed object including position, movement, timing and a variety of other parameters.
Some types of pressure sensors use the measurement of strain or deflection of a sensor component to measure force applied to a particular point or region (force/area) in space. The sensor may rely on a variety of properties to measure the difference between two distinct states or conditions at the sensor. For example, a piezo-resistive effect detects strain due to applied pressure in a material and converts that strain into an electric signal. Similarly, a capacitive detector also measures strain at a point due to applied pressure. Also, the displacement of a sensor may cause changes in electrical inductance or capacitance at a selected point.
Where a sensor is formed by a conductive element, such as a thread or a wire, a point sensor may be formed by the intersection between two conductive threads or lines having known properties. Changes in the conductive properties of the lines at various points in time, together with their identification in space, can provide a combination of sensors in an array that yields information about an object in space over a series of sensor points joined together in an assembly.
Medical monitoring is frequently used to diagnose and monitor a physical condition in a patient. For example, the extent of movement, or unique movement patterns, can be a valuable parameter to measure the onset, progression, or recovery from disease. If comprehensive data sets regarding patient movement could be assembled and analyzed without the need for real time observation of a patient by a medical professional, a physician could, at low cost, assemble and review valuable information regarding the state of health of a patient and could more accurately and efficiently assess the health of the patient.
Additionally, data processing techniques can significantly improve the quality and reliability of the data collected from the sensor array. Using these techniques to refine the raw data collected from the array may mean the difference between a sensor array that is practically useful, and one that cannot gather and analyze the data with enough reliability and fidelity to be used in practice. Sensor pressure arrays that are adapted to measure features of the human body are particularly problematic because of the dynamic nature of movement exhibited by the human body. A sensor array that meaningfully and accurately measures the orientation, movement, or posture of the human form requires a large number of inputs from the sensor array. Without careful analysis and data processing, unwanted electrical currents make the data collected practically unusable. Moreover, because of the unique, dynamic, and complex nature of human physiology, data processing methods and systems are uniquely challenging when put into practice measuring the human body.
The present invention is wireless pressure based sensors assembled in an array for patient monitoring and overall healthcare assessment. The invention includes a system for recording, assembling, and analyzing patient data developed from a plurality of sensors, usually oriented in a preselected pattern to represent a three dimensional picture of the human body or a portion thereof, or any arbitrary object that can cause pressure. The invention also includes methods of using the sensors, analyzing the data, and correlating the data to specific healthcare conditions such that the use of the pressure sensor array assembles, presents, and facilitates analysis of healthcare parameters, disease and recovery states, etc. by a healthcare professional.
The invention also includes data processing such as the use of relative and absolute values assembled from a sensor array and calculated to convey key important information regarding the position, motion, and other parameters of a patient. In specific instances, absolute and relative data from a patient, who has a pressure based sensor array associated with the body, is collected and analyzed to provide a profile of the position, movement, behavior or other parameter of the patient. In some cases, the array of sensors is oriented to mimic the three dimensional structure of the human body such that changes in the pressure measurements, both at single points in time as well as over a selected time period, can be correlated to known profiles for postures such as sitting, standing, lying, walking, and essentially, any other posture or behavior by the human body. Individual subsets as well as progressions of data over time can also be analyzed and correlated to overall levels of activity and essentially any behavioral state where measurement of the body can be detected through the use of a plurality of pressure sensors.
A sensor is formed by the intersection of two conducting lines. The sensor can use both volume and/or surface electrical characteristics, such as resistance, capacitance, or inductance to measure pressure at any particular point. The array is formed from a combination of intersections of the conducting lines, each of which forms a sensor at the point of intersection. Array may also be formed from non intersecting electrodes which may be just pairs side by side if the sensor is constructed in a single plane. See PCT/US2013/043429 specifically incorporated by reference herein. The sensor array formed from the plurality of intersections of the conducting lines can be formed into a flexible material, such as a fabric so that the sensor array can be worn by the user. Additional sensing capability can be provided by incorporating the array into a piezo-resistive fabric.
The continuous sensor array may further include a decoupling feature that yields accurate and reliable electronic and visual representations of the position, orientation or posture of the human form.
Referring to
This pressure signature itself can be computed by a variety of methods. The processed signal with an m×n sized array is a reasonable candidate for the signature. Some techniques for dealing with the full sized data set are discussed in US 2012/0323501 A1, which is specifically incorporated by reference herein. This full sized array generates large data sets for comparison purpose. Each point of this m×n sized frame is effectively a triple with the row and column indices into the matrix yield x, and y co-ordinates, and the value serving as a z axis.
Referring to
Alternately, new vectors may be created for these extrema by computing the distance to a reference point. This reference point can be centroid, or inclination line, infinity, or any reference.
Using a simple preprocessor function e.g. a first order differential, etc., a wide variety of dominant feature extraction data sets are created depending on the specific application. This preprocessor function will be followed by dominant feature extraction as disclosed. Thus, the first order differential of the Sp matrix may be used to compute the dominant features.
The pressure signature thus computed can now be compared using techniques such as DTW (Dynamic Time Warping) to compute similarity measure to reference database.
Reference database is created during the data collection phase, this data is collected, and templates are created in the database for comparison purpose.
Referring to
The dominant feature vector is first used to build the reference database by collecting known/desired postures from a reasonably large set of users and labeling them. This forms Vref, or reference class as indicated in
A multitude of comparison measures (such as Dynamic Time Warping, K-nearest neighbor, etc.) is used to compare the incoming frame, based on known class of reference frames as shown in
Referring to
The raw data may be a simplified representation of the object, as in the stick figure example of the human body above, or may be literally any representation that can be assembled from an array of pressure sensor data. As noted above, the data can be absolute values for position orientation or other physical characteristic or may reference a model or reference value or array for comparisons.
An object will be fully identified with 3 or more projections (at least one in every orthogonal plane). The sensed pressure distribution of an object is detected to identify the object from its pressure profile as the pressure profile will project the entire object on to the sensing plane. The necessary projections are reduced to one known or preferred position which maximizes the unique pressure signature. By reducing the number of projections, a preferred position for identifying subjects/objects is created. One or a plurality of postures may be used and in an arbitrary sequence to complete the identification or increase the accuracy of the identification.
In a system in which the subject is put into a known preferred position, the resulting pressure profile will be unique to that subject/object. The pressure signature Vsig can then be compared the reference database of all known subjects/objects and the identification tags on those reference signatures will allow us to determine the identity of subject/object.
Most sensors can detect incident pressure on a particular sensor on the sensor grid. The value of this data increases significantly when a plurality of values or data sets are mapped to the body, especially since the body can move over the sensor sheet. In this system, the sensed values are mapped over the subject body and tracked and assembled over time for collection in or comparison to values stored in a reference or sample database.
The identity of the pressure signature of the incoming frame is determined as described above, and particularly with respect to
The posture of subject is determined as described above, and particularly with respect to
Every posture creates a unique section of body experiencing the contact pressure, so the 3D body can be considered as a set of planes (or external contours). Every posture covers a certain area on the body. Referring to
In a co-ordinate system on the 3D human body, the co-ordinate system pivots (1-13) has absolute scale (rectangle #0, 1, and so on), and another relative scale that is the set of all the planes and location relative to reference (such as centroid as indicated by the large circle #9). Each location may be locked independently to any arbitrary or a specific pivot point based on the subject geometry. The points on torso may be locked to shoulder points or centroid in a given posture, but those on shins may be locked to ankle or knee points. As an example, a point on torso, in Supine position, may be locked to centroid. The indicated co-ordinate may be referenced as <Posture=Supine, Ref=#9, <x=12, y=33>. Inside every posture only a single subset, e.g. a subset of maxima (high pressure points) is necessary to define an alignment marker(s). These high pressure areas correspond to body skeletal structure and the current posture. Sensor array is typically an array of 64×32=2048 sensors, or 128×64=8192 (8K) sensors. Each plane is formed by a distinct posture, the 4 basic postures are Prone, Supine, Left, Right or intermediate postures (such as Left Tilt, Right Tilt, etc.). When a person lies on the sheet sensor, a subset of these values correspond to the actual area in contact with the sensor, refer to
The relative numbers from the posture are used to determine where the pressure sensor values are assigned on the absolute co-ordinate system. By using a pressure signature of the reference and aligning the current pressure signature, since the posture is known, a complete map is assembled. This coordinate system allows us the attachment of various kinds of metadata, associated with that body part.
In a system of posture, the postures represent the pressure incident on the human body, see
In the system, the raw signal is captured for subjects on a sheet sensor capable of capturing pressure incident on the subject. This signal is represented as a matrix [Sraw]m×n, which is then subjected to calibration, denoising and other preprocessing. Then, the maxima(s) and minima(s) are identified for each row of the matrix, as shown in
The geometry of the sensor array has a predetermined orientation, relative and absolute distances and hence the sensor spacing is known for each individual sensor. Using the array positioning as a Cartesian co-ordinate system, the locations for each of the points is mapped and individual computed, i.e. the points and distances {a, b, c, d, e, f, g, h, i, j}. For every input frame, each value is measured using simple Euclidean distance to determine similarity and the orientation of the body is computed. Using the data, this system can determine identity, postures, and mapping the pressure values to human body.
Similarly, the points to the human body can be mapped by aligning the pivot points on the input frame to the pivot points of template (of the matching posture), this will map and compare all the points on to the human body in absolute terms or relative to the template.
Any signature disclosed can be calculated by a plurality of methods, e.g. Calculate all extrema, calculate a reference such as the centroid or the inclination line running through the centroid.
Referring to
Referring to
Furthermore, the relative and absolute orientation of individual sensors in the array can form a representation of the human body, including separate limbs, core components of the torso, or essentially any element of the anatomy or physiology that would adventitiously feature placement of a sensor for data collection.
The sensor array formed in
Alternate Embodiment of Improving Classical Pressure Sensor.
A classical pressure sensor as in US 2012/0323501 A1 (See FIG. 9) typically depends on uniformity of the piezo sensitive material to implement a repeatable sensor. The various variables such as volume resistance, surface resistance, etc. In practice, it is difficult to achieve high degree of uniformity with the piezo sensitive materials especially over large areas. Additionally, this sensor is prone to hot spots on account of material fatigue, etc. This embodiment improves the classical pressure sensor uniformity and the longevity and repeatability of this classical sensor. A multilayer arrangement for the PIEZO sensitive material is used. Rows are numbered R1 to Rn, Columns are numbered C1 to Cm, and the layers are numbered L1 to Lr, where n, m and r are arbitrary integers denoting the count of each item. These multiple piezo-electric layers drastically improve the practical performance of the sensor. It allows us to choose multiple layers each of which can be optimized for the desired characteristic. For example, if we desire high surface resistance, but the preferred volume resistance does not lend itself to reasonable fabrication, additional sheets are added with high surface resistance, and together this sandwich will yield the desired characteristic.
The invention further includes a method for decoupling the sensor array data. This decoupling method dramatically improves the quality of the sensor readings and greatly improves the utility of the sensor array.
The preferred embodiment of the sensor array is represented by
The resistance of the sensor elements is represented by rrc The circuit further includes an analog to digital convertor (“ADC”) capable of measuring voltage potential. A row is selected by applying a reference voltage (vref) to it, and a column is selected by connecting it to an ADC for measurement of its potential. Optionally, every row, every column, or both may be connected to a grounded pull-down resistor (rPR & rPC). Optionally, a grounded offset resistor (roff) may be connected in parallel to the ADC. If none is present, the ADC effectively measures across a column pull-down resistor instead.
This continuous sensor array reads a sensor element by addressing its row and column, rather than running a dedicated line to each individual sensor element as in a discrete array. Such a design can be more compact, cost-effective, and robust than a discrete array. However, without further processing, the value sampled by this arrangement less accurately reflects the underlying physical quantity it is intended to measure.
The problem is that the sampled quantity does not directly correspond to only the quantity transduced by the selected sensor element. Rather, it is affected by all the other sensor elements in a complex way. The fact that multiple sensors share the same conductive strips results in unwanted electrical interference between the sensors. The combined effect of the interplay of all other sensor elements along with pull-down resistors is referred to as “coupling”. There are methods, however, that allow the desired sensor element value to be recovered and the unwanted interference to be removed (“decoupling”).
When reading with a small offset resistor, the dominant problem is “phantoms” resulting from backward shunt currents, as illustrated in
Additionally, the use of pull-down resistors distorts the readings of the sensor values. The cumulative effect of even a modestly large number of them will be significant. These pull-down resistors must therefore be accounted for in attempting to reconstruct the decoupled signal.
The decoupling technique requires sampling all the sensor elements while holding the underlying element resistances constant. Preferably, the sampling and decoupling are performed in two distinct steps. First, the system rapidly scans the entire sensor array to capture raw data one frame at a time. The system then performs the decoupling and further processing in a second distinct step.
The decoupling process, detailed below, may be executed either by specialized hardware or in software on a general-purpose processor, and either on the acquisition device itself or on a separate device with greater computational power. The general-purpose processor may be part of a desktop computer, laptop computer, mobile telephone, or a tablet computer. This list is not exhaustive and other computers may be used. As the decoupling process demands a great deal of computational power, standard mathematical and computational techniques are applied to maximize its efficiency.
The decoupling process depends fundamentally on a coupling model, derived by assuming an ideal sensor circuit as shown in
The solution, according to this coupling model, giving A in terms of G for the general case, can be expressed as follows. First, where gpc is the conductance of the pull-down resistors rPC, let:
Where gPR is the conductance of the pull-down resistors rPR, let:
Further let gr be the vector formed from row r of the conductance matrix G. Please note that qr−1 is the reciprocal of qr. Then let the matrix Ψ be equal to:
If Ω is the inverse of Ψ, then we may define a matrix S as the product of G and Ω. Computing S may be performed efficiently by in-place Cholesky decomposition.
Ω−Ψ−1
S=GΩ
Each entry of A, αyx, may be found by performing the following calculations. The variable y denotes a row and x denotes a column. Let ω represent the entries of Ω. Please note that qy−1 is the reciprocal of qy.
In the case where there is no offset resistor, the computation can be simplified:
a
y
=z
y
s
y
In the case of no pull-down resistors, the above solution encounters a singularity, but an alternative slower calculation may be used. Let φy represent the entries of Φy.
The desired quantity is ultimately G, the conductance of the sensors. G may be obtained by sampling A. Since direct computation is impractical, the technique is iterative. First, a candidate solution for G is obtained. Using the coupling model and the candidate solution G, a predictive matrix A is generated. After directly sampling the sensor array, the real value of A is compared with the predicted value. If the difference between the two matrices is small enough, the candidate solution G is accepted as the solution. Otherwise, G is refined by the following iterative process.
The iterative process uses the coupled image F, where each element frc of F is straightforwardly related to the measured arc by:
F is a representation of the coupled image. G is the non-coupled conductance image. Using the coupling model as described above, it is possible to create a coupled conductance function (7G) for a given non-coupled conductance image G. That is, there is a function C(G) such that F equals C(G).
The starting point of the iterative process is to scale F so that coupling yields the same sum of elements. The sum of the absolute value of each entry within the F matrix is denoted by ∥F∥1, and likewise, the sum of the absolute value of each entry within the C(F) matrix is ∥C(F)∥1. A parameter α may be tuned to optimize convergence. How to tune α will vary on the circumstances and application. In the simplest case, α is set equal to one.
Subsequent iterations of G are computed in the following way, essentially subtracting out the scaled difference from the expected result:
The parameter β may be one in the simplest case, or it may be selected to emphasize either speed or the likelihood of convergence. β closer to zero will converge more slowly but will reduce the risk that G fails to converge to a suitable value. If any individual iteration overshoots too far, yielding a result that moves farther away rather than closer, that iteration may be modified with successively smaller values for β (e.g., cut in half each time) until that is no longer the case.
Convergence can be considered complete, the iterative process terminated, and Gi accepted as the solution, when C(Gi) is sufficiently close to F by some measure. That is, a tolerance e is chosen, whether absolute or some fraction of the magnitude of F, such that a solution is considered acceptable when
∥F−C(Gi)∥1<ε
In some cases, due to noise, rounding error, or various other causes, the exact solution for G for a given F will contain negative values, which represents a physical impossibility because conductance cannot be negative. There are several ways of addressing this problem. The simplest is to set all negative entries to a non-negative number (such as zero) after completing the final iteration of Gi+1. Another method, which may yield truer results, is to set all negative entries to a non-negative number (such as zero) after each iteration. Since this may prevent full convergence, the convergence criteria may be adjusted accordingly to stop computing iterations when further progress from computing iterations starts becoming too small.
This application claims the benefit of U.S. Provisional Application No. 61/653,071 filed May 30, 2012 entitled “Pressure Signature Based Biometric Systems and Methods”; claims benefit of U.S. Provisional Application No. 61/653,307, filed May 30, 2012 entitled “Decoupling Using Forward/Backward Coupling”; claims benefit of U.S. Provisional Application 61/653,310, filed May 30, 2012 entitled “Wearable Sensor Assembly;” and 61/717,032, filed Oct. 22, 2012 entitled “Systems and Methods for Fluid Sensing,” which applications are hereby incorporated herein by reference in their entirety. This application is also related to PCT application PCT/US2013/043429 filed May 30, 2013, and entitled System And Method For Fluid Sensing, which application is incorporated herein by reference in its entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2013/043490 | 5/30/2013 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61653071 | May 2012 | US | |
61653307 | May 2012 | US | |
61653310 | May 2012 | US | |
61653313 | May 2012 | US | |
61717032 | Oct 2012 | US |