All publications and patent applications mentioned in this specification are herein incorporated by reference in their entirety to the same extent as if each individual publication or patent application was specifically and individually indicated to be incorporated by reference.
The present invention, in some embodiments thereof, relates to methods and apparatuses (e.g., systems) for determining a subject's measurements (e.g., garment “fit”) using non-contact techniques by examining images of the subject. These methods typically generate anthropometric measurements of the subject that may be useful for many purposes, including but not limited to assisting in fitting garments or other wearable devices.
Thus, the invention(s) described herein, in some embodiments thereof, may relate to communication, commerce (including e-commerce), garments, and more particularly to measuring an item or person using an image capturing device.
There are many instances in which it would be helpful to measure a subject's body remotely, or via non-contact means. In one (non-limiting) example, it would be beneficial to determine a subject's measurements (and therefore garment size(s)) when shopping online, or in other situation where it is not practical or desired to take conventional measurements. It is highly desirable to determine a garment (e.g., shirt, shorts, etc.) size which fits a subject well, which can be difficult when relying on the subject measuring themselves, guessing or requiring manual assistance.
Although techniques for determining a subject's measurements remotely have been proposed by others, such as, for example, U.S. Patent Application Publication No. 2013/0179288 to Moses et al., such systems and methods are not accurate or (as in the case with U.S. 2013/0179288), require an external reference object to define a scale and to correct distortions in the image acquired by the webcam to determine the subject's measurements. However, external reference items are often inconvenient or not available, and may not be properly positioned or selected by the subject.
Described here are apparatuses (e.g., systems and devices, including computer implemented apparatuses) and methods that address many of these issues. In particular, described herein are apparatuses and methods to evaluate a subject's size on the basis of anthropometric imaging that can be easily performed by any user with a PC/smartphone equipped with a camera/webcam. These apparatuses and methods may automatically scale and measure the subject, and may thereby determine the subject's sizing (e.g., apparel sizes). The apparatuses and methods described herein do not require any external reference object, but may instead uses one or more anthropometric parameters, such as interocular distance (IOD), that can be determined automatically. The inter-subject variability of IOD is very low and therefore should introduce an error (<5%) that is acceptable for the purpose.
In general, described herein are methods and apparatuses for automatically determining a subject's measurements using one or more images of the subject, where at least one image includes the subject's eyes so that an interocular distance can be determined. In any of the apparatuses (e.g., systems) and methods described, the interocular distance can be used to scale the image(s) so that measurements from the images can provide calibrated (scaled) measurements of the patient's body. These calibrated (scaled) measurements may then be used for any appropriate purpose, including estimating or otherwise determining a subject's garment size(s). Other purposes may include biometric (e.g., identity confirmation, etc.) and/or medical monitoring or identification.
In general, interocular distance may refer to the distance between a subject's eyes, typically measured face-on (e.g., in a frontal image). Interocular distance (IOD) may be interpupillary distance (IPD). Interpupillary distance (IPD) may refer to the distance between the centers of the pupils of the two eyes, and may help determine the stereo separation of the two images which are combined in the brain to produce stereo perception. Surprisingly, the inter-subject variability of IOD is very low and therefore should introduce an error (<5%) that is acceptable for the scaling/normalizing purposes described herein.
Although a single average (mean) IOD may be used to calibrate as described herein, in some variations the apparatuses or methods may select the appropriate mean IOD based on other factors, including age, race, sex, or the like. In general, any appropriate estimate for mean IPD (IOD) may be used. For example, mean IPD has been quoted in the stereoscopic literature as being from 58 mm to 70 mm, and is known to vary with respect to age, gender and race. According to some literature values (e.g., Dodgson, N. A. (2004). Variation and extrema of human interpupillary distance. Proceedings of SPIE: Stereoscopic Displays and Virtual Reality Systems XI, Vol. 5291, pp. 36-46), mean adult IPD is around 63 mm (>17 years old); by gender, the mean is 64.67 mm for men and 62.31 mm for women.
Thus, for example, described herein are methods of automatically determining measurements (e.g., garment sizes) for a subject using a computing device having a camera, the method comprising: determine the subject's interocular distance from a frontal image of the subject; determine a scaling factor from the subject's interocular distance; determine measurements for the subject's body from the frontal image using the scaling factor; determining a correction function based on the distance between a plane of the subject's eyes and a plane of a subject's trunk or limbs; and provide an estimate of the subject's body measurements. These body measurement estimates may be used to determine garment size(s); thus the method may also include providing estimates of garment sizes using the measurements.
Any of the methods described herein may be methods of automatically determining garment sizing for a subject using a computing device having a camera, the method comprising: receiving a frontal image of the subject including the subject's eyes; determining a scaling factor from the subject's interocular distance; scaling the frontal image using the scaling factor; determining measurements of the subject's body from the scaled frontal image; and providing an estimate of the subject's garment size using the scaling factor and subject's measurements.
In general, any of the methods described herein may include determining a correction function based on the distance between a plane of the subject's eyes and one or more other plane of a subject's body; the other plane may be the plane of or tangent to the portion of the body that is to be measured (e.g., shoulders, torso/chest, waist, etc.). The correction function (ƒ(x)) may be be a function of the spacing between the plane of the subject's eyes and the other plane (where the distance is x). The function may be linear (e.g., f(x)=C*x, where C is a constant, such as a value between 0.1 and 0.95). The function may also be based on a surface fitting model, or may be fitted from a curve based on empirical values. The function may be first order, second order, third order, fourth order, fifth order, sixth order, etc. In some variations the function may include root function (e.g., square root) of the distance between points (d1 to d2) on the body and the distance, x, between the planes.
In general, using the scaling factor and correction function may comprises adding the correction function to the scaling factor (e.g., scaling in distance units/pixel may be equal to scaling factor+ƒ(x)). The distance units may be any appropriate distance units (matched to the units of the correction function, such as mm, inches, etc.).
Any of the methods described herein may use more than one image of the subject. In general, at least one image (a first image) shows the subject's body including at least the eyes and one other body part (e.g., the head), from which IOD may be determined to determine a scaling factor. Dimensions (measurements) of the other body part (e.g., head) may then be calculated from the first image and used to scale any other (e.g., second, third, etc.) images that include at least the one other body part, by using the calculated dimensions of the (scaled) other body part to scale the other images. The first image may generally be a frontal image (or at least the front of the face) so that the IOD can be estimated. The additional images, e.g., second image, typically show other angles or views of the subject's body, including the sagittal (side), back, etc.
For example, described herein are methods of automatically determining garment sizing for a subject using a computing device having a camera; any of these methods may include: receiving a frontal image of the subject including the subject's eyes and a first body part; determining a scaling factor from the subject's interocular distance; receiving a second image of the subject including the subject's first body part, wherein the second image is taken from a perspective different than the first image; scaling the frontal image including the first body part using the scaling factor; scaling the second image using a dimension of the scaled first body part; determining measurements of the subject's body from the scaled second and frontal images; and providing an estimate of the subject's garment size using the measurements.
Any or all of the methods described herein (including some or all of these steps) may be performed by a computer processor, e.g., microprocessor. In particular, these methods may be performed by software, firmware, hardware, or some combination thereof. Any of these methods may be performed, for example, as part of an executable (non-transient) program, or “application” that may configure the processor of computer, including particularly a mobile telecommunications device such as a smartphone, tablet (e.g., iPhone™) or the like.
Any of these methods may also include the step of taking the one or more (including the frontal) image of the subject. The method may automatically recognize the subject's eyes. Determining the scaling factor may comprise determining the distance between the centers of the subject's pupils, the distance between a “center” of the eyes, or the like.
Any of these methods may also include the step of receiving one or more of: a subject's age, gender, and race; as mentioned above, these parameters may further refine the reference IOD used to normalize the image(s). For example, determining the scaling factor may comprises using the subject's interocular distance (IOD) and one or more of the subject's age, gender, and race, e.g., by selecting a reference IOD based on one or more of the subject's age, race and gender (sex).
Scaling of the second image may comprise using the scaling factor to determine a size of the first body part from the frontal image and scaling the first body part in the second image using the size of the first body part from the frontal image.
Also described herein are non-transitory computer-readable storage medium storing a set of instructions capable of being executed by a computing device, that when executed by the computing device causes the computing device to determine a subject's body measurements from one or more images of the subject using the IOD to scale the images.
For example a non-transitory computer-readable storage medium storing a set of instructions capable of being executed by a computing device, that when executed by the computing device causes the computing device to determine a subject's interocular distance from a frontal image of a subject that includes the subject's eyes; determine a scaling factor from the subject's interocular distance; determine measurements of the subject's body from the frontal image using the scaling factor; and provide an estimate of the subject's garment size using the measurements. As mentioned, the computing device may be a smartphone. The set of instructions, when executed by the computing device, may further cause the computing device to take a frontal image of the subject and/or additional images of the subject, and/or guide an operator (e.g., the subject) in taking the appropriate images.
The set of instructions, when executed by the computing device, may further cause the computing device to automatically recognize the subject's eyes. The set of instructions, when executed by the computing device, may further cause the computing device to determine the scaling factor using the subject's interocular distance and one or more of the subject's age, gender, and race.
In some variations, a non-transitory computer-readable storage medium storing a set of instructions capable of being executed by a computing device, that when executed by the computing device causes the computing device to: determine a subject's interocular distance from a frontal image of a subject that includes the subject's eyes; determine a scaling factor from the subject's interocular distance; determine a scaled dimension of a first body part from the frontal image of the subject and the scaling factor; scale a second image of the subject using the scaled dimension of the first body part; determine measurements of the subject's body from the frontal image using the scaling factor and the scaled second image; and provide an estimate of the subject's garment size using the measurements.
For example, described herein are methods of automatically determining garment sizing for a subject from a video of the subject, the methods comprising: determining the subject's interocular distance from a frontal image of the subject in the video; determining a scaling factor from the subject's interocular distance; using the scaling factor to determine measurements for the subject's body from a plurality of images of the subject's body extracted from the video; and providing an estimate of the subject's measurements appropriate for garment sizing.
Any of these method may include: receiving a video of the subject, wherein the video includes at least one frontal image of the subject including the subject's eyes, frontal images of a portion of the subject's body to be fitted, and side images of the subject's head and portion of the subject's body to be fitted; determining a scaling factor from the subject's interocular distance; using the scaling factor to scale the images of the subject's body; determining measurements of the subject's body from the scaled images; and providing an estimate of a garment size using the subject's measurements.
For example, a method of automatically determining garment sizing for a subject from a video of the subject may include: receiving a video of the subject, wherein the video includes at least one frontal image of the subject including the subject's eyes, and a plurality of images of the portion of the subject's body to be fitted, including frontal and side images; determining a scaling factor from the subject's interocular distance to convert image space measurements to distance measurements; measuring the portion of the subject's body to be fitted from the video; scaling the measurements using the scaling factor; and providing an estimate of the subject's measurements appropriate for garment sizing using the measurements of the portion of the body to be fitted.
Any of these methods may include automatically recognizing the subject's eyes. Determining the scaling factor may include determining the distance between the centers of the subject's pupils. In some variations the pupillary size (distance) may also or alternatively be used.
Any of the methods described herein may also include asking and/or receiving one or more of: a subject's age, gender, and race; further, one or more of age, gender and race may be used to estimate the scaling factor based on interpupilary distance (interocular distance) by selecting a value for the subject's actual interpupilary distance based on published values linked values within an age, gender and/or race matched group. For example, determining the scaling factor may generally comprise using the subject's interocular distance and one or more of the subject's age, gender, and race.
In any of the methods described herein, the video may comprise a continuous video scanning the subject's body including frontal and sagittal regions. As used herein a continuous video means a video that is taken without interruption, so that each frame is separated from each other by a predetermined time unit.
Providing an estimate of the subject's measurements appropriate for garment sizing may include providing measurements for one or more of: shoulder length, arm length, arm circumference, neck circumference, upper torso circumference, lower torso circumference, wrist circumference, waist circumference, hip circumference, inseam, and thigh measurement, calve measurement, etc.
Any of the methods described herein may also include providing a garment adapted to fit the subject's estimated measurements. The garment may be a stretch fabric (e.g., compression fabric) garment. In some variations, the garment may include one or more electrical elements, such as sensors and other chips, wires, or the like. Thus, any of these methods may also include determining a location for one or more biosensors to be integrated into the garment using the subject's measurements. Sensors may include electrodes, which may be specifically positioned over a subject's muscles (e.g., pectoral, bicep, etc.) for EMG measurements, and/or over the subject's heart in specific (e.g., 12-lead ECG) positions, and/or over the subject's chest (e.g., respiration sensors).
Thus, also described herein are methods of automatically determining garment sizing and positions for one or more biosensors on the garment from a video of a subject, the method comprising: determining the subject's interocular distance from a frontal image of the subject in the video; determining a scaling factor from the subject's interocular distance; using the scaling factor and a plurality of images of the subject's torso from the video taken at different angles to determine measurements for the subject's torso; and providing measurements for a compression garment to be worn by the subject using the measurements of the subject's torso, and indicating the locations for one or more biosensor to be integrated into the compression garment.
Thus, providing the measurements may comprise indicating the locations of a plurality of ECG electrodes to be integrated into the compression garment. In some variations, providing the measurements comprises indicating the locations of a plurality of respiration sensors to be integrated into the compression garment.
Also described herein are apparatuses for performing any of the methods described herein. For example, an apparatus may include software, hardware or firmware configured to control a device (e.g., a hand-held device such as a smartphone, tablet, laptop or the like) to perform any of the functions described herein. In some variations, a non-transitory computer-readable storage medium storing a set of instructions capable of being executed by a computing device, that when executed by the computing device causes the computing device to: determine the subject's interocular distance from a frontal image of a subject in a video; determine a scaling factor from the subject's interocular distance; use the scaling factor and a plurality of images of the subject's body extracted from the video to determine measurements for the subject's body; and provide an estimate of the subject's measurements appropriate for garment sizing.
The set of instructions, when executed by a computing device, may cause the computing device to provide garment sizing information for a compression garment having one or more biosensors integrated therein. For example, the biosensor may comprise a plurality of ECG electrodes, and/or a plurality of respiration sensors.
The set of instructions, when executed by the computing device, may further cause the computing device to automatically recognize the subject's eyes, and/or determine the scaling factor using the subject's interocular distance and one or more of the subject's age, gender, and race, as discussed above. The set of instructions may further cause the computing device to use the scaling factor and a plurality of frontal and sagittal images from the video of a portion of the subject's body to determine measurements for the subject's body.
Also described herein are non-transitory computer-readable storage medium storing a set of instructions capable of being executed by a computing device, that when executed by the computing device causes the computing device to: determine the subject's interocular distance from a frontal image of a subject in a continuous video of the subject's head and body including at frontal and sagittal views; determine a scaling factor from the subject's interocular distance; use the scaling factor and a plurality of images of the subject's body extracted from the video to determine measurements for the subject's body; and provide an estimate of the subject's measurements appropriate for garment sizing of a compression garment including a biosensor sensor.
Any of the apparatuses or methods described herein may be configured to automatically (e.g., without additional human intervention) transmit the measurements determined directly to a fabrication device for manufacture of the garment, along with identifying information (e.g., name address, etc. for delivery). For example, a fabrication device may include a fabric cutter (e.g., a laser machine that will cut the fabric), a robotic device (robot) that may position the components, and particularly electronic components (e.g., sensors, wires, pcb, etc.), or a 3D printer that will produce the garment. In some variations the measurements may be encoded as manufacturing-device readable instructions for manufacture.
In addition, any of the methods described herein may including steps of taking the video and/or guiding the user to take the video. For example, as described in greater detail herein, a method may include a step of instructing the subject how to position the camera for taking the video. The methods and apparatuses may also include reviewing (after the video is taken or while it is taken) the video to confirm that there are sufficient views to take accurate measurements.
Any of the steps described herein may be performed remotely, e.g., by a remote server. For example, any of the steps may be performed by a remote server that analyzes the video. Because the analysis and calculation of the scaling factor, as well as the steps for determining measurements are processor-intensive, and my therefore require processing time and power that exceeds currently available mobile devices (e.g., smartphones), these steps may be performed remotely or in a distributed manner.
Described herein are apparatuses and methods for non-contact (and remote) measurements of a subject's body that are automatically and scaled without the necessity of an external (non-intrinsic) reference. Specifically, described herein are apparatuses, including methods and devices, that use interocular distance to automatically scale one or more images to measure the dimensions of a subject's body to provide sizing information for garments (e.g., clothing).
For example, described herein are method and apparatuses (including systems and devices) to calculate precise body measurements of a potential customer in order to ensure best possible fit of apparel components (e.g., shirts, shorts, thighs, gloves, socks, hats, balaclavas, etc.) or the optimal location on the subject's body for a device and/or garment (e.g., a collar or other component). In particular, described herein are methods of automatically determining body measurements in order to provide a fitted garment (and particularly a fitted compression garment including one or more electronic biosensors) to a subject.
In general, these methods may use a video of the user that includes images of the users head (including the eyes) and at least the portion of the body onto which the garment will be worn (e.g., from the waist to the neck for shirts, from the waist down for pants, etc.). The video may be taken as a single (continuous) video of the subject, including the front views, at least one side, and optionally the back (e.g., in a mirror or directly). The video may be taken by the user herself/himself, or it may be taken by a third party. The video may be taken, for example, using a smartphone.
In some variations the apparatus described herein may include an application (e.g. software or firmware) for controlling a computing device, such as a handheld computing device including a smartphone, tablet, etc. that includes a camera. The apparatus (e.g., application) may guide the user in taking the video, may pre-review the video to confirm it is adequate, may edit the video to remove unwanted portions, and may alert the user if the video is not sufficient.
Typically, the system automatically recognizes the two medial canthi of each eye and calculates their distance in pixels from the image showing the eyes (e.g., a frontal image). This measured distance may be transformed or correlated from pixels into known units of length (e.g., mm, inches, etc.) on the basis of known mean anthropometric parameters, such as interocular distance (IOD). In this manner, the systems and methods do not need any outside reference object in order to calibrate/scale the images. Because the inter-subject variability of IOD is very low (see, e.g., Dodgson, N. A. (2004). Variation and extrema of human interpupillary distance. Proceedings of SPIE: Stereoscopic Displays and Virtual Reality Systems XI, Vol. 5291, pp. 36-46; and Smith, G., & Atchison, D. A. (1997). The eye and visual optical instruments. Cambridge UK: Cambridge University Press) the use of a predetermined reference IOD such as 64.67 mm for males and 62.31 mm for females, may be sufficiently accurate, particularly for sizing garments, and may introduce little error (<5%).
Thereafter, the conversion factor (which may be referred to as a principle conversion factor or an IOD conversion factor may be used for all of the images in the video to covert pixels (virtual distance) to actual measurements (in distance units, such as mm, inches, etc.); when switching between the video images, the method (or any apparatus implementing the method) may also generate and/or use a second conversion factor for adjusting between video images (e.g., as the camera is moved, etc.); the second conversion factor may be used to normalize the pixel sizes between images, and then the primary or IOD conversion factor may be applied as well. By using a continuous video (e.g., taking uninterrupted video) this may be made conceptually easier. In addition, the use of continuous video may allow for virtual rotation of the individual to accurately project the subject's torso onto a normal measurement space which may reduce or eliminate errors due to viewing angle of the video images.
Thus, in general the images taken herein may be taken by one or more of a photo/video-camera on a smartphone, a photocamera, a videocamera, a webcam, or the like. In the examples described herein a video camera is used rather than a photo camera. The use of video allows the apparatus to easily determine the sequence from one frame to the next in terms of time and position between one frame to the previous or the next one. This is less reliable when performed from a sequence of non-video photos since it is difficult to calculate the time and position distance from a shot to the next. Video may also allow determination of complex measurements over highly contoured body regions (e.g., that enabling the apparatus and method to fit a shirt or pair of tights).
In any of the methods described herein, the video should generally include at least one (though multiple are preferred) image of a frontal view including the eyes and a lateral view including the head. In addition, it is helpful to provide continuous frames of imaging transitioning between these images, as well as multiple images of the body region to be measured (e.g., torso, for shirts, etc.) from multiple different angles. From these information, the calculated the size ratio (calibration factor) in mm/pixel may be determined.
Thus, the same images may also show all the body segments that are needed to be determined in order to take all the sizes, e.g. the width of the shoulder, the length of the arms, the width of the trunk, the width of the neck, etc. These images may then be used to project measurements of these body regions based on the video, and the conversion factor (IOD conversion factor) may allow these virtual measurements to be converted into real units (mm, inches, etc.). This may allow the method and apparatuses using these methods to correctly fit shirts, tights or other types of garments rather than simple accessories such as glasses, bracelets, watches, necklaces, belts, etc. Thus, although garments such as shirts and parts complex (and substantially more complex than jewelry and accessories such as glasses) because they cover a much wider part of the body and because there are more variances from person to person (for example a shirt could fit two difference persons as far as shoulders and arms measurements but not in stomach or chest dimensions that could present extreme variations), the methods described herein may be used to accurately determine sizing. Furthermore computerized sizing/fitting of compression garments and/or garments including electrical/electronic components such as sensors present added challenges to fitting of traditional clothes because of their enhanced functionalities: for example, they may include many sensors to gather physiological data, which may need to touch the skin where the signal is strongest. In some variations, a garment including ECG sensors (e.g., ECG electrodes) must be correctly placed near the heart a complex area since it presents substantial variances due to different sizes and positions in men's pectorals or women's breasts. Those sensors also need to function mostly in movement thus they need to be positioned in a way that they can continue to record reliable data even when changing position because of body parts movements. In addition, while traditional apparel are made of ‘soft’ material such as fabric, cotton, wool, etc. “smart” garments including integrated electronics may include also ‘hard’ materials such as wires, microchips, connectors, PCB, etc. or other ‘hard’ components that are not comfortable to wear. Thus to minimize discomfort it is important to locate and properly measure those parts of the body where those ‘hard’ materials/parts should best be located, as described herein.
One challenge in automatically determining sizing is in preparing the correct and appropriate input images. For example, one challenge of such a system that may automatically measure a body region for a garment is that the images should be easily taken by the user himself or herself, without the need for complex equipment, such as dedicated instruments to take body size measurements. Described herein are simple methods for performing these automatic measurements that may be based on devices which may be generally available to most individuals (e.g., general-purpose smartphone, photo/video cameras, webcam, etc.). Further, as another parameter, the methods descried herein may be completely automatized methods, which do not require any user intervention and that provides all final measurements in a completely automatic manner.
In general, these methods may be used to measure for garments that normally cover parts of the body that are traditionally difficult to measure virtually, such as shirts (upper body), hoodies (upper body and head), slacks and pants (lower body including thighs, buttocks, etc.); gloves (wrists and hands), socks (ankles and feet), balaclava (neck and head), etc.
In addition, the video methods described herein may also be used to measure parts of the body in movement. These methods and apparatuses may calculate the measurements to maximize the fit and the comfort of the garment, and may filter the measurements so that they can maximize fit and comfort while accepting users fashion desires.
Finally, these method and apparatuses are particularly helpful for configuring and fitting so-called ‘smart’ garments which may electronic components integrated into the garment, including one or more sensors (e.g., “biosensors”). For example, these methods and apparatuses may, in addition to determining fit, determine the correct sensors positioning after defining the garment measurements based on the body dimensions. Some sensors, such as ECG and EMG electrodes, must be precisely positioned in specific parts of the body in order to acquire a meaningful physiological signal. For example, pairs of EMG electrodes should be precisely placed on each muscle, to avoid noise coming from other close muscles. Similarly, ECG electrodes should not be placed on muscles such as pectorals in order to avoid the EMG noise that could override the ECG waves. Positioning of these sensors may therefore be important (e.g., for skin conductance sensing, sensors may be located from arm pits to latissamus muscles, while for EMGs, sensors may be positioned near the center of biceps).
In any of the variations described herein, the video of the subject's body may be taken so that it includes at least one image in which the eyes (in frontal images) and the head (in lateral images) are clearly framed. In addition, it would be useful to take video including these views and stay in a position which is at sufficiently ‘frontal’ or ‘lateral’ with respect to the sensor of the photo/video-camera, and to allow the photo/video camera to frame all the body segments which are needed to customize the garment, and specifically multiple views of the body regions over which the garment is to be worn (e.g., to customize a shirt, it is needed to have all the trunk, the arms and the neck).
In general, any of the apparatuses and methods described herein may be configured to take images of the head, including the face and in some variations the side of the head, to determine a scaling factor, but the same video may also provide images of the body regions, generally the trunk and/or limbs, that are being fitted automatically as described herein. The subject's trunk may generally refer to the person's body apart from the limbs and head, and may specifically include the chest, shoulders, abdomen, back, waist, hips, crotch region, buttocks, etc. The limbs typically include the arms and legs.
For example, any of the method and apparatuses described herein may include taking the video and/or instructing the user (subject) in a way to take the video to acquire the images used. As mentioned above, in some variations instructions may be provided in which the user is instructed to take a video to have, in at least one image, and preferably more images, the information described above (e.g., frontal views including the face and eyes, and body region to be fitted, transitioning to/from side/sagittal views including the head and body regions to be fitted.
In some variations the method, or an apparatus for performing the method, may include instructing a subject to take the video themselves. As mentioned, the subject may be instructed to take the video either without clothing over the region to be fitted, or in tight fitting and/or minimal clothing. For example, for measuring the torso, the subject may be instructed to remove any loose upper body clothing (e.g. ideally they should be nude and/or wearing only tight underwear or a bra, alternatively, wearing a tight compression shirts and compression tights, or less optimally, wearing a tight shirt and tight pants). For privacy sake, the video may be encrypted to prevent viewing by third parties, and the user may be provided information indicating confidentiality. In some variations the system is configured so that the video is erased or otherwise destroyed after determining measurements. In some variations the video may be modified before transmitting remotely.
For example, in some variations the video may be analyzed locally (e.g. on a handheld device such as a smartphone) to determine the interocular distance and a scaling factor before transmitting the rest of the video, including the body (e.g., all or a portion of the truck and/or limbs) to a remote server for later analysis; however the video may be modified to remove the subject's head and/or face, or to obscure the subject's head and/or face, prior to transmitting the video, e.g., to a remote server for analysis. In this example, the scaling factor and/or the interocular distance may be indicated on one or more frames of the video so that body measurements generated from the video can be properly scaled.
In one variation, the subject may be instructed to perform a series of movements to capture a continuous video with the images useful for the methods described herein. As mentioned above, in some variation the apparatus may talk the user through this process, for example, providing audible guidance to the user as they hold the video device and take the images.
In one variation the subject may be instructed to hold the video camera (e.g., phone camera, etc.) with two hands in front of them (in order to have even shoulders position, rather than holding the video camera with only one hand), with their arms extended as forward or as far as possible. This may allow them to film a larger part of the body, and may include the head and face, neck, shoulders, and upper body, including down to the belly region. The subject may tilt the video camera (e.g., phone) to capture the face and body in the video. The subject may be instructed to hold the video camera as parallel to the body as possible, for between 1-5 seconds (e.g., 3 seconds). The subject may then be instructed to hold the video camera in the right arm (e.g., straight out from the body), and lift the left arm from the side of the body and up as straight as possible to be parallel to the body, and held for 1-5 seconds (e.g., 3 seconds). Next, the user may be instructed to take the video camera in their left hand and hold the camera out from the body and move their right arm, raising the right arm from the side of the body up to a position straight out and parallel from the body (and held for 1-5, e.g., 3, seconds). The subject may then be instructed to lower the right arm and rotate the extended the left arm to their side, holding the camera parallel to the floor and in the same plane as the front of the torso to film the left side of the head, and then in a continuous movement bend your elbow to touch the trunk so as to film the left side of the head and the left shoulder. This step may be repeated with the camera a in the other hand to film the right side of the head and of the right shoulder. The subject may then bet told to bring the right arm (holding the video camera) in front of the body to take hold of the video camera with both hands again to return to the initial position and hold for the appropriate time (e.g., 1-5 seconds, such as 3 seconds). The user may then be instructed to, while preserving video camera position parallel to the body, lower it to record rest of the front lower-trunk to include upper legs (and hold for 1-5, e.g., 3 seconds). Users may also be instructed to stand with their back facing a mirror and to take a 3 seconds video of their back of the body: head, shoulders, upper trunk and lower trunk all the way down to back of upper legs. The total video typically takes no more than 20 seconds. Movements should be as steady and continuous as possible. To facilitate the operation users can play a tutorial video from the smartphone (e.g., if using an application on the smartphone) or be guided to a website providing a guide of the movements).
In some variations the user may work with a third party to take the images. The images may be similar to those taken as described above, except that user may start in a “crucifix” position, with arms as extended as possible, then rotate the arms form the side to over the head, lower the arms along the body and rotate the entire body 90° to the left for a video of the left side of the body, and further rotate the body to the left by 90° to be taken a video of the back. From the back, both arms may be lifted into the ‘crucifix’ position and then the arms may be lifted in an extended parallel position over the head, the hands may be lowered along the body, and the body may be rotated by 90° to the left for a video of the right side of the body.
Other movements for imaging the body either by a third party or by the user alone (and/or in front of a mirror) may be used. Generally, it is important that as much of the region of the body to be covered by the garment be imaged in the video as smoothly as possible, without stopping (introducing discontinuities in the video). In some variations the apparatus may detect problems with the video (e.g. focus, magnification, lighting levels, etc.) or may perform some image processing (e.g., detecting body position, separation of the body from background, etc.) and may instruct the subject to adjust or re-take the video accordingly.
The video may then be transmitted to a remote server (e.g., over an internet connection) for automated analysis, and/or analyzed locally (e.g., on the smartphone or computer). In some variations the apparatus may include one or more functions to allow automatic uploading of the video, including securing the transmission (e.g., by encryption, etc.). In some variations the video may be analyzed to determine the quality prior to transmission, so that the subject may be instructed to take another image. Quality may be improved by using high resolution cameras, using more frames to calculate an average size ratio (mm/pixels) instead of a single image, and/or by automatic detection and/or recognition of body features (face, eyes, head, torso, etc.) to confirm the video includes sufficient views. In general, the subject may be provided with instructions in order to improve image acquisition.
As used herein, a server may refer to an application (e.g., software, firmware, etc.) capable of accepting requests from a client and giving responses accordingly. Servers can run on any computer, including dedicated computers, which individually are also often referred to as “the server”. A computer can have several servers running simultaneously. The server maybe run on a dedicated computer. Client devices (e.g., remote devices) may connect to a server through a network but may run on the same computer. In the context of Internet Protocol (IP) networking, a server is a program that operates as a socket listener.
In any of the variations described herein, the user may also provide the apparatus with additional information (e.g., gender, height, weight, etc.), which may be used by the method to refine the analysis, including the determination of a scaling factor from the interocular distance.
The video images may be filtered by digital filters in order to enhance the contrast between the body and the background, and/or to eliminate image noise. These methods may also allow the user to acquire multiple images from multiple points of views. Measurements obtained through video may be filtered through existing libraries of body measurements to further refine the measurements.
When additional information (e.g., height, weight, gender, etc.) are included, this information about the user may help to improve the measuring process. For example, weight, height and age can help the system to pre-assign the user to a specific anthropometric measurements cluster, in order to filter outliers and false positive given by external sources of noise that could affect the measurements (e.g. low light, blur).
In general, the program requires just one tool on the user's side: a device that can record video, handle basic video processing and get access to the Internet. For instance this device could be represented by the user smartphone.
Video processing may be performed in parts, for example, normalizing the video images to be used to each other and in particular to the image(s) used to determine the scaling factor from the interocular distance, and/or projecting or calculating surface dimensions providing measurements of the subject's body. For example, the video processing 111 may include determining dimensions of the surface of the subject's body (e.g., by modeling and/or reconstructing a model of the subject from the video images), and then using the dimensions and the scaling factor (or alternatively, but scaling the model and/or images forming the model first, so that the dimensions are already expressed in the correct units) to determine a measurement for the body in real-world units 117 for length or areas (e.g., inches, cm, etc.). In some variations the methods and apparatuses for using them may alternatively convert these measurements into garment sizes, including standard or custom sizing units. As described in detail herein, any of the methods and apparatuses for performing them described herein may optionally include defining optimal positioning for electrical components 119 used in wearable electronics, such as sensors (e.g., electrodes, etc.), wiring (e.g., conductive traces, inks, etc.), processing elements (chips, circuits, processors, etc.), and connectors (multi-pin connectors, etc.).
Further, any of the methods and apparatuses described herein may transmit the measurements directly to a fabrication device 121. For example, any of these methods and/or systems may be connected or connectable (including directly connected or connectable) to one or more fabrication devices, such as 3D printers, laser cutters, sewing machines, etc.
In variations in which sensors will be positioned on the body, the sensor positions may be located onto the device in predetermined locations relative to body landmarks (e.g., pectoral regions, etc.). For example,
Similarly,
As described herein the main processing stage used to determine the body measurements and calculate the garment dimensions may be handled by a server-based program. Thus, this may be done after recording the video. The server-based program may process the video without any additional requirement for the subject and may ensure a cross-platform compatibility (because the core processing will not be dependent by different OS and hardware architectures). However in some variations, the processing may be done at least in part, if not entirely, locally (e.g., in the smartphone, laptop, desktop, etc.).
Further, even if processing of the video is done remotely, some basic checking and calculations may be performed in real-time by the part of the program responsible for recording the video, thus on the tool required on the user side, as described above. For example, the apparatus may tell the subject if the setup (e.g. environment light, image quality, blur) is suitable or not for this application. In case any parameter does not fulfill the expected requirements, the program may give instruction to the users on how to improve the setup.
After automatically checking environment parameters, the user may be allowed or instructed to start recording the video by following one of the procedure above. To facilitate the operations, users may be able to play a tutorial video that will guide them through all the necessary video steps. During the whole recording phase, other processing stages may be performed by the apparatus. For example, the apparatus may implement a face (and head) recognition feature to help the users to correctly acquire the video. In addition, this may also continuously check for some recording parameters such as blur or video stability. These parameters could affect the server-based processing, thus the users may be notified in case one of them will exceeds the expected ranges.
Once the video recording is complete, the video may be uploaded to a remote server, where it will may processed to determine the body measurements and determinate the garments sizes following the steps shown in
When fitting for garments including electronics (e.g., wearable sensors and/or electronics), once the garment sizes are determined, the program may continue to the last processing phase in which the garment dimensions and the body measurement are used to define model that will be used to determine the optimal sensors positioning.
Any of the apparatuses (e.g., systems) and methods for performing non-contact automatic estimation of garment fit from visual (e.g. video or pictures) input may include input of at least: a subject's head and face, front profile, side profile and back profile. In some variations, these images (e.g., head and face, front profile, side profile and back profile) may be sufficient, although additional images (including overlapping images) may be used. In general the methods and apparatuses described herein may not require any external reference object (e.g., having a known dimension, such as a coin, credit card, etc.), but instead uses anthropometric parameters as a reference for measurements instead; in particular, the interocular distance (IOD), which can be determined automatically, may be used as a starting reference distance for the entire measuring process. The inter-subject variability of IOD is very low and therefore should introduce an error (<5%) that is acceptable for the purpose.
In any of the variations described herein, the system and apparatus may also determine a correction factor or scaling factor to correct for the spacing between different frontal body planes (e.g., different depth of field), based on an estimate of the distance between the frontal planes (e.g., a plane of the face, from which IOD may be estimated, and a plane of the gut and/or torso). The separation between these planes may be estimated from one or more profile images taken perpendicular to the frontal planes.
For example, as discussed above, the apparatus (e.g., system) or method may first estimate the intraocular distance analyzing a picture (or video frame) in which the subject's head and face are placed right in front of the camera. The system or method may then (e.g., automatically or manually) recognize the subject's eyes and calculate the IOD in pixels. Knowing the average IOD in millimeters, a scaling factor (e.g., mm/pixel) may then be calculated as discussed and illustrated above. This scaling factor may then be used as a reference to estimate other anthropometric distances (e.g. the height/width of the head) that can be also used as a reference distance for other measurements.
After analyzing a picture of the subject's head and face, the method (or a system implementing it) may also analyze other pictures in which at least the subject front profile, side profile and back profile are shown. Considering that different anthropometric distances have already been estimated (e.g. the height/width of the head) they can be used as a reference distance to calculate new scaling factors when analyzing pictures of the subject front profile, side profile and back profile. For instance, the width of the head (which may be calculated in millimeters during the analysis of the head and face based on the IOD-determined scaling factor) may be used to calculate a scaling factor for analyzing the back profile. This new scaling factor may then be used to estimate the width of the shoulders and other anthropometric distances within the subject's back profile. Even though the system is able to calculate and use different reference distances (e.g. IOD, width or height of the head, etc.) to determine a series of translational scaling factors between different images, these measurements often refer to parts of the body placed on different planes (e.g., different frontal planes) or at different depth of field. As mentioned, an additional corrective or correctional factor based on the separation between different depth of field may be used.
For instance, when analyzing a front profile picture, distances measured on the front plane that includes (e.g., virtually cuts) the eyes may be in a different plane that the plane tangent to the stomach, thus causing additional and unwanted errors into the distances measurement when estimating size of these out-of-plane portions of the body. See, for example,
In general, this function may be a linear (e.g., first order), second order, third order, fourth order, etc., function. For example, the function (ƒ(x)) may be expressed generally as a function of the distance between the planes, in (mm or pixels) and/or a function of the distance between the point(s) in the plane (e.g., the stomach plane) being determined. In general the function ƒ(x) may return a correcting value that is less than the distance between the planes.
Thus, to compensate, the method or apparatus may determine and apply a correction algorithm that compensates the different depths of fields by combining the analysis performed during the whole process. For instance from the analysis of subject's side profile, the system implementing the method may estimate the distance between the IOD plane and the stomach plane, calculating the correction factor to be applied when performing the measurements of subject front profile.
The methods (e.g., algorithms) described above may be constantly improved for accuracy and performances through machine learning and using any of the apparatuses (systems and devices) described herein. For example, an apparatus as described herein may include an upper-body and a lower-body garment with a grid design of known dimensions, which may be used to help establish and/or modify the correctional factors (f(x)) used herein. For example a grid garment such as the one shown in
Terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. For example, as used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items and may be abbreviated as “/”.
Spatially relative terms, such as “under”, “below”, “lower”, “over”, “upper” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is inverted, elements described as “under” or “beneath” other elements or features would then be oriented “over” the other elements or features. Thus, the exemplary term “under” can encompass both an orientation of over and under. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly. Similarly, the terms “upwardly”, “downwardly”, “vertical”, “horizontal” and the like are used herein for the purpose of explanation only unless specifically indicated otherwise.
Although the terms “first” and “second” may be used herein to describe various features/elements, these features/elements should not be limited by these terms, unless the context indicates otherwise. These terms may be used to distinguish one feature/element from another feature/element. Thus, a first feature/element discussed below could be termed a second feature/element, and similarly, a second feature/element discussed below could be termed a first feature/element without departing from the teachings of the present invention.
As used herein in the specification and claims, including as used in the examples and unless otherwise expressly specified, all numbers may be read as if prefaced by the word “about” or “approximately,” even if the term does not expressly appear. The phrase “about” or “approximately” may be used when describing magnitude and/or position to indicate that the value and/or position described is within a reasonable expected range of values and/or positions. For example, a numeric value may have a value that is +/−0.1% of the stated value (or range of values), +/−1% of the stated value (or range of values), +/−2% of the stated value (or range of values), +/−5% of the stated value (or range of values), +/−10% of the stated value (or range of values), etc. Any numerical range recited herein is intended to include all sub-ranges subsumed therein.
Although various illustrative embodiments are described above, any of a number of changes may be made to various embodiments without departing from the scope of the invention as described by the claims. For example, the order in which various described method steps are performed may often be changed in alternative embodiments, and in other alternative embodiments one or more method steps may be skipped altogether. Optional features of various device and system embodiments may be included in some embodiments and not in others. Therefore, the foregoing description is provided primarily for exemplary purposes and should not be interpreted to limit the scope of the invention as it is set forth in the claims.
The examples and illustrations included herein show, by way of illustration and not of limitation, specific embodiments in which the subject matter may be practiced. As mentioned, other embodiments may be utilized and derived there from, such that structural and logical substitutions and changes may be made without departing from the scope of this disclosure. Such embodiments of the inventive subject matter may be referred to herein individually or collectively by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept, if more than one is, in fact, disclosed. Thus, although specific embodiments have been illustrated and described herein, any arrangement calculated to achieve the same purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of skill in the art upon reviewing the above description.
This patent application claims the benefit as a continuation-in-part of International Patent Application No. PCT/US2015/010343, filed on Jan. 6, 2015 (published as WO 2015/103620), titled “SYSTEMS AND METHODS TO AUTOMATICALLY DETERMINE GARMENT FIT,” which claimed priority to U.S. Provisional Patent Application No. 61/924,086, filed on Jan. 6, 2014, titled “SYSTEMS AND METHODS TO DETERMINE GARMENT FIT” each of which is herein incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
3591526 | Kawashima | Jul 1971 | A |
3793716 | Smith Johannsen | Feb 1974 | A |
4624817 | Gusack et al. | Nov 1986 | A |
4710981 | Sanchez | Dec 1987 | A |
4823240 | Shenker | Apr 1989 | A |
4867166 | Axelgaard et al. | Sep 1989 | A |
5036865 | Keaton | Aug 1991 | A |
5111818 | Suzuki et al. | May 1992 | A |
5148002 | Kuo et al. | Sep 1992 | A |
5163006 | Deziel | Nov 1992 | A |
5241300 | Buschmann | Aug 1993 | A |
5280265 | Kramer et al. | Jan 1994 | A |
5352315 | Carrier et al. | Oct 1994 | A |
5379461 | Wilmers | Jan 1995 | A |
5395508 | Jolly et al. | Mar 1995 | A |
5557263 | Fisher et al. | Sep 1996 | A |
5581492 | Janik | Dec 1996 | A |
5635909 | Cole | Jun 1997 | A |
5678448 | Fullen et al. | Oct 1997 | A |
5694645 | Triplette | Dec 1997 | A |
5749365 | Magill | May 1998 | A |
5802607 | Triplette | Sep 1998 | A |
5824996 | Kochman et al. | Oct 1998 | A |
5845644 | Hughes et al. | Dec 1998 | A |
5853005 | Scanlon | Dec 1998 | A |
5865740 | Kelly et al. | Feb 1999 | A |
5903222 | Kawarizadeh et al. | May 1999 | A |
5906004 | Lebby et al. | May 1999 | A |
5912653 | Fitch | Jun 1999 | A |
5921674 | Koczi | Jul 1999 | A |
6016476 | Maes et al. | Jan 2000 | A |
6019877 | Dupelle et al. | Feb 2000 | A |
6024575 | Ulrich | Feb 2000 | A |
6047203 | Sackner et al. | Apr 2000 | A |
6080690 | Lebby et al. | Jun 2000 | A |
6097297 | Fard | Aug 2000 | A |
6136127 | De Bastiani | Oct 2000 | A |
6144120 | Doi et al. | Nov 2000 | A |
6210771 | Post et al. | Apr 2001 | B1 |
6232879 | Tyren | May 2001 | B1 |
6259399 | Krasner | Jul 2001 | B1 |
6319015 | Faunce | Nov 2001 | B1 |
6325066 | Hughes et al. | Dec 2001 | B1 |
6341504 | Istook | Jan 2002 | B1 |
6349201 | Ford | Feb 2002 | B1 |
6415176 | Scheirer et al. | Jul 2002 | B1 |
6436064 | Kloecker | Aug 2002 | B1 |
6490534 | Pfister | Dec 2002 | B1 |
6561814 | Tilbury et al. | May 2003 | B2 |
6563424 | Kaario | May 2003 | B1 |
6642467 | Farringdon | Nov 2003 | B2 |
6668380 | Marmaropolous et al. | Dec 2003 | B2 |
6713733 | Kochman et al. | Mar 2004 | B2 |
6729025 | Farrell et al. | May 2004 | B2 |
6792124 | Tilbury et al. | Sep 2004 | B2 |
6801140 | Mantyjarvi et al. | Oct 2004 | B2 |
6830344 | Reho et al. | Dec 2004 | B2 |
6895261 | Palamides | May 2005 | B1 |
6930608 | Grajales et al. | Aug 2005 | B2 |
6968075 | Chang | Nov 2005 | B1 |
6970731 | Jayaraman et al. | Nov 2005 | B1 |
6982115 | Poulos et al. | Jan 2006 | B2 |
7020508 | Stivoric et al. | Mar 2006 | B2 |
7034685 | Fabre et al. | Apr 2006 | B2 |
7161084 | Sandbach | Jan 2007 | B2 |
7173437 | Hervieux et al. | Feb 2007 | B2 |
7191803 | Orr et al. | Mar 2007 | B2 |
7210939 | Marmaropolous et al. | May 2007 | B2 |
7211053 | Marmaropolous et al. | May 2007 | B2 |
7230610 | Jung et al. | Jun 2007 | B2 |
7248756 | Ebbesen et al. | Jul 2007 | B2 |
7250547 | Hofmeister et al. | Jul 2007 | B1 |
7299034 | Kates | Nov 2007 | B2 |
7299964 | Jayaraman et al. | Nov 2007 | B2 |
7319895 | Klefstad-Sillonville et al. | Jan 2008 | B2 |
7320947 | Child et al. | Jan 2008 | B2 |
7321785 | Harris | Jan 2008 | B2 |
7324841 | Reho et al. | Jan 2008 | B2 |
7344379 | Marmaropolous et al. | Mar 2008 | B2 |
7348645 | Xu | Mar 2008 | B2 |
7365031 | Swallow et al. | Apr 2008 | B2 |
7377133 | Sandbach et al. | May 2008 | B2 |
7388166 | Marmaropolous et al. | Jun 2008 | B2 |
7429959 | Gerder et al. | Sep 2008 | B2 |
7448874 | Willis | Nov 2008 | B2 |
7476104 | Marmaropoulos et al. | Jan 2009 | B2 |
7559768 | Marmaropoulos et al. | Jul 2009 | B2 |
7578195 | DeAngelis et al. | Aug 2009 | B2 |
7616112 | Miller, III | Nov 2009 | B2 |
7645220 | Hoffman et al. | Jan 2010 | B2 |
7665288 | Karayianni et al. | Feb 2010 | B2 |
7683643 | Qi et al. | Mar 2010 | B2 |
7712373 | Nagle et al. | May 2010 | B2 |
7715873 | Biere et al. | May 2010 | B1 |
7719007 | Thompkins et al. | May 2010 | B2 |
7732002 | Kodas et al. | Jun 2010 | B2 |
7753685 | Lee et al. | Jul 2010 | B2 |
7753845 | Gopinathan et al. | Jul 2010 | B2 |
7760082 | Wong et al. | Jul 2010 | B2 |
7769412 | Gailloux | Aug 2010 | B1 |
7770473 | Von Lilienfeld-Toal et al. | Aug 2010 | B2 |
7779656 | Dias et al. | Aug 2010 | B2 |
7783334 | Nam et al. | Aug 2010 | B2 |
7787726 | Ten Eyck et al. | Aug 2010 | B2 |
7849888 | Karayianni et al. | Dec 2010 | B2 |
7862624 | Tran | Jan 2011 | B2 |
7870761 | Valentine et al. | Jan 2011 | B2 |
7872557 | Seibert | Jan 2011 | B2 |
7878030 | Burr | Feb 2011 | B2 |
7880607 | Olson et al. | Feb 2011 | B2 |
7891020 | Von Bluecher | Feb 2011 | B2 |
7914108 | Konno et al. | Mar 2011 | B2 |
7933554 | Hoyt et al. | Apr 2011 | B2 |
7955696 | Baikerikar et al. | Jun 2011 | B2 |
7976480 | Grajales et al. | Jul 2011 | B2 |
7982613 | Zheng | Jul 2011 | B2 |
7983876 | Vock et al. | Jul 2011 | B2 |
8008606 | Kaiserman et al. | Aug 2011 | B2 |
8024023 | Tolvanen | Sep 2011 | B2 |
8032199 | Linti et al. | Oct 2011 | B2 |
8063307 | Bukshpun et al. | Nov 2011 | B2 |
8099258 | Alten et al. | Jan 2012 | B2 |
8140143 | Picard et al. | Mar 2012 | B2 |
8146171 | Chung et al. | Apr 2012 | B2 |
8162857 | Lanfermann et al. | Apr 2012 | B2 |
8186231 | Graumann et al. | May 2012 | B2 |
8214008 | Hassonjee et al. | Jul 2012 | B2 |
8228202 | Buchner et al. | Jul 2012 | B2 |
8253586 | Matak | Aug 2012 | B1 |
8262217 | Furukawa | Sep 2012 | B2 |
8263215 | Burr et al. | Sep 2012 | B2 |
8267862 | Jeong et al. | Sep 2012 | B2 |
8308489 | Lee et al. | Nov 2012 | B2 |
8331097 | Yang et al. | Dec 2012 | B2 |
8340740 | Holzer et al. | Dec 2012 | B2 |
8348841 | Varadan | Jan 2013 | B2 |
8348865 | Jeong et al. | Jan 2013 | B2 |
8362882 | Heubel et al. | Jan 2013 | B2 |
8373079 | Walkington | Feb 2013 | B2 |
8398546 | Pacione et al. | Mar 2013 | B2 |
8403845 | Stivoric et al. | Mar 2013 | B2 |
8416579 | Biesheuvel et al. | Apr 2013 | B2 |
8475371 | Derchak et al. | Jul 2013 | B2 |
8739397 | Nagata et al. | Jun 2014 | B2 |
8798708 | Tremblay | Aug 2014 | B2 |
8862431 | Hodge | Oct 2014 | B2 |
8925393 | Cannard et al. | Jan 2015 | B2 |
8945328 | Longinotti-Buitoni et al. | Feb 2015 | B2 |
8948839 | Longinotti-Buitoni et al. | Feb 2015 | B1 |
8954129 | Schlegel et al. | Feb 2015 | B1 |
9282893 | Longinotti-Buitoni et al. | Mar 2016 | B2 |
9566032 | Babaeizadeh et al. | Feb 2017 | B2 |
9979547 | Starner et al. | May 2018 | B2 |
10154791 | Longinotti-Buitoni et al. | Dec 2018 | B2 |
20020093515 | Fay et al. | Jul 2002 | A1 |
20030139692 | Barrey et al. | Jul 2003 | A1 |
20040115430 | Leonard | Jun 2004 | A1 |
20040249242 | Lau et al. | Dec 2004 | A1 |
20050029680 | Jung et al. | Feb 2005 | A1 |
20050058744 | Steinberg et al. | Mar 2005 | A1 |
20050067816 | Buckman | Mar 2005 | A1 |
20050107722 | Ozaki et al. | May 2005 | A1 |
20050228234 | Yang | Oct 2005 | A1 |
20060007059 | Bell | Jan 2006 | A1 |
20060062993 | Ogata et al. | Mar 2006 | A1 |
20060080182 | Thompson et al. | Apr 2006 | A1 |
20060124470 | Zama et al. | Jun 2006 | A1 |
20060139165 | Bader | Jun 2006 | A1 |
20060155182 | Mazzarolo | Jul 2006 | A1 |
20070000912 | Aisenbrey | Jan 2007 | A1 |
20070046720 | Konno et al. | Mar 2007 | A1 |
20070049842 | Hill et al. | Mar 2007 | A1 |
20070151312 | Bruce et al. | Jul 2007 | A1 |
20070153363 | Gruner | Jul 2007 | A1 |
20070177770 | Derchak et al. | Aug 2007 | A1 |
20070178716 | Glaser et al. | Aug 2007 | A1 |
20070202765 | Krans et al. | Aug 2007 | A1 |
20070293781 | Sims et al. | Dec 2007 | A1 |
20080045815 | Derchak et al. | Feb 2008 | A1 |
20080058744 | Tippey et al. | Mar 2008 | A1 |
20080064964 | Nagata et al. | Mar 2008 | A1 |
20080083720 | Gentile et al. | Apr 2008 | A1 |
20080083721 | Kaiserman et al. | Apr 2008 | A1 |
20080083740 | Kaiserman et al. | Apr 2008 | A1 |
20080171914 | Ouwerkerk et al. | Jul 2008 | A1 |
20080177168 | Callahan et al. | Jul 2008 | A1 |
20080234561 | Roesicke et al. | Sep 2008 | A1 |
20080241391 | Kim et al. | Oct 2008 | A1 |
20080246629 | Tsui et al. | Oct 2008 | A1 |
20080255794 | Levine | Oct 2008 | A1 |
20080258921 | Woo et al. | Oct 2008 | A1 |
20080269629 | Reiner | Oct 2008 | A1 |
20080269652 | Reiner | Oct 2008 | A1 |
20080287769 | Kurzweil et al. | Nov 2008 | A1 |
20080287770 | Kurzweil et al. | Nov 2008 | A1 |
20080294019 | Tran | Nov 2008 | A1 |
20090012408 | Nagata et al. | Jan 2009 | A1 |
20090018410 | Coene et al. | Jan 2009 | A1 |
20090105795 | Minogue et al. | Apr 2009 | A1 |
20090112078 | Tabe | Apr 2009 | A1 |
20090157327 | Nissila | Jun 2009 | A1 |
20090227856 | Russell et al. | Sep 2009 | A1 |
20090281394 | Russell et al. | Nov 2009 | A1 |
20090286055 | Pourdeyhimi et al. | Nov 2009 | A1 |
20100004720 | Li et al. | Jan 2010 | A1 |
20100029598 | Kopitz et al. | Feb 2010 | A1 |
20100041974 | Ting et al. | Feb 2010 | A1 |
20100059274 | Ives et al. | Mar 2010 | A1 |
20100071205 | Graumann et al. | Mar 2010 | A1 |
20100077528 | Lind et al. | Apr 2010 | A1 |
20100112195 | Kodas et al. | May 2010 | A1 |
20100113910 | Brauers et al. | May 2010 | A1 |
20100149567 | Kanazawa et al. | Jun 2010 | A1 |
20100185062 | Salazar et al. | Jul 2010 | A1 |
20100185398 | Berns et al. | Jul 2010 | A1 |
20100194815 | Furukawa | Aug 2010 | A1 |
20100198038 | Nagata et al. | Aug 2010 | A1 |
20100234715 | Shin et al. | Sep 2010 | A1 |
20100274100 | Behar et al. | Oct 2010 | A1 |
20100292598 | Roschk et al. | Nov 2010 | A1 |
20100309209 | Hodgins et al. | Dec 2010 | A1 |
20100312071 | Schenk | Dec 2010 | A1 |
20100324405 | Niemi et al. | Dec 2010 | A1 |
20110000412 | Chung et al. | Jan 2011 | A1 |
20110015498 | Mestrovic et al. | Jan 2011 | A1 |
20110032103 | Bhat et al. | Feb 2011 | A1 |
20110042125 | Lee et al. | Feb 2011 | A1 |
20110087115 | Sackner et al. | Apr 2011 | A1 |
20110092795 | Derchak | Apr 2011 | A1 |
20110100683 | Bhattacharya et al. | May 2011 | A1 |
20110102304 | Nelson | May 2011 | A1 |
20110115624 | Tran | May 2011 | A1 |
20110125064 | Shyr | May 2011 | A1 |
20110130643 | Derchak et al. | Jun 2011 | A1 |
20110144457 | Coulon | Jun 2011 | A1 |
20110183068 | Yamakawa et al. | Jul 2011 | A1 |
20110184270 | Russell et al. | Jul 2011 | A1 |
20110259638 | Sherrill et al. | Oct 2011 | A1 |
20110267578 | Wilson | Nov 2011 | A1 |
20110277206 | Sokolowski | Nov 2011 | A1 |
20110288605 | Kaib et al. | Nov 2011 | A1 |
20120024833 | Klewer et al. | Feb 2012 | A1 |
20120029299 | Deremer et al. | Feb 2012 | A1 |
20120030935 | Slade et al. | Feb 2012 | A1 |
20120031431 | Carlson et al. | Feb 2012 | A1 |
20120035426 | Mielcarz et al. | Feb 2012 | A1 |
20120071039 | Debock et al. | Mar 2012 | A1 |
20120071793 | Gal | Mar 2012 | A1 |
20120078127 | McDonald et al. | Mar 2012 | A1 |
20120088986 | David et al. | Apr 2012 | A1 |
20120101357 | Hoskuldsson et al. | Apr 2012 | A1 |
20120118427 | Brookstein et al. | May 2012 | A1 |
20120127687 | Allee et al. | May 2012 | A1 |
20120136231 | Markel | May 2012 | A1 |
20120143093 | Stirling et al. | Jun 2012 | A1 |
20120144551 | Guldalian | Jun 2012 | A1 |
20120144561 | Begriche et al. | Jun 2012 | A1 |
20120144934 | Russell et al. | Jun 2012 | A1 |
20120146797 | Oskin et al. | Jun 2012 | A1 |
20120158074 | Hall | Jun 2012 | A1 |
20120165645 | Russell et al. | Jun 2012 | A1 |
20120165717 | Al Khaburi | Jun 2012 | A1 |
20120184826 | Keenan et al. | Jul 2012 | A1 |
20120188158 | Tan et al. | Jul 2012 | A1 |
20120197224 | Chagger | Aug 2012 | A1 |
20120215076 | Yang et al. | Aug 2012 | A1 |
20120223833 | Thomas et al. | Sep 2012 | A1 |
20120233751 | Hexels | Sep 2012 | A1 |
20120238845 | Yang | Sep 2012 | A1 |
20120246795 | Scheffler et al. | Oct 2012 | A1 |
20120255166 | Kim et al. | Oct 2012 | A1 |
20120324616 | Hyde et al. | Dec 2012 | A1 |
20120330109 | Tran | Dec 2012 | A1 |
20130013331 | Horseman | Jan 2013 | A1 |
20130019372 | Esses | Jan 2013 | A1 |
20130019383 | Korkala et al. | Jan 2013 | A1 |
20130041272 | Guillen et al. | Feb 2013 | A1 |
20130053674 | Volker | Feb 2013 | A1 |
20130066168 | Yang et al. | Mar 2013 | A1 |
20130072777 | Tremblay | Mar 2013 | A1 |
20130077263 | Oleson et al. | Mar 2013 | A1 |
20130079860 | Besio | Mar 2013 | A1 |
20130144111 | Wang et al. | Jun 2013 | A1 |
20130179288 | Moses et al. | Jul 2013 | A1 |
20130211208 | Varadan | Aug 2013 | A1 |
20130212900 | Stewart | Aug 2013 | A1 |
20130231711 | Kalb | Sep 2013 | A1 |
20130244121 | Gogotsi et al. | Sep 2013 | A1 |
20130245423 | Derchak et al. | Sep 2013 | A1 |
20130281795 | Varadan | Oct 2013 | A1 |
20130314668 | Haddadi et al. | Nov 2013 | A1 |
20140061273 | Bullivant et al. | Mar 2014 | A1 |
20140100436 | Brunner et al. | Apr 2014 | A1 |
20140135593 | Jayalth et al. | May 2014 | A1 |
20140135602 | Lemke et al. | May 2014 | A1 |
20140172134 | Casillas et al. | Jun 2014 | A1 |
20140182880 | Simenhaus et al. | Jul 2014 | A1 |
20140206948 | Romem | Jul 2014 | A1 |
20140303470 | Tsukada et al. | Oct 2014 | A1 |
20140312027 | Augustine et al. | Oct 2014 | A1 |
20150143601 | Longinotti-Buitoni et al. | May 2015 | A1 |
20150250420 | Longinotti-Buitoni et al. | Sep 2015 | A1 |
20150289820 | Miller et al. | Oct 2015 | A1 |
20150342266 | Cooper et al. | Dec 2015 | A1 |
20160148531 | Bleich et al. | May 2016 | A1 |
20160262462 | Kawamura et al. | Sep 2016 | A1 |
20180004924 | Tieu et al. | Jan 2018 | A1 |
20180067516 | Longinotti-Buitoni et al. | Mar 2018 | A1 |
20180376586 | Longinotti-Buitoni et al. | Dec 2018 | A1 |
Number | Date | Country |
---|---|---|
1294504 | May 2001 | CN |
1985761 | Dec 2006 | CN |
101917903 | Dec 2010 | CN |
102970925 | Mar 2013 | CN |
1057923 | Dec 2000 | EP |
1335831 | Aug 2003 | EP |
1478249 | Nov 2004 | EP |
1509128 | Mar 2005 | EP |
1622512 | Feb 2006 | EP |
1709903 | Oct 2006 | EP |
1905112 | Apr 2008 | EP |
1907075 | Apr 2008 | EP |
1925718 | May 2008 | EP |
2025369 | Feb 2009 | EP |
2191737 | Jun 2010 | EP |
2196142 | Jun 2010 | EP |
2217145 | Aug 2010 | EP |
2314744 | Apr 2011 | EP |
3037036 | Jun 2016 | EP |
2008229084 | Oct 2008 | JP |
WO 9006189 | Jun 1990 | WO |
WO 0016493 | Mar 2000 | WO |
WO 0101855 | Jan 2001 | WO |
WO03000015 | Jan 2003 | WO |
WO 03060449 | Jul 2003 | WO |
WO 2004076731 | Sep 2004 | WO |
WO 2004107831 | Dec 2004 | WO |
WO 2005032447 | Apr 2005 | WO |
WO 2005067796 | Jul 2005 | WO |
WO 2005096133 | Oct 2005 | WO |
WO 2006064447 | Jun 2006 | WO |
WO 2006102538 | Sep 2006 | WO |
WO 2007056557 | May 2007 | WO |
WO 2008137046 | Nov 2008 | WO |
WO 2008153786 | Dec 2008 | WO |
WO 2009040696 | Apr 2009 | WO |
WO 2009112281 | Sep 2009 | WO |
WO 2010038176 | Apr 2010 | WO |
WO 2010044018 | Apr 2010 | WO |
WO 2010058346 | May 2010 | WO |
WO 2010085671 | Jul 2010 | WO |
WO 2010085688 | Jul 2010 | WO |
WO2010096907 | Sep 2010 | WO |
WO 2010120945 | Oct 2010 | WO |
WO 2011092620 | Aug 2011 | WO |
WO 2011156095 | Dec 2011 | WO |
WO2012011068 | Jan 2012 | WO |
WO 2012060524 | May 2012 | WO |
WO 2012066056 | May 2012 | WO |
WO 2012073076 | Jun 2012 | WO |
WO 2012073230 | Jun 2012 | WO |
WO 2012083066 | Jun 2012 | WO |
WO 2012104484 | Aug 2012 | WO |
WO 2012110954 | Aug 2012 | WO |
WO 2012112186 | Aug 2012 | WO |
WO 2012113014 | Aug 2012 | WO |
WO 2012140079 | Oct 2012 | WO |
WO 2012140522 | Oct 2012 | WO |
WO 2012168836 | Dec 2012 | WO |
WO 2012176193 | Dec 2012 | WO |
WO 2014025430 | Feb 2014 | WO |
WO 2014075682 | May 2014 | WO |
WO 2014204323 | Dec 2014 | WO |
WO 2015103620 | Jul 2015 | WO |
WO 2015138515 | Sep 2015 | WO |
WO2016035350 | Mar 2016 | WO |
Entry |
---|
Mauri et al.; U.S. Appl. No. 15/335,403 entitled “Calibration packaging apparatuses for physiological monitoring garments,” filed Oct. 26, 2016. |
Longinotti-Buitoni et al; U.S. Appl. No. 15/324,152 entitled “Garments having stretchable and conductive ink,” filed Jan. 5, 2017. |
Longinotti-Buitoni et al.; U.S. Appl. No. 15/516,138 entitled “Devices and methods for use with physiological monitoring garments,” filed Mar. 31, 2017. |
Aliverti et al.; Compartmental analysis of breathing in the supine and prone positions by optoelectronic plethysmography; Ann Biomed Eng; 29(1):60-70; Jan. 2001. |
Babchenko et al.; Fiber optic sensor for the measurement of respiratory chest circumference changes; J Biomed Opt; 4(2):224-229; Apr. 1999. |
Cala et al.; Chest wall and lung volume estimation by optical reflectance motion analysis; J Appl Physiol; 81(6):2680-2689; Dec. 1996. |
Chadha et al.; Validation of respiratory inductive plethysmography using different calibration procedures; Am Rev Respir Dis; 125:644-649; Jun. 1982. |
Chen et al.; Color structured light system of chest wall motion measurement for respiratory volume evaluation; J Biomed Opt; 15(2):026013; Mar.-Apr. 2010. |
D'Angelo et al.; A system for respiratory motion detection using optical fibers embedded into textiles; Conf Proc IEEE Med Biol Soc; 3694-3697; Aug. 2008. |
Dodgson; Variation and extrema of human interpupillary distance; Prod. Of SPIE: Stereoscopic Displays and Virtual Reality Systems XI; vol. 5291; pp. 36-46; Jan. 2004. |
Ferrigno et al.; Three-dimensional optical analysis of chest wall motion; J Appl Physiol; 77(3):1224-1231; Sep. 1994. |
Gramse et al.; Novel concept for a noninvasive cardiopulmonary monitor for infants: a pair of pajamas with an integrated sensor module; Ann Biomed Eng; 31(2):152-158; Feb. 2003. |
Heilman et al.; Accuracy of the LifeShirt (Vivometrics) in the detection of cardiac rhythms; Biol Psychol; 75(3):300-305; Jul. 2007. |
Kenyon et al.; Rib cage mechanics during quiet breathing and exercise in humans; J Appl Physiol; 83(4):1242-1255; Oct. 1997. |
Konno et al.; Measurement of the separate volume changes of rib cage and abdomen during breathing; J Appl Physiol; 22(3):407-422; Mar. 1967. |
Lafortuna et al.; A new instrument for the measurement of rib cage and abdomen circumference variation in respiration at rest and during exercise; Eur J Appl Physiol Occup Physiol; 71(2-3):259-265; Mar. 1995. |
Milledge et al.; Inductive plethysmography—a new respiratory transducer; J Physiol; 267(1):4P-5P; May 1977. |
Peacock et al.; Optical mapping of the thoracoabdominal wall; Thorax; 39 (2):93-100; Feb. 1984. |
Peacock et al.; Optical measurement of the change in trunk volume with breathing; Bull Eur Physiopathol Respir; 21(2):125-129; Mar.-Apr. 1985. |
Pennock B.E.; Rib cage and abdominal piezoelectric film belts to measure ventilatory airflow; J Olin Monit; 6(4):276-283; Oct. 1990. |
Sackner et al.; Calibration of respiratory inductive plethysmograph during natural breathing; J Appl Physiol; 66(1):410-420; Jan. 1989. |
Saumarez; Automated optical measurements of human torso surface movements during freathing; J. Appl. Physiol.; 60(2); pp. 702-709; Feb. 1986. |
Zimmerman et al.; Postural changes in rib cage and abdominal volume-motion coefficients and their effect on the calibration of a respiratory inductance plethysmograph; Am Rev Respir Dis; 127(2):209-214; Feb. 1983. |
Chourabi et al.; Understanding smart cities: An integrative framework; 45th Hawii International Conference on System Sciences; pp. 2289-2297; Jan. 4, 2012. |
Purao et al.; Modeling citizen-centric services in smart cities; 32nd. International Conference on Conceptual Modeling; Hong Kong; pp. 438-445; (8 pages, retrieved from the Internet at https://icity.smu.edu.sg/sites/icity.smu.edu.sg/files/publications/Modeling-Citizen-centric-Services-in-Smart-Cities_ER2013.pdf); Nov. 11-13, 2013. |
Longinotti_Buitoni et al.; U.S. Appl. No. 15/554,784 entitled “Laundry system for smart garments,” filed Aug. 31, 2017. |
Longinotti-Buitoni et al.; U.S. Appl. No. 15/877,378 entitled “Flexible fabric ribbon connectors for garments with sensors and electronics,” filed Jan. 22, 2018. |
Longinotti-Buitoni et al.; U.S. Appl. No. 15/905,811, entitled “Physiological monitoring garments with enhanced sensor stabilization,” filed Feb. 26, 2018. |
Hossain et al.; Human identity verification by using physiological and behavioural biometric traits; International Journal of Bioscience, Biochemistry and bioinformatics; 1(3); pp. 199-205; Sep. 2011. |
Longinotti-Buitoni; U.S. Appl. No. 16/222,603 entitled “Biometric identification by garments having a plurality of sensors,” filed Dec. 17, 2018. |
Longinotti-Buitoni et al., U.S. Appl. No. 16/231,587 entitled “Physiological monitoring garments,” filed Dec. 23, 2018. |
Number | Date | Country | |
---|---|---|---|
20160314576 A1 | Oct 2016 | US |
Number | Date | Country | |
---|---|---|---|
61924086 | Jan 2014 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2015/010343 | Jan 2015 | US |
Child | 15202833 | US |