Patent Grant
8339287
The present invention relates in general to controlling a computer system or an electronic system, and, in one exemplary embodiment, to a device to control an electronic or computer system by means of a fluid flow and a method of manufacturing the same.
In one exemplary embodiment, a device to facilitate a user interface of a computer system utilizing breath. The device includes a body, a user side inlet defined by the body to receive a fluid flow generated by a user, and an exhaust opening defined by the body. The fluid flow may be either inhaled into the device or expelled from the device through the exhaust opening. The device may include a conduit positioned between the user side inlet and the one exhaust opening. The conduit is to allow the fluid flow to travel between the at least one user side inlet and the at least one exhaust opening. The device may include at least one segment positioned inside the body. The segment is sensitive to the fluid flow generated by the user, which allows effectuating one of a first control action, and a second control action. The device may include one or more contactors. A first contactor of the one or more contactors is positioned such as it is intermittently in contact with the at least one segment. The contact may occur responsive to the fluid flow contact with the at least one segment. The contact may occur responsive to the fluid flow generated by the user. The device may include a sensor to react to a movement of the at least one segment.
Further in accordance with the exemplary embodiment of the present invention, a method of manufacturing a device to interact with a computer system by breathing is described. The method includes defining at least one user side inlet within a body to receive a fluid flow generated by a user. The method further includes defining at least one exhaust opening within the body through which the fluid flow is either inhaled into the device or expelled from the device defining at least one conduit between the at least one user side inlet and the at least one exhaust opening to allow the fluid flow to travel between the at least one user side inlet and the at least one exhaust opening. The method further includes locating at least one segment within the body, the at least one segment being sensitive to the fluid flow generated by the user to effectuate one of a first control action, and a second control action. According to one embodiment, the method further includes locating one or more contactors within the body. The locating one or more contactors within the body includes positioning a first contactor of the one or more contactors such as it is intermittently in contact with the at least one segment, the contact occurring responsive to the fluid flow generated by the user. The method further includes locating a sensor within the body to react to a movement of the at least one segment.
A device to facilitate a user interface of a computer system utilizing breath is described. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without these specific details.
In one embodiment, the invention is a relative input device (e.g., it reports its distance and direction of movement each time it is moved, but cannot report its absolute position). The invention may provide improved performance and accuracy, in accordance with the Fitts' Law, compared to alternative devices. It will be appreciated that other embodiments of the invention could be integrated in an absolute input system by adding to the basic device any of the usual magnetic or ultrasonic trackers.
Some of the applications of the present invention may relate to the fields of ubiquitous, wearable computing, electronic games, automotive and avionics ergonomic control by a driver or pilot, physiological monitoring, home automation, etc, as most of these domains of applications require “on/off” functions in addition to variable ones.
Sensor module 1000 includes a body 1002 in which are defined a plurality of conduits 500, illustrated in broken line. The conduits 500 may be rectangular in profile, and extend from inlet chambers 110 defined within a front face of the block 1002 to a plurality of exhaust outlets 410 defined in a back face of the body 1002.
In the exemplary embodiment illustrated in
A flexible member or segment 600 (shown in
The inlets 110 are profiled so as to direct an air flow (e.g. breath expelled by a user into an associated conduit 500).
At a high level, the sensor module 1000 operates to generate one or more control signals that are communicated, for example, by a cord 900 to a machine (e.g., a computer) thereby facilitate interaction by a user of the sensor module 1000 with the relevant machine. More specifically, the segments 600 coupled to each of the conduits 500 is sensitive to an air flow through the associated conduit and serves to translate certain characteristics of that air flow into a signal that may be, for example, communicated to a machine for the purposes of interacting with that machine.
According to an exemplary embodiment of the present invention, the manufacturing process of a sensor module 1000 has the following operations:
(a) defining at least one user side inlet within a body to receive a fluid flow generated by a user;
(b) defining at least one exhaust opening within the body through which the fluid flow is either inhaled into the device or expelled from the device;
(c) defining at least one conduit between the at least one user side inlet and the at least one exhaust opening to allow the fluid flow to travel between the at least one user side inlet and the at least one exhaust opening;
(d) locating at least one segment within the body, the at least one segment being sensitive to the fluid flow generated by the user to effectuate one of a first control action, and a second control action;
(e) locating one or more contactors within the body, including positioning a first contactor of the one or more contactors such as it is intermittently in contact with the at least one segment, the contact occurring responsive to the fluid flow generated by the user; and
(f) locating a sensor within the body to react to a movement of the at least one segment.
When the user breathes out (expiration), towards the sensor module 1000, the air is channeled by the user side inlets 110 to an openings 510 of an adjoining conduit 500, then through the conduit 500, stressing (e.g., bending or moving) a segment 600 positioned inside the conduit 500 to create an opening between the segment 600 and the interior of the sensor module 1000, and finally out the sensor module 1000 through the exhaust openings 410.
When the user breathes in (inspiration), sucking the air out of the sensor module 1000, air is channeled through at least one exhaust openings 410, through an opening between a stressed segment 600 and the walls of a conduit 500, then through the conduits 500, stressing the segments 600 positioned outside the conduit 500, and out of the sensor module 1000 through the user side inlet 110.
The user may breathe in and out of the user side inlet 110, thereby generating a air flow. No direct contact is required, since the segments 600 are to be constructed from light and flexible material, and are designed such as to be allowed to move very freely responsive to the air flow. The air flow may travel either towards or away from the user side inlets 110 and can stress (e.g., bend or move) the segments 600 through the conduits openings 510 of the conduits 500. The segments 600 are able to respond to the inward or outward direction of the air flow. In one embodiment, the segments 600 respond to the inward or outward direction of the air flow, depending on their position with respect to the conduits 500.
Air may flow in either direction through the exhaust openings 410. In one embodiment, the general design of the exhaust openings 410 helps avoid unwanted responses by minimizing external wind effects.
In one embodiment, the segments 600 are positioned with respect to the conduits 500 in such a way as to make the segments 600 responsive to the air flow. The segments 600 may be made of any material able to respond to the air flow produced by human breath (stress breath) by bending, in proportion to the breath intensity, rather than substantially vibrating, and returning to its rest position when the stress breath stops. The segment 600 deflects inside a curved channel designed to maintain the pressure through the travel of the segment 600. The exhaust through the exhaust opening 410 is available at the end of the segment 600 travel. The thickness of the segment 600 may be between approximately 0.99 mm and approximately 0.11 mm. In some embodiments that utilize optical sensing, the segment 600 may include materials capable of blocking light (e.g., IR, ambient). In some embodiments that utilize magnetic-based sensors, the sensors may include ferromagnetic or ferric materials to comply with mechanical prerequisites.
In further embodiments, any mechanical or electromechanical device may generate the air flow. In one embodiment, a stop, or a lug can be positioned on a conduit 500 in order to dampen and stop the segment 600 back to its rest position, once the air flow stops. Materials that can be used for the segments 600 may be synthetic ones, injected or molded, ferromagnetic, piezo-electric or optical materials. In one embodiment, these materials may be used for conversion purposes and dampening/stopping as well as returning the segments 600 to the rest position.
In one embodiment, a segment 600 may be sensitive to both directions of the air flow. Furthermore, the segment 600 may be positioned flush with the conduits 500. The segment 600 can be positioned at any angle regarding the air flow channeling.
The air flow inside the conduits 500 may be detected by the use of segments 600. The sensing may be based on identifying vibration of the segment 600 or bending of the segment 600 responsive to the air flow. To effectuate sensing of the air flow, the distance between the sensor module 1000 (a sensing module) and a user may be between approximately 1.25 inches and approximately 1.75 inches. The air pressure at the user mouth resulting from the user's inhaling or exhaling into the sensor module 1000 may be approximately 0.15 PSI. The air pressure at the user side inlet 110 resulting from the user's inhaling or exhaling into the sensor module 1000 may be from approximately 0.003 PSI to approximately 0.004 PSI. The area of the user side inlet 110 may be approximately 100 square millimeters per segment. Increasing the area of the user side inlet 110 may increase the effect of the pressure. The distance to direct the flow, change direction is approximately 3 mm.
In one embodiment, the air flow generated by the user causes the segment 600 to vibrate. The exhaust opening 410 allows the air to be expelled from the sensor module 1000 as soon as the segment 600 deflects, and increases progressively with variations in pressure.
The thickness of the segment 600 may be between approximately 0.99 mm and approximately 0.11 mm. The modulus of elasticity maybe between approximately 7152 PSI and approximately 7352 PSI. The density of the segment 600 may be between approximately 390 kg/cubic meter and approximately 410 kg/cubic meter. In one embodiment, the maximum displacement of the segment 600 is approximately 5 mm. The exhaust available after a displacement of 4 mm. In some embodiments that utilize optical sensing, the segment 600 may include materials capable of blocking light (e.g., IR, ambient). In some embodiments that utilize magnetic-based sensors, the sensors may include ferromagnetic or ferric materials to comply with mechanical prerequisites.
In one embodiment, a segment 600 may be secured within the sensor module 1000 by fastening means (e.g. screw, glue, rivet) such as the air flow traveling through a conduit 500 causes the segment 600 to stress (e.g., bend or move). The segments 600 may also be embedded in the conduits 500 or integrated as part of the conduits 500. In one embodiment of the present invention, the segments 600 are flush with a plane of a conduit 500, either inside or outside of the conduit walls, depending on whether they are to respond, respectively, to the expiration (breathing out) or inspiration (breathing in) of the user, and the openings through which the segments can bend are made in the conduits 500 in order to provide an optimal air tightness.
The conduit openings 510 can bear, on their sides opposite to the segments 600, a non-return valve (not shown), allowing air flow to pass only in the stress direction of the corresponding segment, thus improving air tightness.
As to pointing, the exemplary embodiment of the present invention may incorporate the features disclosed in PCT/FR00/00362.
With respect to clicking, in one embodiment of the invention, the segments 600 are used for “all or nothing” purposes, based on contact. Two of many possible embodiments of the invention are depicted: the first one, [a], uses contactors 800 and/or switches, the second one, [b], uses contactors 800 and brushes 820. In embodiment [a], the system is based on two contactors 800. One contactor is positioned outside the conduit 500 and in sustained contact with the segment 600 in its rest position. The other contactor is positioned inside the conduit 500, approximately at full stroke of the segment 600. In the depicted embodiment, a sustained contact generates no signal, a short loss of contact (quick inspiration) generates a single click; a loss of contact with sufficient stroke to make the segment contact the other contactor (inside the conduit), and then come back to its rest position, generates a double click. A loss of contact and a long contact with the inside contactor generates a held click, which lasts until a single click (or another held click) is generated by the user. While the held click is being in effect, the user may effectuate a motion (e.g., drag and drop). This feature may be used in combination with the teachings of International Application PCT/FR00/00362. In this embodiment, a first segment 600 may be sensitive to a first air flow direction to effectuate clicking operation, and a second segment 600 may be sensitive to a second air flow direction to effectuate pointing operation. In embodiment [b], the powered brushes 820 are used in addition to the inside contactor 800. The segment 600 is made, at least partly (in the brushes zone), of a conductive material (e.g., ferromagnetic). The brushes 820 are positioned in pairs, inside the conduit 500, on both sides of the segment 600. The segment 600 contacts the first pair of brushes (with a negligible frictional resistance) when stressed by a gentle, moderate stress breath of the user. The second pair of brushes may be contacted by the segment 600 by applying a stronger though still moderate inspiration. Each contact with a pair of brushes conducts the electric current from one brush of the pair to the other brush of the pair, thus generating a “click” signal. Thus, a light expiration by the user generates a single click, and a moderate expiration generates a double click. The processing system does not take into account the electric loops generated by the segment's return, possibly because of a time delay relay or equivalent means. The held click in embodiment [b] is effectuated the same way as in embodiment [a].
Some significant variants can be envisaged, as to the clicking functions. For instance, switches can replace contactors. The switches may be pressure sensitive. A number of materials or combinations of materials may be used in order make the segments 600 more responsive to the user's actions (e.g., ferromagnetic material in the segment and mini magnets integral with the contactors). The contactors 800, switches and/or brushes 820 can produce “click-like” sounds to maintain the usual mouse sounds. A variety of other embodiments are possible in order to enhance the invention, according to the technical solutions adopted in the present invention. A variety of available voltages, interfacing requirements, and user customization needs may be utilized, like piezo-electricity for segment dampening and response to stress purposes, electromagnetic contactors in case of ferromagnetic segments, and a number of optional parameters the user could set, such as delays and/or signals' thresholds differentiation between single click, double click, held click, etc.
With regard to held clicking, the user must be able to pursue any pointing function and to generate a new motion while performing the held clicking (e.g., dragging and dropping, resizing). Therefore, in one embodiment of the present invention, the processing means may include a bus 700 that links together all the contactors and/or switches dedicated to the “held click” function, thus providing a single, uninterrupted and central processing of the data resulting from the various electric signals generated. The bus 700 may be connected to the processing device 20. Similarly, a processor to process the signal emitted by the converter provides a continuous and progressive movement of the pointer (direction, pace and distance), and a satisfactory monitoring of the single and double click functions, with no unwanted repetition, when the user's stress breath moved from one/multiple segment(s) to one/multiple other ones. Network circuits, signal comparison, delay and threshold management, etc. may accomplish this, for instance.
While
In
In
In
While the above-disclosed embodiments relate to functions that are ordinarily performed with the use of a mouse in a GUI environment, the present invention's principle is not restricted to a two-dimensional environment. The present invention is applicable to the three-dimensional pointing and tracking or more (e.g., by repeating the describes principle in several planes, several combinations between pointing and clicking devices), to scrolling (or even auto scroll) and zooming functions as well, to customizable solutions, and can be used in a variety of fields, like games, ergonomic controls, etc. In one embodiment the sensor module 1000 provides the user with the two ways of controlling a computer or an electronic system (on/off control and continuous change of status control) through a single organ (e.g., a mouth or nose), and a single action, thus not interfering with other organs (e.g., hands or eyes), which could be used for other input or output purposes. There should be noted that this device may have various shapes (e.g., in order to prevent wind or other external interferences) and may be embedded or integrated in a variety of portable, wearable devices, e.g., a headset.
The invention can work with standard GUIs' drivers, though special drivers can be designed to match the product features, improve accuracy and take advantage of extra functionalities. The invention may also receive input from the dialog boxes presented by many computer programs to specify settings (e.g., interaction range, meaning, control-display ratio, appearance etc.) relating to the relevant program or to the computer system.
The computer system may include a processor, a main memory and a static memory, which communicate with each other via a bus. The computer system may further include a video display unit (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). The computer system may also include an alphanumeric input device (e.g., a keyboard), a cursor control device (e.g., a mouse), a disk drive unit, a signal generation device (e.g., a speaker) and a network interface device. In alternative embodiments, the computer system may also comprise personal computer (PC), workstation, a set-top box (STB), Personal Digital Assistant (PDA), a cellular telephone, a web appliance or any machine capable of executing a sequence of instructions that specify actions to be taken by that machine.
Although the present invention has been described with reference to specific exemplary embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
The present application is a continuation of U.S. application Ser. No. 10/402,729 filed on Mar. 28, 2003 now U.S. Pat. No. 7,250,877 and claims the benefit of the filing dates of U.S. provisional patent application Ser. No. 60/368,602, filed Mar. 29, 2002, No. 60/378,573 filed May 6, 2002, No. 60/402,994 filed Aug. 12, 2002 and also incorporates these provisional applications by reference. The present application also incorporates by reference International Application no. PCT/FR00/00362.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4207959 | Youdin et al. | Jun 1980 | A |
| 4301449 | Fitzgerald | Nov 1981 | A |
| 4433685 | Giorgini et al. | Feb 1984 | A |
| 4713540 | Gilby et al. | Dec 1987 | A |
| 4746913 | Volta | May 1988 | A |
| 4929826 | Truchsess et al. | May 1990 | A |
| 4993308 | Villeneuve | Feb 1991 | A |
| 5126731 | Cromer, Jr. | Jun 1992 | A |
| 5341133 | Savoy et al. | Aug 1994 | A |
| 5378850 | Tumura | Jan 1995 | A |
| 5422640 | Haley | Jun 1995 | A |
| 5523745 | Fortune et al. | Jun 1996 | A |
| 5603065 | Baneth | Feb 1997 | A |
| 5763792 | Kullik | Jun 1998 | A |
| 5889511 | Ong et al. | Mar 1999 | A |
| 5907318 | Medina | May 1999 | A |
| 6213955 | Karakasoglu et al. | Apr 2001 | B1 |
| 6396402 | Berger et al. | May 2002 | B1 |
| 6574571 | Bonnat | Jun 2003 | B1 |
| 6801231 | Beltz | Oct 2004 | B1 |
| 7584064 | Bonnat | Sep 2009 | B2 |
| 7739061 | Bonnat | Jun 2010 | B2 |
| 20040164881 | Loun Mok et al. | Aug 2004 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20110304424 A1 | Dec 2011 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60368602 | Mar 2002 | US | |
| 60378573 | May 2002 | US | |
| 60402994 | Aug 2002 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10402729 | Mar 2003 | US |
| Child | 11676456 | US |
