Patent Application
20140253453
1. Field of the Invention
The invention broadly relates to computer input devices, and more specifically to a hand motion input device.
2. Prior Art
There are many types of computer input devices for controlling objects such as icons and pointers on a display. Each has its advantages and disadvantages. The most common pointing device for desktop computers is the mouse. It includes a housing shaped for being grasped by a hand and moved in two dimensions on a desk. A sensor on the bottom of the mouse detects sliding movement across the desk surface or mouse pad to control the pointer. Buttons on the housing enable clicking display objects. The mouse is very precise and easy to control with small movements, but since it is separate from the keyboard, it requires the hand to frequently move away from the keyboard. The movement away from the keyboard is not only inconvenient, it requires the fingers to find the home keys on the keyboard again after using the mouse. Some users develop repetitive stress disorders using mouses due to the twisted arm position required by most mice.
A touch pad comprises a flat panel that senses touch by one or more fingers and translates the motion into display object control inputs. It is typically built into a notebook computer in front of the spacebar. Since uses typically use the index finger to operate the touch pad, it requires the hand to move a short distance away from the keys on the keyboard to operate. The movement away from the keyboard is not only inconvenient, it requires the fingers to find the home keys on the keyboard again after using the touch pad. Further, touch pads have less accuracy and speed than mice, which makes pointer control more difficult. A mechanical switch under the touchpad performs a click when the touchpad is pressed downward a short distance, but the actuating force is relatively high and uncomfortable. Therefore touch pad drivers or software are arranged to interpret a finger lifting and quickly pressing down again as a click. Since this tapping motion requires lifting a finger and pressing down against the touch pad again, it is not as intuitive or convenient as simply pressing down to click.
Some touch pads have numeric keys printed on them so that they may be either used as a touch pad or as a touch sensitive numeric keyboard, but not both functions at the same time. There is a key dedicated to changing the device between touch pad and keyboard modes. A serious disadvantage is that in keyboard mode, the keys are touch keys. Finding the correct keys by touch is not only difficult, the touch sensitive keys have no key travel and therefore no mechanical feedback. If the keyboard is calibrated to allow the fingers to lightly rest on them without unintentional activation, it must have a relatively high operating force threshold that makes typing uncomfortable. If the keyboard is calibrated to be activated by light touch, the fingers cannot rest on them like they do on the home keys of a conventional keyboard.
A roller bar pointing device comprises a transverse housing for being positioned in front of a keyboard. A cylindrical roller bar extends along the housing parallel to the spacebar on the keyboard. The roller bar may be rolled for Y direction pointer movement, and slid from side to side for X direction pointer movement. The bar may be pressed down to operate a mechanical switch for performing a click on display. But the hand must move away from the typing position to operate the roller bar with the fingers. The small diameter bar is uncomfortable to press to click, and mentally translating the rolling and sliding motion into 2 dimensional pointer movements is unintuitive. Further, the device is very large and takes up a lot of desk space.
A motion controller senses arm or finger motion and translates it into computer or game console input for controlling pointer movement and other functions. The KINECT by Microsoft in Redmond, Wash., is a game console motion controller. It includes forward facing sensors in a housing on a pedestal for being positioned on the edge of a desk or TV stand. During operation, the housing tilts up and down automatically to find the floor and see the users in the play space. Since it can only sense large arm movements, it is not suitable for controlling a pointing device in a desktop or notebook computer.
A motion controller designed for fine control is the LEAP MOTION CONTROLLER by Leap Motion in San Francisco, Calif. It includes a rectangular housing for being positioned in front of a computer monitor. An upward facing sensor on the top of the housing is arranged to detect hand and finger movements above the controller. The LEAP MOTION CONTROLLER is sensitive enough to detect even small finger movements for precise pointer control. The LEAP MOTION CONTROLLER has a field of view directed upward and away from the keyboard. It requires the arm and hand to be moved away from the keyboard and raised up and forward into its field of view, but raising the arm frequently all day long is tiring.
Prior art pointing devices or motion controllers each has some advantages and some disadvantages that make their use inconvenient when repeated many times per day, or cause discomfort and even injury over the long term.
Therefore an objective of the invention is to provide a controller for controlling computer display objects with hand movements in the air while substantially keeping the arms substantially in their typing positions relative to a keyboard. It overcomes the primary drawback of prior art mice and touch pads by eliminating having to move the hand a substantial distance from its typing position to grab a mouse or operate a touch pad. It overcomes the primary drawback of prior art combination touch pad and touch sensitive keyboards by operating over a mechanical keyboard. It overcomes the primary drawback of prior art roller bar pointing devices by eliminating having to move the hand away from its typing position. It overcomes the primary drawback of prior art motion controllers by eliminating having to raise the arm high up from the typing position. It achieves these objectives and advantage with a sensor elevated above the keys of a mechanical keyboard. The sensor is directed to view and monitor a user's first and second hands in typing positions on the keyboard. The controller includes a switch positioned adjacent the spacebar of the keyboard. The sensor and switch are connected to a processor which is connected to a computer system. When the switch is engaged by the thumb of the user's second hand, the processor is responsive to the sensor to track the first hand's motions in the air, directly over and in close proximity to the keyboard for controlling display objects. There is no need to raise the arms up from their typing positions. When the switch is disengaged by the thumb, the processor communicates with the computer system to disable motion tracking so the fingers may type on the keyboard without controlling display objects. In another embodiment, switching between display object control mode and typing mode may be performed by software, without a physical switch. In this embodiment, the sensor is arranged to detect the second hand performing a predetermined gesture as a command to enable display object control mode, and detect the second hand ceasing to perform the gesture as a command to disable display object control mode.
As shown in
Display object controller 10 includes a temporary operating mode and a toggle mode. In temporary mode, processor 12 is arranged to enable motion control when switch 16 is touched, and disable motion control when switch 16 is not touched. Toggle mode may be entered with another command, for example, by tapping switch 16 twice in quick succession. Toggle mode may be disabled by tapping switch 16 twice in quick succession again. Other methods or an additional toggle mode switch may be provided to enter or release toggle mode.
Alternatively, mode switching may be performed by additional instructions in software 28. When switch 16 is engaged, sensor 14 remains active but processor 12 is arranged to send a command to computer system 20 to disable display object control via software 28.
In another embodiment, a switching means is provided as additional instructions in software 28 instead of a touch or mechanical switch 16. Sensor 14 is configured to sense the motion of both hands. The software is arranged to detect a predetermined gesture by the second hand as a command to enable display object control mode, and disable display object control mode when the hand ceases to perform the gesture. The gesture is preferably unusual enough so that the second hand is unlikely to unintentionally perform the gesture while typing or resting, but still easily performed without straining or fatigue. An example of such a gesture may be touching the thumb and index finger together, which is unlikely to happen unintentionally yet may be performed with ease. I claim:
