Patent Application
20090058819
The disclosed embodiments to a display interface for a computing device.
Over the last several years, the growth of cell phones and messaging devices has increased the need for keypads and button/key sets that are small and tightly spaced. In particular, small form-factor keyboards, including QWERTY layouts, have become smaller and more tightly spaced. With decreasing overall size, there has been greater focus on efforts to provide functionality and input mechanisms more effectively on the housings.
In addition to a keyboard, mobile computing devices and other electronic devices typically incorporate numerous buttons to perform specific functions. These buttons may be dedicated to launching applications, short cuts, or special tasks such as answering or dropping phone calls. The configuration, orientation and positioning of such buttons is often a matter of concern, particularly when devices are smaller.
At the same time, there has been added focus to how displays are presented, particularly with the increase resolution and power made available under improved technology. Moreover, form factor consideration such as slimness and appearance are important in marketing a device.
Embodiments described herein provide for a mobile computing device having a pressable display assembly on which soft buttons and other features can be selected. As will be described, a contact-sensitive display assembly for a computing device is provided, having a pressable display surface that, when pushed by user-interaction, triggers a processor of the computing device to recognize the interaction as being deliberate or otherwise distinguishable from contact that involves grazing the display surface or providing trace input.
In one embodiment, the display assembly provides a surface that is pressable by enabling the display surface (or the whole assembly) to be moved inwards to actuate or trigger a contact element. Thus, the amount of distance that the display surface travels as a result of user-contact may determine whether the user-contact satisfies a threshold for considering the contact deliberate, or otherwise distinguishable from, for example, the user grazing the display surface.
In another embodiment, the display assembly may include a force sensor that can detect force applied to a designated region of the display surface. The force sensor may operate independent of any other sensor that can detect a position of an object. The display surface may travel a negligible amount in order to trigger the force sensor. The force sensor may measure the amount of force applied to the display surface by a particular user-contact in order to determine whether the contact satisfies a threshold for determining that the contact was deliberate or otherwise distinguishable from, for example, the user grazing the display surface.
With embodiments described herein, a mechanism (e.g. switch element, force sensor) may be combined with a display assembly in order to identify when a user-contact with the display surface satisfies a threshold criteria. Responsive to the threshold criteria being satisfied, the processing resources of the mobile computing device determine the position of an object using position sensors. The position is determined at the time the contact was made (e.g. just before or just after when the user-contact occurred). In one embodiment, the position information is then interpreted based on an assumption that the user-contact was deliberate. The user-contact may be distinguished from incidental contact, or from trace input. For example, the user-contact may be interpreted as selection input when the threshold criteria is met.
Among other benefits, embodiments described herein promote the use of soft keys, buttons and other features on mobile computing devices. For example, conventional mobile computing devices often have buttons that have pre-designated functions of performing application launches, software/hardware control or actions. Embodiments described herein enable some or all of such pre-designated buttons to be presented as soft keys or buttons. As soft keys or buttons, more area on a face of a mobile computing device may be used for display area, and fewer mechanical buttons or features are necessary. Embodiments described herein promote the use fewer mechanical buttons, which provides a cost savings. Furthermore, the use of soft keys and buttons enables optional dynamism with the manner the keys and buttons are presented, configured and used.
As used herein, the term “soft” means displayed. For example, a “soft button” is a displayed button.
Additional embodiments described herein provide for a mobile computing device that combines the use of soft user-interface features and mechanical switching. According to one or more embodiments, a user is able to interact with a contact-sensitive display of a mobile computing that is movable inward with respect to the housing. The inward movement of the display enables certain types of user-interactions with the contact-sensitive display to be recognized as a particular class or type of input.
Still further, one or more embodiments enable a device to provide certain button functionality through use of a contact-sensitive display that is push-sensitive. For example, the display surface may travel slightly inwards and/or interact with a force sensor. In this way, a contact with the display surface actuates an underlying switch or contact element. In particular, one or more embodiments enable a device to provide selectable icons or soft-buttons on a region of a contact-sensitive display. The user may select a particular soft feature (e.g. such as a displayed button) by sufficiently contacting the soft feature on the display surface to actuate the processor into interpreting the contact as selection input. As selection input, the processor may use the position of the object making the sufficient contact to determine the coinciding soft feature that encompasses the coordinates of the object's position.
Among other advantages, embodiments described herein enable many of the buttons or mechanical features normally found on devices such as mobile computing devices to be found on a display region of the device.
Embodiments described in this application may be implemented on any type of computer having a sensor aware display for detecting user-interaction. One type of computer on which embodiments described herein may be implemented is a mobile computing device, such as a cellular computing device, wireless messaging device, personal digital assistant, or hybrid/multi-functional device for enabling cellular voice and data transmissions. These devices typically have relatively limited display sizes, processing resources, and display area. The ease of use and flexibility provided by embodiments described herein has benefit to such devices, as input features and mechanisms described in connection with such embodiments compensates for the relatively more limited dimensions such devices typically have. However, embodiments described herein may also be implemented by desktop computers, laptop computers, and large profile computers.
The display surface 120 use be integrated or coupled with sensors that detect presence of an object on the surface. Such sensors can provide information for determining the position of an object that either makes contact with or is in close proximity to display surface 120. In one embodiment, the display surface 120 is part of a display assembly that uses capacitive sensors, so that proximately held objects can also be contacted.
The housing 110 may contain one or more internal components, including processor and memory resources of the device. The processor may generate data that is displayed as content on the display surface 120. As will be described, an internal processor may also generate various soft features that are presented for use in combination with a mechanism for determining whether a detected user-contact is sufficient or satisfies some criteria for considering the contact as selection input and/or deliberate.
According to an embodiment, the display surface 120 is moveable inwards (as shown by directional axis Z), and a measure of the inward movement is determinative of whether the contact is sufficient. In one embodiment, the display surface 120 is pivotable inward. In an example such as shown by
As an alternative or addition to being moveable inwards by pivot, the display surface 120 may be coupled with a force sensor that operates independent the position sensors that detect the position of the object. In one embodiment, the display assembly is coupled to or in contact with a force sensor that can detect (i) application of force on the display surface, and (ii) a magnitude of the applied force or of the moment resulting from the applied force. If the contact with the display surface 120 is performed with sufficient force to exceed a threshold, an embodiment provides that the processor interprets the contact by the object as deliberate, or otherwise differently than had the threshold not been met.
The amount of inward movement permitted for display surface 120 may be slight or negligible. In particular, almost no movement of the display surface 120 is needed if a force sensor is used. If inward travel measurement is used for the criteria, the distance may be that which is required to collapse a dome switch, which under one implementation, may be between 0.1 mm or 0.5 mm (e.g. 0.3 mm). Larger travel distances are also contemplated, such as in the range of 1-3 mm.
As described with an embodiment of
Accordingly, an embodiment provides that the device 100 provides an interface region 125 that overlap a threshold detector 128 underlying the display surface 120. In one embodiment, the threshold detector 128 may be in the form of a mechanical and/or electrical switch that can detect when the contact causes sufficient travel from the display surface. For example, the threshold detector 128 may be in the form of a mechanical switch. In another embodiment, the threshold detector 128 may be a force sensor that detects or determines where a force applied with the contact is sufficient. The interface region 125 may display various forms of user-interface features, including buttons 129 or icons (“soft buttons”). At the same time, the user-interaction with any portion of the interface region 125 may result in a contact event that is sufficient to be considered deliberate or distinguishable from grazing. In an embodiment, the occurrence of the contact event in connection with the user contacting a point in the interface region 125 is interpreted by the processor as a selection of the feature that is displayed (or alternatively most proximate) at the point of contact. Thus, for example, the user may select a soft button by pushing or deliberately contacting the soft button region of the display surface, similar to a mechanical button or feature.
One or more embodiments contemplate that soft buttons and features that are displayed for use with threshold detector 128 are provided within designated boundary or region that occupies only a portion of the overall area of the display surface 120. In one embodiment, the interface region 125 is provided at a lower region of the overall display surface 120, where the soft buttons 129 are provided.
In one implementation, the soft buttons 129 are persistent and static. As a variation, the display may be powered to dim or power off in the region where the soft buttons 129 are provided, so as to make the soft buttons disappear. Still further, the region where the soft buttons 129 are provided may be dynamic, with ability to insert other soft features (e.g. see keyboard 630 of
Still further, embodiments provide for use of optical sensors which can detect light variations resulting from objects passing over the display surface. In such implementations, mechanisms or techniques may be used to distinguish light variations that result from user-contact, as opposed to user motioning an object over the display. For example, a specific object may be used having a tip that creates light variation patterns that are distinguishable from more general motions that may result from other objects or non-contact interactions.
Additionally, with the housing 110, numerous internal components may provided, including the processor 250 and memory resources 260. The processor 250 may be provided on a substrate 252 and interconnected with an electrical contact layer 230 through, for example, a bus connector 255. In an embodiment in which optical sensors are used, one way in which incidental light variations may be distinguished from the light variations resulting from deliberate interactions (e.g. use touching of soft button) is through detection of inward movement of the display surface, as described with embodiments provided herein.
In an embodiment, the sensor components 224 detect the position of any object that comes in contact with the display surface 120. How and whether the position information is used may depend on whether a switch event occurs in connection with the contact. According to an embodiment, the electrical contact layer 230 underlies at least a region of the display assembly 220. One or more contact elements 232 may be provided on the electrical contact layer 230.
Alternatively, the display assembly may be limited in pivot movement at top end 239. For example, the top end 239 may form a base from which the bottom end 235 cantilevers. Variations provide that both top and bottom end 235, 239 are hinged or otherwise pivotally coupled to a frame of the housing.
In an embodiment, when the display assembly 220 (or display surface 120) moves inward (either through pivot along rotational direction S or translation), pressure or contact may be applied onto the element(s) 232 of the electrical contact layer. Actuation of the element 232 may correspond to either the initial contact, or the release after the initial contact. For example, in a snap-dome implementation, the actuation may be provided for either the dome collapse or release. The contact element switches so as to signal as a switching event the occurrence of the inward movement of the display assembly 220 or its surface 120. The user may interact with the display surface 120 by either (i) applying sufficient force to move at least the portion of the display assembly inward and actuate the element 232 on the layer 230, or (ii) applying insufficient force to actuate the element 232 while contacting the display surface. In either case, an embodiment provides that the sensor components 222 is configured to detect a position of the object making contact with the display. In the latter case where the element 232 is not actuated by contact from the object, the processor 250 may be configured to either ignore the interaction, or interpret the interaction as some form of input, such as trace input (e.g. handwriting or “ink” input).
If the contact element 232 is actuated, the processor 250 is configured to associate the position of the object making contact with the display surface 120 with an input value. The input value may be one that is assigned to a region that includes or is proximate to the point of contact. As described with one or more embodiments, the processor may display buttons or icons in interface regions 128. The interface regions 128 may have pre-determined values assigned to individual soft buttons, so that each point in the region of the displayed button or icon may have the same value. If the position of the object in contact with the display (when the display assembly is pushed inwards to actuate the contact element 232) coincides with an area of the display surface 120 encompassed by one of the soft buttons, the processor 250 identifies the input value assigned to the particular soft-button or feature. The input value may be, for example, a character input (alphabet, numeric, special character), or functional (e.g. application launch, display or device control, menu launch).
An embodiment such as described enables the processor 250 to ignore any contact with the interface region 128 of the display surface 120 when the contact does not result in the contact element 232 switching. This enables the processor to distinguish incidental input from deliberate user-input. In one embodiment, the ability of the processor 250 to distinguish some incidental input promotes a design in which core aspects of the user-interface of the device are provided as soft buttons. In such a design, accidental use of the soft buttons is limited or made equivalent to mechanical buttons.
While an embodiment of
Numerous other variations may be used to enable the display assembly 220 to move inward. One or more embodiments assume the display assembly is rigid, such as provided by an LCD type display. However, other embodiments contemplate use of flexible display surfaces for providing features described with embodiments herein. These include, for example, E-INK (as manufactured by E-INK CORP.) display technology.
According to an embodiment, the force sensor 282 is resistive, so as to change resistance when force (i.e. pressure) is present. The force sensor 282 may be tied to the processing resource to enable a user or manufacturer to change the settings of the force sensor 282. For example, the force sensor 282 may be made to be more sensitive, so that light contact may be deemed deliberate. Additionally, the processor 250 may use algorithms that reference position information (from sensors 224) with output from the force sensor. For example, in a hinge construction, the processor 250 may realize that contact with some regions of the display may incur less moment and thus apply less pressure, even though from the user's perspective, the force applied should be sufficient. In such a scenario, the processor may implement an algorithm to adjust threshold force levels based on the position where the contact is received.
In an embodiment, the force sensor 282 may be provided on a substrate or other thickness that supports its use within the device. The sensor platform 280 may correspond to any depth (provided as discrete or continuous elements) that contains one or more force sensors 282, which themselves may be in the form of modules. The sensor platform 280 may also include interconnectivity elements, such as wiring, to electrically couple force sensors in use with processing resources and other components. Still further, one or more embodiments further contemplate use of a sensor platform 280 that includes multiple force sensors 282. The processor can sum force outputs from multiple sensors, reference position information, and based on the position of the object, make a more accurate determination as to whether the input was deliberate, distinguishable as selection input etc.
Step 310 provides that one of more soft-features are provided on a region or portion of the display surface 120. The features may take the form of buttons (i.e. “soft buttons”), keys, menu items or other features. Each feature may be assigned a set of coordinates, defining an area of the feature on the display surface 120.
In a step 320, an occurrence of a contact with the display surface 120 is detected, and a determination is made as to whether the contact satisfies a designated threshold criteria. The determination may be made programmatically, as in the case where force sensors are used. Alternatively, the determination may be made inherently through the structure of the assembly, as in the case when travel of the display surface is to actuate an electrical contact. Thus, as described with an embodiment of
If the determination or result of step 320 is that the contact was insufficient or does not satisfy the threshold, an embodiment provides that the contact by the object is ignored. For example, the contact may be assumed incidental. As an alternative, an embodiment provides that the contact is detectable, but interpreted as an alternative form of input. For example, the contact by the object may be interpreted as trace or directional input.
When the determination of step 320 is that the contact met the threshold for being sufficient, the position of the object in contact with the display is determined in step 330. In one embodiment, sensor components 224 may be used, for example, to track and/or record the position of the object when it makes contact with the display surface. At an instant when the occurrence of step 320 is detected, the position of the object may be determined.
Step 340 provides that the position of the object is identified as being within a boundary of a region for a particular soft button or feature. As such, a soft-feature or button is identified from the position of the object when the occurrence of step 320 is detected. Accordingly, one embodiment provides that the combination of the sufficiency determination of step 320 and the position of the object as determined in step 330 are interpreted as selection input by the processor 250. The selection input may be for the particular soft button or feature that contains the contact coordinate of the object when the occurrence of step 320 is detected.
Embodiments such as described above and with
In one embodiment, the soft buttons 412 are persistent on a dedicated portion of the display surface 415. For example, the soft buttons 412 may appear anytime the device 400 is turned on. In another embodiment, the soft buttons 412 are semi-persistent, such as being displayed whenever the device is in a particular mode. For example, soft buttons 412 may be displayed whenever a particular application is in use. As an alternative or addition, the soft buttons 412 may be swapped with other buttons, depending on the application that is in use.
In another implementation, the device 400 may be operable in both a landscape and portrait mode. In landscape mode, for example, the device may display video content or have use that does not require soft buttons 412. As such, the buttons 412 may be hidden or made to disappear when, for example, the device is switched from portrait to landscape mode.
Various configurations and constructions for enabling the sliding housing design may be used. For example, as illustrated with an embodiment of
Alternatively, housing segments may telescope-meaning lower housing segment 508 contains the upper housing segment 512 when it moves upward or downward. Such containment may be peripheral, meaning the entire periphery of the upper housing segment 512 may, on at least one cross-section, be contained within a section of the lower housing segment 508.
Numerous alternative constructions are also contemplated. For example, housing segments 508, 512 may use “flip” construction, rather than a slider. In a flip construction, the housing segments 508, 512 are pivotally coupled such that the two housing segments pivot between closed and open positions.
Various kinds of soft features may be implemented in accordance with one or more embodiments described herein. With an embodiment of
According to an embodiment, the buttons 612 have assignments to icons or other graphics. For example, an icon 614 may be assigned to a particular application. A selection input may be received with an object (such as a human finger) contacting the display 620 on the soft button 612 with sufficient force to push the display inward or alternatively be registered by force sensor 282 (
Furthermore, under an embodiment, the appearance of individual icons 614 may be altered with settings or user-input. For example, icons 614 may be changed in color, size or other appearance.
In one embodiment, the display region 618 where soft buttons 612 are provided is persistent, so as to be present when display 620 is operational. In an embodiment, the display region 618 is persistent when the device is in a particular mode of operation. Still further, the display region 618 may disappear or re-appear depending on user preferences, input or other conditions.
As an alternative or addition, an embodiment of
In addition to enabling new soft-feature mechanisms to be provided, one embodiment provides that the display region 618 may be adjusted in size, shape, location or appearance. Thus, the display region 618 may be a dynamic and/or configurable feature, rather than a static or persistent feature.
Sensors 720 may couple to processor 710 to provide position information 722 of an object in contact with a display surface of the display assembly 730. In one embodiment, the position information 722 may identify a specific region or coordinate that coincides with a soft feature, such as a displayed button on a region of the display 732. The threshold detector 744 may trigger with sufficient contact on the display surface. The processor 710 may interpret the combination of triggering signals from the threshold detector 744 and position information 722 from sensors 720 as a soft-key press events, associated with a specific key identified from the position information.
Although illustrative embodiments of the invention have been described in detail herein with reference to the accompanying drawings, it is to be understood that the invention is not limited to those precise embodiments. As such, many modifications and variations will be apparent to practitioners skilled in this art. Accordingly, it is intended that the scope of the invention be defined by the following claims and their equivalents. Furthermore, it is contemplated that a particular feature described either individually or as part of an embodiment can be combined with other individually described features, or parts of other embodiments, even if the other features and embodiments make no mentioned of the particular feature. This, the absence of describing combinations should not preclude the inventor from claiming rights to such combinations.
