This application generally relates to user interaction with electronic devices that are at least in a partially submerged state. In particular, the application relates to platforms and techniques for enabling users to select functions and facilitate operations of an electronic device when the electronic device is submerged.
Electronic devices such as smart phones are equipped with a wide variety of sensors that support various functionalities and applications. For example, a user may use a camera application and image sensor of an electronic device to capture and store digital images. Many existing electronic devices are also equipped with capacitive touch-sensitive user interfaces that support users making various selections and facilitate various functions via touch events. However, the electronic devices are unable to detect certain touch events when in certain environments.
In particular, if an electronic device is dropped or placed in a conductive medium such as water, the water will cause a change in the capacitive charge field on all or nearly all of the locations of a capacitive touch-sensor in contact with the water, which prevents the user interface from detecting touch events from a user. The conductive medium therefore causes a change in capacitance, like that resulting from a finger touch event, as a result of the electronic device being submersed in the conductive medium. Therefore, the user is unable to make selections and facilitate functions via the user interface while the electronic device is submerged.
Accordingly, there is an opportunity to enable users to facilitate functionalities and operating modes of electronic devices while the electronic devices are submerged.
The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification, and serve to further illustrate embodiments of concepts that include the claimed embodiments, and explain various principles and advantages of those embodiments.
Generally, users are spending an increasing amount of time interacting with various mobile electronic devices such as smart phones and tablets. Typically, the mobile devices are equipped with capacitive touch-sensitive user interfaces. For example, the user interfaces incorporate capacitive touch panels that can sense user contact, for example via a user's finger creating a touch event. Users can select various functions and control various operations of the mobile devices via these touch events. With the increasing capabilities of mobile devices, it is increasingly desirable for users to be able to interact with their mobile devices in a wide variety of situations and environments.
When an electronic device is submerged in a medium that is conductive, touch pixels of the capacitive touch-sensitive user interface can be used to detect partial or complete submersion. For example, non-purified water is a conductive material capable of “activating” touch pixels of a capacitive touch panel of an electronic device. If the electronic device is fully submerged, the conductive medium contacts the entire user interface (i.e., many pixels along the entire capacitive touch panel will activate), and the user interface is not able to detect any additional contact (e.g., a user's finger). Therefore, a user will not be able to leverage the user interface to select or facilitate the functions and operations that are normally activating using the capacitive touch-sensitive user interface. In addition, if the device is partially submerged, the portion of the capacitive touch panel that is submerged will “activate” and also limit the ability of the user to leverage the corresponding portion of the user interface to select or facilitate the functions and operations that may be normally activated using the capacitive touch-sensitive user interface. The techniques as discussed herein for managing various operating modes of the electronic device may be implemented when the electronic device is either partially submerged or fully submerged.
The term “activate” as used herein may refer to a sensor location of the capacitive touch sensitive user interface changing its state, which indicates that the surface is being touched in that sensor location. The state change can be, but is not limited to, a change in the resonant frequency of a circuit connected to the position or a change in the impedance measured with respect to ground at that sensor location.
According to embodiments, an electronic device can detect when it is submerged or partially submerged in a conductive medium by virtue of at least a portion of its user interface being capacitively coupled to its exterior casing. Responsive to detecting a submerged or partially submerged state, the electronic device can modify its operating mode to enable a user to select certain features or functions supported by the electronic device using an alternate user interface that is not affected by the submersion. In some embodiments, the electronic device may switch its mutual capacitance measurement to a self-capacitance measurement with a known reference baseline that may be factory set, whereby the self-capacitance measurements are detected via single touch events. When the operating mode is modified, the user interface can instruct the user to select one or more hardware buttons that correspond to one or more of the features or functions. When the user actuates a certain hardware button, the electronic device can perform the corresponding function. The embodiments as discussed herein therefore offer a benefit to users of the electronic devices by enabling the users to facilitate certain applications and functionalities while the electronic devices are submerged or partially submerged in a conductive medium. This benefit is especially important as electronic devices become more advanced and more ubiquitous.
Generally, the exterior of the electronic device 105 may be defined by a capacitive touch-sensor user interface 103 (e.g., a touchscreen or a touchpad) and an exterior casing 111. The user interface 103 is configured to display content and receive or detect input from a user of the electronic device 105. The exterior casing 111 may take up various remaining portions or surfaces of the electronic device 105, and may be designed to house or enclose various interior components of the electronic device 105. The exterior casing 111 may include one or multiple pieces or components, and may be composed of various materials (e.g., plastic, metal, glass, etc.) or combinations of materials. As illustrated in
The electronic device 105 can include audio components such as a speaker 102 and a microphone 110. The speaker 102 is configured to output audio based on an electrical audio signal and the microphone 110 is configured to convert detected sound into an electrical signal. As illustrated in
The electronic device 105 can further include various sensors configured to capture image data and detect other general environment data associated with the electronic device 105. In particular, the electronic device 105 can include an image sensor 108 configured to capture digital images and generate resulting imaging data (e.g., digital photos and digital videos). It should be appreciated that various locations, types, and sizes of the image sensor 108 are envisioned. Further, it should be appreciated that the electronic device 105 can include other sensors, such as a proximity sensor, gyroscope, light sensor, accelerometer, location module (e.g., a Global Positioning System (GPS) module), and/or other sensors.
The electronic device 105 can further include one or more hardware buttons 115, 116, 117 that are each adapted for actuation by a user of the electronic device 105. A user actuating one or more of the hardware buttons 115, 116, 117 can cause the electronic device 105 (or any component or application thereof) to initiate, perform, or execute one or more corresponding functions. For example, if the electronic device 105 is executing a music playback application and detects that a user actuates the hardware button 116, the electronic device 105 can cause its speaker 218 to increase its output volume. According to embodiments, the functions that correspond to actuation of the hardware buttons 115, 116, 117 may vary depending on a currently-executing application or function.
The electronic device 205 can further include at least one speaker 218 (e.g., a “built-in” speaker) configured to output audio based on an electrical audio signal. As illustrated in
The touchscreen user interface 103 as illustrated in
Referring back to
If the electronic device 105 is partially submerged, the portion of the capacitive panel that is submerged will “activate” and will fail to respond to additional capacitive contact. According to some embodiments, the electronic device 105 may set a threshold for a contiguous percentage of the capacitive panel that is “activated,” which can cause the electronic device 105 to perform the same or similar actions as described herein for when the electronic device 105 is fully submerged. Although the descriptions contained herein generally describe the conductive material as water, it should be appreciated that submersion in other conductive liquid or near-liquid materials such as gels are envisioned.
In operation, the processor 122 is configured to receive signal or contact data from the capacitive panel of the user interface 103 and examine the contact data to determine whether the capacitive panel is capacitively coupled to a ground potential such as the floating ground of the exterior casing 111. Generally, if the contact data indicates that the entire capacitive panel is “active,” the capacitive panel is capacitively coupled to the exterior casing 111 and the electronic device 105 is likely fully submerged in a conductive material. Conversely, if the contact data indicates that at least a portion of the capacitive panel is not “active” (e.g., if only half of the capacitive panel is disposed in the conductive material), the entire capacitive panel is not capacitively coupled to the exterior casing 111 and the electronic device 105 is likely not fully submerged in a conductive material. If the contact data indicates that a contiguous area of the capacitive panel is “active,” and that a percentage of the contiguous area relative to the area of the capacitive panel has exceeded a certain threshold (e.g., 20%, 40%, 60%, etc.), then the electronic device 105 may be considered partially submerged.
The processor 122 is configured to automatically receive updated contact data from the capacitive panel to determine when the electronic device 105 enters a partial or fully submerged state (i.e., enters a conductive material) as well as exits a partial or fully submerged state (i.e., is removed from a conductive material). In some embodiments, if the electronic device 105 determines that a contiguous “activated” area of the capacitive panel falls below (or rises above) a detection comparison threshold, then the electronic device 105 may be considered to have exited (or to have entered) the submerged state. The processor 122 may also be configured to determine whether the electronic device is submerged in a conductive material according to various shifts in signal levels.
Referring to
On the left side of
The electronic device 405 may exit the conductive material 425 as indicated on the right side of
According to embodiments, the processor 122 is configured to initiate various operating modes of the electronic device 105 in response to determining that the electronic device 105 is submerged. The various operating modes can incorporate the various sensors of the electronic device 105. For example, the operating modes may include audio capture using the microphone 110, image and/or video capture using the image sensors 108 and/or 207, illumination mode using the illumination component 209, and/or other modes. The processor 122 may further cause the user interface 103 to display indications and information associated with the operating modes, such as various menus, interfaces, or selections that indicate various functions of the operating modes. In some embodiments, the processor 112 may deactivate or disable one or more wireless communication modules 114 of the electronic device 105 so that the electronic device 105 does not waste power attempting to transmit and receive while submerged. The antennas of a wireless transceiver that are tuned for an air medium will be highly inefficient when transmitting or receiving in a non-air medium.
As discussed herein, when the electronic device 105 is partially or fully submerged in a conductive material, the user interface 103 is unable to detect capacitive user input beyond that of the conductive medium, and therefore a user is unable to make touch selections via the capacitive user interface 103 to facilitate the various operating modes. However, according to embodiments, the processor of the electronic device 105 may configure the hardware buttons 115, 116, 117 to enable the user to make various selections and facilitate the operating modes of the electronic device 105. Therefore, by virtue of the user interface 103 indicating the various functions of the operating modes, and the ability of the user to make selections using the hardware buttons 115, 116, 117, the user is able to effectively operate the electronic device 105 while the electronic device 105 is submerged in a conductive material.
When a processor of the electronic device 505 determines that the electronic device 505 is submerged (partially or fully) in a conductive material (as indicated by “B” in
The processor can detect an actuation of the hardware button 515 by the user and can cause the user interface 503 to indicate the camera mode and display functionalities associated therewith (as indicated by “C” in
It should be appreciated that other functions associated with a general image/video capture operating mode are envisioned. In particular, the electronic device 505 may modify a particular image capture setting in response to detecting submersion. For example, the optimal shutter speed and/or aperture of an image sensor may differ depending on whether the electronic device 505 is submerged or not submerged, and the electronic device 505 may automatically modify each setting accordingly. For further example, the electronic device 505 may automatically disable an auto-focus setting of the image sensor in response to detecting submersion. Similarly, the electronic device 505 may perform other image capture-related functionalities in response to the user actuating one of the hardware buttons 515, 516, 517. For example, if the user actuates the hardware button 516 (or the hardware button 517), the image sensor may optically zoom in (or zoom out).
If the user instead selects a hardware button 815, the scrollable menu 829 displays a different selectable function (as shown: “camera mode”), as indicated by the “B” interface in
As illustrated in the “C” interface of
There are many methods for using hardware buttons and a non-touch-sensitive display to guide a user through various menus to control an electronic device. The method shown in
The electronic device analyzes 934 the contact data to determine whether a large contiguous portion of the capacitive touchscreen panel is capacitively coupled to ground, for example an earth ground or a floating ground such as an exterior casing of the electronic device. In particular, if the analysis determines that no contiguous area of the capacitive touchscreen above a detection threshold (e.g., 20%, 40%, 60%, etc.) is capacitively coupled to ground (“NO”), then the analysis concludes that the electronic device is neither partially nor fully submerged in a conductive medium, and the electronic device can operate 935 as normal. In contrast, if the analysis determines that a contiguous area of the capacitive touchscreen above a detection threshold (e.g., 20%, 40%, 60%, etc.) is coupled to ground (“YES”), then the analysis concludes that the electronic device is partially or fully submerged in a conductive material and, in an optional embodiment, the electronic device disables 936 one or more wireless communication modules so that the electronic device is unable to send or receive corresponding data. This decreases power consumption of the electronic device when the device would be ineffective at transmitting and receiving wireless data in the conductive medium.
The electronic device determines 938 which function or operating mode to indicate or initiate on a user interface. In some cases, the electronic device may indicate or initiate a default function or operating mode. In other cases, a user of the electronic device may select which function or operating mode for the electronic device to indicate or initiate. If the function or operating mode is a scrollable menu (“MENU”), the electronic device displays 954 the scrollable menu in a user interface. According to embodiments, the scrollable menu is associated with a plurality of various functions operable by the electronic device (e.g., an illumination mode, an audio capture mode, a camera mode, etc.), and the scrollable menu can indicate one or more functions at a time. The electronic device detects 956 an actuation of a hardware button by the user, where the hardware button corresponds to the scrollable menu. Responsive to detecting the actuation of the hardware button, the electronic device scrolls 958 through the menu. In particular, the electronic device can cause the scrollable menu to indicate a function different than a function previously displayed by the scrollable menu. The electronic device detects 960 an actuation of an additional hardware button (e.g., a hardware button different from the hardware button of 956). The additional hardware button may correspond to the function currently highlighted or displayed by the scrollable menu. Accordingly, in response to detecting the actuation of the additional hardware button, the electronic device executes 962 the function highlighted in the scrollable menu.
If the function or operating mode is image or video capture (“IMAGING”), the electronic device displays 940 a live preview of image data captured by an image sensor of the electronic device. Accordingly, the user may view currently-captured image data of the image sensor. The electronic device optionally modifies 942 one or more image capture settings. For example, the electronic device may modify or disable settings related to aperture, focal length, shutter speed, ISO, auto focus, and/or others, to improve submersed image capture.
The electronic device detects 944 an actuation of a hardware button by a user. In embodiments, the electronic device can indicate, in a user interface, a corresponding function of the hardware button so that the user can assess the function before actuating the hardware button. In an optional embodiment, if the hardware button corresponds to a zoom function, the electronic device zooms 946 the image sensor in response to the electronic device detecting the actuation of the hardware button. In another embodiment, if the hardware button corresponds to an image/video capture function, the electronic device captures 948 image data in response to the electronic device detecting the actuation of the hardware button. It should be appreciated that the electronic device may perform the zooming and capturing of 946 and 948 in response to detecting the actuation of different hardware buttons.
If the function or operating mode is audio capture (“AUDIO”), the electronic device indicates 949 the audio capture mode in the user interface, for example by instructing a user to select or actuate a hardware button to begin recording. The electronic device detects 950 an actuation of the hardware button by the user. It should be appreciated that the hardware button of the audio capture operating mode is the same as or different from the hardware button of the image/video capture operating mode. Responsive to detecting the actuation of the hardware button, the electronic device captures 952 audio data, for example via a microphone of the electronic device.
If the function or operating mode is illumination (“ILLUMINATION”), the electronic device indicates 964 the illumination mode in the user interface, for example by instructing a user to select a hardware button to illuminate an illumination component such as an LED. The electronic device detects 966 an actuation of the hardware button by the user. Responsive to detecting the actuation of the hardware button, the electronic device illuminates 968 the illumination component to provide light in a vicinity of the electronic device.
Although not depicted in
Generally, the memory 1098 can include one or more forms of volatile and/or non-volatile, fixed and/or removable memory, such as read-only memory (ROM), electronic programmable read-only memory (EPROM), random access memory (RAM), erasable electronic programmable read-only memory (EEPROM), and/or other hard drives, flash memory, MicroSD cards, and others.
The electronic device 1005 can further include a communication module 1095 configured to interface with one or more external ports 1090 to communicate data via one or more networks 1076. For example, the communication module 1095 can leverage the external ports 1090 to establish a wide area network for connecting the electronic device 1005 to other components such as a remote data server. According to some embodiments, the communication module 1095 can include one or more transceivers functioning in accordance with IEEE standards, 3GPP standards, or other standards, and configured to receive and transmit data via the one or more external ports 1090. More particularly, the communication module 1095 can include one or more WWAN, WLAN, and/or WPAN transceivers configured to connect the electronic device 1005 to wide area networks, local area networks, and/or personal area networks. According to embodiments, the processor 1097 can enable or disable the communication module 1095 and/or the external ports 1090 depending on whether the electronic device 1005 is submerged.
The electronic device 1005 can further include one or more sensors 1096 such as one or more image sensors 1007 and a location module 1074. The electronic device 1005 can also include one or more other sensors 1075 such as, for example, accelerometers, gyroscopes, and/or proximity sensors, light sensors, infrared sensors, touch sensors, NFC components, and other sensors. The memory 1098 can further store a set of sensor settings 1073 that correspond to various settings of the sensors 1096. The processor 1097 may apply certain settings to certain sensors depending on a submersion state of the electronic device 1005.
The electronic device 1005 may further include a user interface 1091 configured to present information to the user and/or receive inputs from the user. As illustrated in
In general, a computer program product in accordance with an embodiment includes a computer usable storage medium (e.g., standard random access memory (RAM), an optical disc, a universal serial bus (USB) drive, or the like) having computer-readable program code embodied therein, wherein the computer-readable program code is adapted to be executed by the processor 1097 (e.g., working in connection with the operating system 1099) to facilitate the functions as described herein. In this regard, the program code may be implemented in any desired language, and may be implemented as machine code, assembly code, byte code, interpretable source code or the like (e.g., via C, C++, Java, Actionscript, Objective-C, Javascript, CSS, XML, and/or others).
Thus, it should be clear from the preceding disclosure that the systems and methods offer increased usability of electronic devices. In particular, the embodiments enable users to interact with and facilitate operations of electronic devices while the electronic devices are submerged in a conductive material.
This disclosure is intended to explain how to fashion and use various embodiments in accordance with the technology rather than to limit the true, intended, and fair scope and spirit thereof. The foregoing description is not intended to be exhaustive or to be limited to the precise forms disclosed. Modifications or variations are possible in light of the above teachings. The embodiment(s) were chosen and described to provide the best illustration of the principle of the described technology and its practical application, and to enable one of ordinary skill in the art to utilize the technology in various embodiments and with various modifications as are suited to the particular use contemplated. All such modifications and variations are within the scope of the embodiments as determined by the appended claims, as may be amended during the pendency of this application for patent, and all equivalents thereof, when interpreted in accordance with the breadth to which they are fairly, legally and equitably entitled.