Patent Grant
9799279
The present application is related to electronic displays, and more specifically to methods and systems that create reliefs on electronic displays.
Current electronic displays associated with electronic devices, such as cell phones, tablets, etc., have planar screens that do not deform.
Introduced here are methods and systems to create a relief on an electronic display. In one embodiment, the relief is created by micro-electromechanical systems (MEMS) placed above a cover layer of the electronic display. Each MEMS when activated can protrude or depress, thus creating the relief on the electronic display. In another embodiment, the relief is created by a plurality of resistors placed beneath the cover layer. The cover layer is made out of an elastically deformable material that, when heated, expands, thus creating a protrusion on the electronic display. Each resistor when activated heats a section of the cover layer, causing the cover layer to protrude.
These and other objects, features and characteristics of the present embodiments will become more apparent to those skilled in the art from a study of the following detailed description in conjunction with the appended claims and drawings, all of which form a part of this specification. While the accompanying drawings include illustrations of various embodiments, the drawings are not intended to limit the claimed subject matter.
Brief definitions of terms, abbreviations, and phrases used throughout this application are given below.
Reference in this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Moreover, various features are described that may be exhibited by some embodiments and not by others. Similarly, various requirements are described that may be requirements for some embodiments but not others.
Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to.” As used herein, the terms “connected,” “coupled,” or any variant thereof, mean any connection or coupling, either direct or indirect, between two or more elements. The coupling or connection between the elements can be physical, logical, or a combination thereof. For example, two devices may be coupled directly, or via one or more intermediary channels or devices. As another example, devices may be coupled in such a way that information can be passed there between, while not sharing any physical connection with one another. Additionally, the words “herein,” “above,” “below,” and words of similar import, when used in this application, shall refer to this application as a whole and not to any particular portions of this application. Where the context permits, words in the Detailed Description using the singular or plural number may also include the plural or singular number respectively. The word “or,” in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list.
If the specification states a component or feature “may,” “can,” “could,” or “might” be included or have a characteristic, that particular component or feature is not required to be included or have the characteristic.
The term “module” refers broadly to software, hardware, or firmware components (or any combination thereof). Modules are typically functional components that can generate useful data or another output using specified input(s). A module may or may not be self-contained. An application program (also called an “application”) may include one or more modules, or a module may include one or more application programs.
The terminology used in the Detailed Description is intended to be interpreted in its broadest reasonable manner, even though it is being used in conjunction with certain examples. The terms used in this specification generally have their ordinary meanings in the art, within the context of the disclosure, and in the specific context where each term is used. For convenience, certain terms may be highlighted, for example, using capitalization, italics, and/or quotation marks. The use of highlighting has no influence on the scope and meaning of a term; the scope and meaning of a term is the same, in the same context, whether or not it is highlighted. It will be appreciated that the same element can be described in more than one way.
Consequently, alternative language and synonyms may be used for any one or more of the terms discussed herein, but special significance is not to be placed upon whether or not a term is elaborated or discussed herein. A recital of one or more synonyms does not exclude the use of other synonyms. The use of examples anywhere in this specification, including examples of any terms discussed herein, is illustrative only and is not intended to further limit the scope and meaning of the disclosure or of any exemplified term. Likewise, the disclosure is not limited to various embodiments given in this specification.
Technology
Introduced here are methods and systems to create a relief on an electronic display. In one embodiment, the relief is created by micro-electromechanical systems (MEMS) placed above a cover layer of the electronic display. Each MEMS when activated can protrude or depress, thus creating the relief on the electronic display. In another embodiment, the relief is created by a plurality of resistors placed beneath the cover layer. The cover layer is made out of an elastically deformable material that, when heated, expands, thus creating a protrusion on the electronic display. Each resistor when activated heats a section of the cover layer, causing the cover layer to protrude.
The relief on the electronic display can be used to form Braille text to enable visually impaired people to read text, and/or perceive images. The relief can be used to educate children about various shapes. The relief can be used for aesthetic purposes to create more engaging electronic displays.
The haptic layer 210 includes a plurality of haptic elements, such as micro-electromechanical systems (MEMS), nano-electromechanical systems (NEMS), pico-electromechanical systems (PEMS), thermal elements, and/or elastically deformable materials. The haptic elements can be made out of an optically transparent material. The thermal elements can be resistors to emit heat. Elastically deformable materials can be elastically deformable glass, elastically deformable plastic, etc.
The horizontal controller 320 connected to the horizontal electrodes 300 activates at least one horizontal electrode at a time. The vertical controller 340 connected to the vertical electrodes 310 activates at least one vertical electrode at a time. The horizontal controller 320 and the vertical controller 340 are connected to a processor. The processor is configured to send an instruction to the horizontal controller 320 and the vertical controller 340. The instruction includes an identification (ID) associated with a horizontal electrode or a vertical electrode. The instruction can also include an instruction to protrude or to depress.
The haptic element 350 is connected to at least one horizontal and at least one vertical electrode. When both the horizontal and the vertical electrodes are activated, the haptic element 350 is also activated. The haptic element 350 can be disposed anywhere within a region 360 formed by the plurality of horizontal electrodes 300 and the plurality of vertical electrodes 310, such as: the upper left corner of the region 360 as shown in
The haptic element 350 can be a device such as MEMS, NEMS, or PEMS attached to the cover layer. When activated, the device can protrude or can depress. The region of the cover layer attached to the device follows the shape of the device, and protrudes or depresses in response to the force exerted by the device against the cover layer.
The haptic element 350 can be a thermal element made out of a heat dissipating material. When activated, the thermal element dissipates heat, warming the cover layer, and causing the cover layer to protrude in the region where the cover layer is heated.
The haptic element 350 can include both the device, such as MEMS, NEMS, or PEMS, and the thermal element. The device and the thermal element can be joined, or can be placed apart, anywhere within the region 360 (only one region labeled for brevity in
The capacitor 540, co-centric with the thin membrane 500, is placed beneath the thin membrane 500 and between the one or more anchors 530. The capacitor is connected to electrodes 550, 560. Electrodes 550, 560 apply voltage to the capacitor 540, charging the top surface of the capacitor 540, facing the thin membrane 500, either positively or negatively.
One or more capacitors 640 are placed beneath the thin membrane 600 and between the one or more anchors 630. The one or more capacitors 640 are connected to two or more electrodes 650, 660. Two or more electrodes 650, 660 apply voltage to the one or more capacitors 640, charging the top surfaces of the one or more capacitors 640, facing the thin membrane 600, either positively or negatively. The one or more capacitors 640 are shaped and/or placed away from the center of the thin membrane 600, so that when the thin membrane 600 depresses, as shown in
In
In
The thermal layer 710 includes a plurality of thermal elements corresponding to the plurality of substantially thermally insulated cells 730. When activated, each thermal element in the plurality of thermal elements heats the corresponding thermally insulated cell. The thermal element can be made out of a thermally dissipating material. For example, the thermal element can be a resistor.
The optional device layer 760 includes a plurality of devices corresponding to the plurality of substantially thermally insulated cells 730. A device in the plurality of devices can be a device configured to protrude or depress, such as a MEMS, a NEMS, or a PEMS. The device and the thermal element can be joined or can be placed apart anywhere within the cell as shown in
The electrode layer 720 includes a plurality of horizontal electrodes 770 and a plurality of vertical electrodes 780. The plurality of horizontal electrodes 770 corresponds to the plurality of horizontal thermal barriers 740, while the plurality of vertical electrodes 780 corresponds to the plurality of vertical thermal barriers 750. At least one horizontal electrode and at least one vertical electrode when activated cause one thermal element to activate. In turn, the thermal element heats the corresponding cell in the plurality of substantially thermally insulated cells 730, causing the elastically deformable material to protrude.
A horizontal controller (not pictured) connected to the plurality of horizontal electrodes 770 activates at least one horizontal electrode at a time. A vertical controller (not pictured) connected to the vertical electrodes 780 activates at least one vertical electrode at a time. The horizontal controller and the vertical controller are connected to a processor. The processor is configured to send an instruction to the horizontal controller and the vertical controller. The instruction includes an ID associated with a horizontal electrode or a vertical electrode.
Various methods can be implemented to manufacture and operate the system as described herein. For example, a method to create a relief associated with an electronic display includes providing a haptic layer disposed proximate to an outer surface associated with the electronic display, the haptic layer comprising a plurality of micro-electromechanical systems (MEMS) to create the relief associated with the electronic display, the relief comprising at least one of a depression or a protrusion on the electronic display, said providing the haptic layer including: providing a thin piezoelectric membrane configured to bend when a voltage is applied to the thin piezoelectric membrane; providing an anchor to support the thin piezoelectric membrane, and the anchor to prevent the thin piezoelectric membrane from bending at points of contact; providing a plurality of membrane electrodes proximate to the thin piezoelectric membrane, the plurality of membrane electrodes to apply the voltage to the thin piezoelectric membrane. Finally, the method to create the relief includes providing a controller coupled to the haptic layer, the controller to activate at least one MEMS in the plurality of MEMS associated with the haptic layer.
Providing the haptic layer includes: providing a capacitor placed beneath the thin piezoelectric membrane, a top surface of the capacitor facing a bottom surface of the thin piezoelectric membrane; providing a plurality of capacitor electrodes proximate to the capacitor, the plurality of capacitor electrodes to create an electric charge on the top surface of the capacitor, the electric charge comprising one of a positive charge or a negative charge; providing the plurality of membrane electrodes proximate to the thin piezoelectric membrane, the plurality of membrane electrodes to create the electric charge on the bottom surface of the thin piezoelectric membrane; and providing the thin piezoelectric membrane to protrude when the electric charge on the bottom surface of the thin piezoelectric membrane matches the electric charge on the top surface of the capacitor, and the thin piezoelectric membrane to depress when the electric charge on the bottom surface of the thin piezoelectric membrane is opposite of the electric charge on the top surface of the capacitor.
The method to create the relief associated with the electronic display includes providing a cover layer defining the outer surface associated with the electronic display, the cover layer to create at least one of the depression or the protrusion when activated; providing a touch sensor layer disposed beneath the cover layer; and providing the haptic layer disposed between the cover layer and the touch sensor layer, the haptic layer to exert pressure on the cover layer to cause the cover layer to create at least one of the depression or the protrusion.
The method to create the relief associated with the electronic display further includes sending, by a processor to the haptic layer, an instruction to the controller to activate at least one MEMS in the plurality of MEMS, the instruction comprising an ID associated with at least two electrodes.
Computer
In the example of
This disclosure contemplates the computer system 800 taking any suitable physical form. As example and not by way of limitation, computer system 800 may be an embedded computer system, a system-on-chip (SOC), a single-board computer system (SBC) (such as, for example, a computer-on-module (COM) or system-on-module (SOM)), a desktop computer system, a laptop or notebook computer system, an interactive kiosk, a mainframe, a mesh of computer systems, a mobile telephone, a personal digital assistant (PDA), a server, or a combination of two or more of these. Where appropriate, computer system 800 may include one or more computer systems 800; be unitary or distributed; span multiple locations; span multiple machines; or reside in a cloud, which may include one or more cloud components in one or more networks. Where appropriate, one or more computer systems 800 may perform without substantial spatial or temporal limitation one or more steps of one or more methods described or illustrated herein. As an example and not by way of limitation, one or more computer systems 800 may perform in real time or in batch mode one or more steps of one or more methods described or illustrated herein. One or more computer systems 800 may perform at different times or at different locations one or more steps of one or more methods described or illustrated herein, where appropriate.
The processor may be, for example, a conventional microprocessor such as an Intel Pentium microprocessor or Motorola power PC microprocessor. One of skill in the relevant art will recognize that the terms “machine-readable (storage) medium” or “computer-readable (storage) medium” include any type of device that is accessible by the processor.
The memory is coupled to the processor by, for example, a bus. The memory can include, by way of example but not limitation, random access memory (RAM), such as dynamic RAM (DRAM) and static RAM (SRAM). The memory can be local, remote, or distributed.
The bus also couples the processor to the non-volatile memory and drive unit. The non-volatile memory is often a magnetic floppy or hard disk, a magnetic-optical disk, an optical disk, a read-only memory (ROM), such as a CD-ROM, EPROM, or EEPROM, a magnetic or optical card, or another form of storage for large amounts of data. Some of this data is often written, by a direct memory access process, into memory during execution of software in the computer 800. The non-volatile storage can be local, remote, or distributed. The non-volatile memory is optional because systems can be created with all applicable data available in memory. A typical computer system will usually include at least a processor, memory, and a device (e.g., a bus) coupling the memory to the processor.
Software is typically stored in the non-volatile memory and/or the drive unit. Indeed, storing an entire large program in memory may not even be possible. Nevertheless, it should be understood that for software to run, if necessary, it is moved to a computer readable location appropriate for processing, and for illustrative purposes, that location is referred to as the memory in this paper. Even when software is moved to the memory for execution, the processor will typically make use of hardware registers to store values associated with the software and local cache that, ideally, serve to speed up execution. As used herein, a software program is assumed to be stored at any known or convenient location (from non-volatile storage to hardware registers) when the software program is referred to as “implemented in a computer-readable medium.” A processor is considered to be “configured to execute a program” when at least one value associated with the program is stored in a register readable by the processor.
The bus also couples the processor to the network interface device. The interface can include one or more of a modem or network interface. It will be appreciated that a modem or network interface can be considered to be part of the computer system 800. The interface can include an analog modem, ISDN modem, cable modem, token ring interface, satellite transmission interface (e.g., “direct PC”), or other interfaces for coupling a computer system to other computer systems. The interface can include one or more input and/or output devices. The I/O devices can include, by way of example but not limitation, a keyboard, a mouse or other pointing device, disk drives, printers, a scanner, and other input and/or output devices, including a display device. The display device can include, by way of example but not limitation, a cathode ray tube (CRT), liquid crystal display (LCD), or some other applicable known or convenient display device. For simplicity, it is assumed that controllers of any devices not depicted in the example of
In operation, the computer system 800 can be controlled by operating system software that includes a file management system, such as a disk operating system. One example of operating system software with associated file management system software is the family of operating systems known as Windows® from Microsoft Corporation of Redmond, Wash., and their associated file management systems. Another example of operating system software with its associated file management system software is the Linux™ operating system and its associated file management system. The file management system is typically stored in the non-volatile memory and/or drive unit and causes the processor to execute the various acts required by the operating system to input and output data and to store data in the memory, including storing files on the non-volatile memory and/or drive unit.
Some portions of the detailed description may be presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of operations leading to a desired result. The operations are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise, as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as “processing” or “computing” or “calculating” or “determining” or “displaying” or “generating” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general purpose systems may be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the methods of some embodiments. The required structure for a variety of these systems will appear from the description below. In addition, the techniques are not described with reference to any particular programming language, and various embodiments may thus be implemented using a variety of programming languages.
In alternative embodiments, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a client-server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
The machine may be a server computer, a client computer, a personal computer (PC), a tablet PC, a laptop computer, a set-top box (STB), a personal digital assistant (PDA), a cellular telephone, an iPhone, a Blackberry, a processor, a telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
While the machine-readable medium or machine-readable storage medium is shown in an exemplary embodiment to be a single medium, the term “machine-readable medium” and “machine-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “machine-readable medium” and “machine-readable storage medium” shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by the machine and that causes the machine to perform any one or more of the methodologies or modules of the presently disclosed technique and innovation.
In general, the routines executed to implement the embodiments of the disclosure may be implemented as part of an operating system or a specific application, component, program, object, module or sequence of instructions referred to as “computer programs.” The computer programs typically comprise one or more instructions set at various times in various memory and storage devices in a computer, and that, when read and executed by one or more processing units or processors in a computer, cause the computer to perform operations to execute elements involving the various aspects of the disclosure.
Moreover, while embodiments have been described in the context of fully functioning computers and computer systems, those skilled in the art will appreciate that the various embodiments are capable of being distributed as a program product in a variety of forms, and that the disclosure applies equally regardless of the particular type of machine or computer-readable media used to actually effect the distribution.
Further examples of machine-readable storage media, machine-readable media, or computer-readable (storage) media include but are not limited to recordable type media such as volatile and non-volatile memory devices, floppy and other removable disks, hard disk drives, optical disks (e.g., Compact Disk Read-Only Memory (CD ROMS), Digital Versatile Disks, (DVDs), etc.), among others, and transmission type media such as digital and analog communication links.
In some circumstances, operation of a memory device, such as a change in state from a binary one to a binary zero or vice versa, for example, may comprise a transformation, such as a physical transformation. With particular types of memory devices, such a physical transformation may comprise a physical transformation of an article to a different state or thing. For example, but without limitation, for some types of memory devices, a change in state may involve an accumulation and storage of charge or a release of stored charge. Likewise, in other memory devices, a change of state may comprise a physical change or transformation in magnetic orientation or a physical change or transformation in molecular structure, such as from crystalline to amorphous or vice versa. The foregoing is not intended to be an exhaustive list in which a change in state for a binary one to a binary zero or vice versa in a memory device may comprise a transformation, such as a physical transformation. Rather, the foregoing are intended as illustrative examples.
A storage medium typically may be non-transitory or comprise a non-transitory device. In this context, a non-transitory storage medium may include a device that is tangible, meaning that the device has a concrete physical form, although the device may change its physical state. Thus, for example, non-transitory refers to a device remaining tangible despite this change in state.
Remarks
The foregoing description of various embodiments of the claimed subject matter has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the claimed subject matter to the precise forms disclosed. Many modifications and variations will be apparent to one skilled in the art. Embodiments were chosen and described in order to best describe the principles of the invention and its practical applications, thereby enabling others skilled in the relevant art to understand the claimed subject matter, the various embodiments, and the various modifications that are suited to the particular uses contemplated.
While embodiments have been described in the context of fully functioning computers and computer systems, those skilled in the art will appreciate that the various embodiments are capable of being distributed as a program product in a variety of forms, and that the disclosure applies equally regardless of the particular type of machine or computer-readable media used to actually effect the distribution.
Although the above Detailed Description describes certain embodiments and the best mode contemplated, no matter how detailed the above appears in text, the embodiments can be practiced in many ways. Details of the systems and methods may vary considerably in their implementation details, while still being encompassed by the specification. As noted above, particular terminology used when describing certain features or aspects of various embodiments should not be taken to imply that the terminology is being redefined herein to be restricted to any specific characteristics, features, or aspects of the invention with which that terminology is associated. In general, the terms used in the following claims should not be construed to limit the invention to the specific embodiments disclosed in the specification, unless those terms are explicitly defined herein. Accordingly, the actual scope of the invention encompasses not only the disclosed embodiments, but also all equivalent ways of practicing or implementing the embodiments under the claims.
The language used in the specification has been principally selected for readability and instructional purposes, and it may not have been selected to delineate or circumscribe the inventive subject matter. It is therefore intended that the scope of the invention be limited not by this Detailed Description, but rather by any claims that issue on an application based hereon. Accordingly, the disclosure of various embodiments is intended to be illustrative, but not limiting, of the scope of the embodiments, which is set forth in the following claims.
This application claims priority to U.S. Provisional Patent Application No. 62/395,243, filed on Sep. 15, 2016, which is incorporated by this reference herein in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6441449 | Xu | Aug 2002 | B1 |
| 7471031 | Kawakubo | Dec 2008 | B2 |
| 7586164 | Musalem | Sep 2009 | B2 |
| 8362882 | Heubel | Jan 2013 | B2 |
| 8451240 | Pasquero | May 2013 | B2 |
| 8564176 | Nihei | Oct 2013 | B2 |
| 8593409 | Heubel | Nov 2013 | B1 |
| 8665241 | Heubel | Mar 2014 | B2 |
| 8717151 | Forutanpour | May 2014 | B2 |
| 8780060 | Maschmeyer | Jul 2014 | B2 |
| 8854331 | Heubel | Oct 2014 | B2 |
| 8948706 | Napoles | Feb 2015 | B2 |
| 9405369 | Modarres | Aug 2016 | B2 |
| 9557857 | Schediwy | Jan 2017 | B2 |
| 20020025595 | Xu | Feb 2002 | A1 |
| 20050030292 | Diederiks | Feb 2005 | A1 |
| 20060291135 | Musalem | Dec 2006 | A1 |
| 20070134835 | Fukuda | Jun 2007 | A1 |
| 20090002328 | Ullrich | Jan 2009 | A1 |
| 20090250267 | Heubel | Oct 2009 | A1 |
| 20100141407 | Heubel | Jun 2010 | A1 |
| 20100238114 | Vartanian | Sep 2010 | A1 |
| 20110148255 | Nihei | Jun 2011 | A1 |
| 20110304558 | Pasquero | Dec 2011 | A1 |
| 20120105333 | Maschmeyer | May 2012 | A1 |
| 20120274599 | Schediwy | Nov 2012 | A1 |
| 20120286944 | Forutanpour | Nov 2012 | A1 |
| 20130155020 | Heubel | Jun 2013 | A1 |
| 20140071079 | Heubel | Mar 2014 | A1 |
| 20140159779 | Napoles | Jun 2014 | A1 |
| 20140232679 | Whitman | Aug 2014 | A1 |
| 20140320276 | Maschmeyer | Oct 2014 | A1 |
| 20140320436 | Modarres | Oct 2014 | A1 |
| 20150205368 | Yairi | Jul 2015 | A1 |
| 20150205416 | Yairi | Jul 2015 | A1 |
| 20150205417 | Yairi | Jul 2015 | A1 |
| 20150279010 | Cianfrone | Oct 2015 | A1 |
| 20160259415 | Ullrich | Sep 2016 | A1 |
| 20170068318 | McClure | Mar 2017 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 62395243 | Sep 2016 | US |
