Patent Grant
12175856
The present application is a U.S. National Stage Application under 35 U.S.C. § 371 of International Patent Application No. PCT/CN2021/120569, filed on Sep. 26, 2021, the disclosure of which incorporated by reference herein in its entirety.
The present disclosure relates to a haptic rendering device, a method, a display device and a controller.
The main ways of human sensing system comprises vision, hearing and touch. Currently, both vision and hearing are sensed and presented by relatively mature methods. For example, video cameras and photo cameras are used to simulate the acquisition of images by humans, display screens and other display devices are used to present images, devices such as silicon microphones, electret microphones, and piezoelectric microphones are used to simulate the acquisition of sound signals in the environment by humans, and headphones and stereos using various principles such as static electricity, dynamic coil, and piezoelectricity are used to present various wonderful sounds for humans.
For the haptic system, due to its relatively complex mechanism, there involves perception of a plurality of physical signals such as mechanical, temperature, chemical, and humidity signals in the environment by human body. The research and industrialization are relatively late. From the early resistive touch screen to the demand in the current large-scale application of a capacitive touch screen as well as application scenarios such as virtual reality, there is an urgent demand for tactile perception and haptic rendering. Haptic rendering in the related art is mainly implemented by vibration feedback, in which excitation of human body is realized by vibration of a contact surface. In surface haptic rendering, the characteristics of an object are simulated on the contact surface so that a more realistic tactile feeling is realized for human body, and an efficient and natural interaction effect can be realized on the multimedia terminal.
According to an aspect of embodiments of the present disclosure, a haptic rendering device is provided. The haptic rendering device comprises: a substrate; a first driver arranged on the substrate and configured to vibrate and drive the substrate to vibrate after receiving a first driving signal; a vibration sensor arranged on the substrate and configured to generate a first detection voltage signal according to an amplitude or a frequency at which the first driver vibrates together with the substrate in a case where the substrate vibrates; and a controller configured to output the first driving signal to the first driver, receive the first detection voltage signal, and adjust the first driving signal according to the first detection voltage signal.
In some embodiments, the controller is configured to reduce an amplitude or a duty cycle of the first driving signal in a case where the first detection voltage signal is greater than a threshold value, or increase the amplitude or the duty cycle of the first driving signal in a case where the first detection voltage signal is less than the threshold value.
In some embodiments, the vibration sensor comprises an accelerometer, a velocity sensor, or a displacement sensor.
In some embodiments, the accelerometer comprises at least one of a piezoelectric accelerometer, a capacitive comb accelerometer, a bulk-silicon capacitive accelerometer, or a piezoresistive accelerometer.
In some embodiments, the piezoelectric accelerometer comprises: a first bottom electrode on the substrate; a first portion of the substrate below the first bottom electrode, wherein the first portion comprises a recess on a side away from the first bottom electrode and a mass block surrounded by the recess, wherein a thickness of part of the first portion at a bottom of the recess in a direction perpendicular to the substrate is less than a thickness of the mass block in the direction perpendicular to the substrate; a first piezoelectric thin film layer on a side of the first bottom electrode away from the substrate; and a first top electrode on a side of the first piezoelectric thin film layer away from the substrate; wherein the first bottom electrode and the first top electrode are electrically connected to the controller, and an orthographic projection of the recess on the substrate at least partially overlaps with an orthographic projection of the first piezoelectric thin film layer on the substrate.
In some embodiments, the piezoelectric accelerometer further comprises: a first lead-out electrode electrically connected to the first bottom electrode; and a second lead-out electrode electrically connected to the first top electrode; wherein the first bottom electrode is electrically connected to the controller through the first lead-out electrode, and the first top electrode is electrically connected to the controller through the second lead-out electrode.
In some embodiments, a shape of the recess comprises a circular ring, a square ring or a hexagonal ring from a perspective perpendicular to the substrate.
In some embodiments, the first bottom electrode comprises a plurality of first sub-bottom electrodes, wherein the plurality of first sub-bottom electrodes are electrically connected to each other; the recess comprises a plurality of sub-recesses, and the mass block comprises a plurality of sub-mass blocks, wherein the plurality of sub-mass blocks are surrounded by the plurality of sub-recesses in a one-to-one correspondence, and the plurality of sub-recesses are below the plurality of first sub-bottom electrodes in a one-to-one correspondence; the first piezoelectric film layer comprises a plurality of first sub-piezoelectric film layers, wherein the plurality of first sub-piezoelectric film layers are on a side of the plurality of first sub-bottom electrodes away from the substrate in a one-to-one correspondence; and the first top electrode comprises a plurality of first sub-top electrodes, wherein the plurality of first sub-top electrodes are on a side of the plurality of first sub-piezoelectric thin film layers away from the substrate in a one-to-one correspondence.
In some embodiments, the first driver comprises: a second bottom electrode on the substrate; a second portion of the substrate below the second bottom electrode; a second piezoelectric thin film layer on a side of the second bottom electrode away from the substrate; and a second top electrode on a side of the second piezoelectric thin film layer away from the substrate; wherein the second bottom electrode and the second top electrode are electrically connected to the controller.
In some embodiments, the first driver further comprises: a third lead-out electrode electrically connected to the second bottom electrode; and a fourth lead-out electrode electrically connected to the second top electrode; wherein the second bottom electrode is electrically connected to the controller through the third lead-out electrode, and the second top electrode is electrically connected to the controller through the fourth lead-out electrode.
In some embodiments, a material of the first bottom electrode is the same as a material of the second bottom electrode; a material of the first piezoelectric thin film layer is the same as a material of the second piezoelectric thin film layer; and a material of the first top electrode is the same as a material of the second top electrode.
In some embodiments, the second piezoelectric thin film layer comprises a plurality of second sub-piezoelectric thin film layers, wherein the plurality of second sub-piezoelectric thin film layers are spaced apart from each other and arranged along an extending direction of the second bottom electrode.
In some embodiments, the first driver comprises a plurality of first drivers arranged on the substrate along a first direction; and the vibration sensor comprises a plurality of vibration sensors arranged on the substrate along a second direction; wherein the first direction is perpendicular to the second direction.
In some embodiments, the haptic rendering device further comprises a piezoelectric transformer arranged on the substrate, electrically connected between the controller and the first driver, and configured to receive the first driving signal from the controller, amplify the first driving signal and output an amplified first driving signal to the first driver to drive the first driver to vibrate.
In some embodiments, the haptic rendering device further comprises a second driver arranged on the substrate, and configured to vibrate and drive the substrate to vibrate after receiving a second driving signal, wherein a vibration frequency of the second driver is less than a vibration frequency of the first driver; wherein the vibration sensor is further configured to generate a second detection voltage signal according to an amplitude or a frequency at which the second driver vibrates together with the substrate in a case where the substrate vibrates; and the controller is further configured to output the second driving signal to the second driver, receive the second detection voltage signal, and adjust the second driving signal according to the second detection voltage signal.
According to another aspect of the embodiments of the present disclosure, a display device is provided. The device comprises the haptic rendering device described above.
According to another aspect of the embodiments of the present disclosure, a haptic rendering method is provided. The haptic rendering method comprises: outputting a first driving signal to a first driver arranged on a substrate to cause the first driver to vibrate and drive the substrate to vibrate; generating a first detection voltage signal by a vibration sensor arranged on the substrate according to an amplitude or a frequency at which the first driver vibrates together with the substrate in a case where the substrate vibrates; and adjusting the first driving signal according to the first detection voltage signal.
In some embodiments, the adjusting of the first driving signal according to the first detection voltage signal comprises: reducing an amplitude or a duty cycle of the first driving signal in a case that the first detection voltage signal is greater than a threshold value; or increasing the amplitude or the duty cycle of the first driving signal in a case where the first detection voltage signal is less than the threshold value.
According to another aspect of the embodiments of the present disclosure, a controller is provided. The controller comprises: a memory; and a processor coupled to the memory, wherein the processor is configured to implement the method described above based on instructions stored in the memory.
According to another aspect of the embodiments of the present disclosure, a non-transitory computer readable storage medium is provided. The non-transitory computer readable storage medium has computer program instructions stored thereon which, when executed by a processor, implement the method described above.
Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings.
The accompanying drawings which constitute part of this specification, illustrate the exemplary embodiments of the present disclosure, and together with this specification, serve to explain the principles of the present disclosure.
The present disclosure may be more explicitly understood from the following detailed description with reference to the accompanying drawings, in which:
It should be understood that the dimensions of various parts shown in the accompanying drawings are not necessarily drawn according to actual proportional relations. In addition, the same or similar reference signs are used to denote the same or similar components.
Various exemplary embodiments of the present disclosure will now be described in detail in conjunction with the accompanying drawings. The description of the exemplary embodiments is merely illustrative and is in no way intended as a limitation to the present disclosure, its application or use. The present disclosure may be implemented in many different forms, which are not limited to the embodiments described herein. These embodiments are provided to make the present disclosure thorough and complete, and fully convey the scope of the present disclosure to those skilled in the art. It should be noticed that: relative arrangement of components and steps, material composition, numerical expressions, and numerical values set forth in these embodiments, unless specifically stated otherwise, should be explained as merely illustrative, and not as a limitation.
The use of the terms “first”, “second” and similar words in the present disclosure do not denote any order, quantity or importance, but are merely used to distinguish between different parts. A word such as “comprise”, “include”, or the like means that the element before the word covers the element (s) listed after the word without excluding the possibility of also covering other elements. The terms “up”, “down”, “left”, “right”, or the like are used only to represent a relative positional relationship, and the relative positional relationship may be changed correspondingly if the absolute position of the described object changes.
In the present disclosure, when it is described that a particular device is located between the first device and the second device, there may be an intermediate device between the particular device and the first device or the second device, and alternatively, there may be no intermediate device. When it is described that a particular device is connected to other devices, the particular device may be directly connected to said other devices without an intermediate device, and alternatively, may not be directly connected to said other devices but with an intermediate device.
All the terms (comprising technical and scientific terms) used in the present disclosure have the same meanings as understood by those skilled in the art of the present disclosure unless otherwise defined. It should also be understood that terms as defined in general dictionaries, unless explicitly defined herein, should be interpreted as having meanings that are consistent with their meanings in the context of the relevant art, and not to be interpreted in an idealized or extremely formalized sense.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, these techniques, methods, and apparatuses should be considered as part of this specification.
As shown in
The haptic rendering device further comprises a first driver 20. The first driver 20 is arranged on the substrate 11. The first driver 20 is configured to vibrate and drive the substrate to vibrate after receiving a first driving signal.
The haptic rendering device further comprises a vibration sensor 30. The vibration sensor 30 is arranged on the substrate 11. The vibration sensor 30 is configured to generate a first detection voltage signal according to an amplitude or a frequency at which the first driver 20 vibrates together with the substrate 11 in a case where the substrate 11 vibrates.
In some embodiments, the vibration sensor comprises an accelerometer, a velocity sensor, or a displacement sensor.
For example, the accelerometer comprises at least one of a piezoelectric accelerometer, a capacitive comb accelerometer, a bulk-silicon capacitive accelerometer, or a piezoresistive accelerometer. For example, the velocity sensor comprises at least one of a laser type velocity sensor or a linear velocity sensor. For example, the displacement sensor comprises at least one of a capacitive displacement sensor or an eddy current displacement sensor.
The haptic rendering device further comprises a controller 40. The controller 40 is configured to output the first driving signal to the first driver 20, receive the first detection voltage signal, and adjust the first driving signal according to the first detection voltage signal.
So far, a haptic rendering device according to some embodiments of the present disclosure is provided. The haptic rendering device comprises: a substrate; a first driver arranged on the substrate and configured to vibrate and drive the substrate to vibrate after receiving a first driving signal; a vibration sensor arranged on the substrate and configured to generate a first detection voltage signal according to an amplitude or a frequency at which the first driver vibrates together with the substrate in a case where the substrate vibrates; and a controller configured to output the first driving signal to the first driver, receive the first detection voltage signal, and adjust the first driving signal according to the first detection voltage signal. In this way, the first driving signal can be optimized so that when the first driving signal causes the first driver to drive the substrate to vibrate, a first driver-substrate resonant body can operate in a stable state, thereby bringing a stable haptic experience to the user.
For example, the controller 20 is configured to reduce an amplitude or a duty cycle of the first driving signal in a case where the first detection voltage signal is greater than a threshold value (which may be referred to as a first threshold value), or increase the amplitude or the duty cycle of the first driving signal in a case where the first detection voltage signal is less than the threshold value. In this way, the first driving signal can be optimized so that when the first driving signal causes the first driver to drive the substrate to vibrate, a first driver-substrate resonant body can operate in a stable state, thereby bringing a stable haptic experience to the user.
It is to be noted that, the above-described threshold may be preset according to actual needs or actual conditions. For example, the threshold may be preset according to different device structures, different screens (the screen where the substrate is situated), or surface conditions of different objects displayed on the screen, and the threshold may be preset by way of training.
As shown in
In some embodiments, as shown in
The first driver 20 and the vibration sensor 30 are located close to different edges of the substrate respectively. For example, as shown in
It is to be noted that, although two rows of first drivers are shown in
As shown in
As shown in
Viewed from a perspective perpendicular to the substrate, a shape of the recess 101 is a circular ring. Of course, the scope of the embodiments of the present disclosure is not limited thereto. Viewed from a perspective perpendicular to the substrate, the shape of the recess may also be other shapes, for example a square ring or a hexagonal ring, which will be described in detail later in conjunction with
As shown in
As shown in
The first bottom electrode 301 and the first top electrode 303 are electrically connected to the controller. An orthographic projection of the recess 101 on the substrate 11 at least partially overlaps with an orthographic projection of the first piezoelectric thin film layer 302 on the substrate 11.
The piezoelectric accelerometer utilizes the positive piezoelectric effect of the piezoelectric material. That is, the piezoelectric material generates an electrical signal (serving as the first detection voltage signal) under a mechanical effect and outputs the electrical signal to the controller. The piezoelectric accelerometer is configured to detect a vibration acceleration value when the glass substrate vibrates.
It is to be noted that, although a piezoelectric accelerometer is used here, those skilled in the art can understand that accelerometers with other principles may also be used.
In some embodiments, the piezoelectric accelerometer has a resonant frequency of 20 Hz to 100 kHz. For example, it may be seen from
In some embodiments, as shown in
As shown in
The first driver utilizes the inverse piezoelectric effect of the piezoelectric material. That is, the piezoelectric material produces a mechanical effect under the effect of an electrical signal. The first driver is configured to drive the substrate to vibrate in the case of driving by an electric signal, so as to generate a haptic feedback effect.
In some embodiments, a material of the first bottom electrode 301 is the same as a material of the second bottom electrode 201, a material of the first piezoelectric thin film layer 302 is the same as a material of the second piezoelectric thin film layer 202, and a material of the first top electrode 303 is the same as a material of the second top electrode 203. This facilitates the manufacture of a haptic rendering device.
For example, a bottom electrode material layer (serving as a seed layer) may be formed on the substrate, and then a patterning process may be performed on the bottom electrode material layer to form the first bottom electrode 301 and the second bottom electrode 201. Next, a piezoelectric thin film layer is formed on the first bottom electrode 301, the second bottom electrode 201 and the substrate, and then a patterning process is performed on the piezoelectric thin film layer to form the first piezoelectric thin film layer 302 and the second piezoelectric thin film layer 202. Next, a top electrode material layer is formed on the first t piezoelectric thin film layer 302, the second piezoelectric thin film layer 202 and the substrate, and then a patterning process is performed on the top electrode material layer to form the first top electrode 303 and the second top electrode 203. Next, a rear of the substrate below the first bottom electrode 301 is etched to form a recess that isolates the mass block from a peripheral substrate area. The first driver and the piezoelectric accelerometer are thus formed. This manufacturing process can achieve the process compatibility between the piezoelectric accelerometer and the piezoelectric thin film driver.
In the above description, the first driver uses a piezoelectric thin film layer. However, those skilled in the art can understand that the first driver may also use other structural layers, such as a piezoelectric ceramic sheet or the like.
In some embodiments, as shown in
In some embodiments, as shown in
In the haptic rendering device of the embodiments described previously, the vibration sensor comprises a plurality of vibration sensors. However, the scope of the embodiments of the present disclosure is not limited thereto. For example, as shown in
Of course, the shapes of the above-described recess and mass block are only exemplary, and the scope of the embodiments of the present disclosure is not limited thereto.
As shown in
As shown in
As shown in
As shown in
As shown in
In the above-described embodiments, two piezoelectric accelerometers are integrated together. However, those skilled in the art can understand that, in order to improve the detection sensitivity, more piezoelectric accelerometers can be integrated together. Therefore, the scope of the embodiments of the present disclosure is not limited thereto.
In the embodiments of the present disclosure, a vibration sensor is integrated on the haptic rendering device, an amplitude or frequency of the first driver-substrate resonant body can be measured by the vibration sensor, and the controller adjusts a driving signal by the amplitude or frequency of the first driver-substrate resonant body, thereby controlling the first driver-substrate resonant body to operate in a stable state, and bringing a stable tactile experience to the user.
As shown in
The second driver 50 is arranged on the substrate 11. The second driver 50 is configured to vibrate and drive the substrate to vibrate after receiving a second driving signal. Here, a vibration frequency of the second driver 50 is less than a vibration frequency of the first driver 20. For example, the second drive 50 comprises an eccentric rotor and/or a linear motor, or the like.
The vibration sensor 30 is further configured to generate a second detection voltage signal according to an amplitude or a frequency at which the second driver 50 vibrates together with the substrate 11 in a case where the substrate vibrates.
The controller 40 is further configured to output the second driving signal to the second driver 50, receive the second detection voltage signal, and adjust the second driving signal according to the second detection voltage signal. For example, the controller 20 is further configured to reduce an amplitude or a duty cycle of the second driving signal in a case where the second detection voltage signal is greater than a second threshold, or increase the amplitude or the duty cycle of the second driving signal in a case where the second detection voltage signal is less than the second threshold.
In the haptic rendering device of the above-described embodiments, a first driver with a relatively high vibration frequency and a second driver with a relatively low vibration frequency are also provided on the substrate, so that the boundary touch effect is produced by the film pressing effect of the first driver during high-frequency vibration, and the effects such as tapping, or warning are produced by low-frequency pressing, vibration of the second driver, thereby enhancing the haptic experience.
In other embodiments, the second driver may not be provided. Rather, a low-frequency signal is loaded on the first driver to produce a haptic feedback effect of low-frequency vibration.
In some embodiments, as shown in
In the embodiments of the present disclosure, the above-described haptic rendering device may be applied to consumer electronics (for example, notebook virtual keys, touchpads), automobile central control systems, indoor and outdoor advertising display, hospitals, and the like.
In some embodiments of the present disclosure, a display device is also provided. The display device comprises the haptic rendering device as described above. For example, the display device may be a mobile phone, a notebook computer, a tablet computer, a central control display screen of an automobile, indoor and outdoor advertising display screens, or the like. Such display device can realize a haptic rendering function whilst realizing a display function.
In step S1002, a first driving signal is output to a first driver arranged on a substrate to cause the first driver to vibrate and drive the substrate to vibrate.
In step S1004, a first detection voltage signal is generated by a vibration sensor arranged on the substrate according to an amplitude or a frequency at which the first driver vibrates together with the substrate in a case where the substrate vibrates.
In step S1006, the first driving signal is adjusted according to the first detection voltage signal.
In some embodiments, the step S1006 comprises: reducing an amplitude or a duty cycle of the first driving signal in a case that the first detection voltage signal is greater than a threshold value; or increasing the amplitude or the duty cycle of the first driving signal in a case where the first detection voltage signal is less than the threshold value.
So far, a haptic rendering method according to some embodiments of the present disclosure is provided. The haptic rendering method comprises: outputting a first driving signal to a first driver to cause the first driver to vibrate and drive the substrate to vibrate; generating a first detection voltage signal by a vibration sensor according to an amplitude or a frequency at which the first driver vibrates together with the substrate in a case where the substrate vibrates; and adjusting the first driving signal according to the first detection voltage signal. In this way, the first driving signal can be optimized so that when the first driving signal causes the first driver to drive the substrate to vibrate, a first driver-substrate resonant body can operate in a stable state, thereby bringing a stable haptic experience to the user.
The memory 410 may be a magnetic disk, a flash memory, or any other non-volatile storage medium. The memory is configured to store instructions in the embodiment corresponding to
The processor 420 which is coupled to the memory 410, may be implemented as one or more integrated circuits, for example a microprocessor or microcontroller. The processor 420 is configured to execute instructions stored in the memory, so that the first driver-substrate resonant body operates in a stable state, thereby bringing a stable tactile experience to the user.
In another embodiment, the present disclosure also provides a non-transitory computer readable storage medium having computer program instructions stored thereon which, when executed by a processor, implement the steps of the method in the embodiments corresponding to
The present disclosure is described in conjunction with the flow charts and/or block views of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It will be understood that each step and/or block of the flow charts and/or block views as well as a combination of steps and/or blocks of the flow charts and/or block views may be implemented by a computer program instruction. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, an embedded processing machine, or other programmable data processing devices to produce a machine, such that the instructions executed by a processor of a computer or other programmable data processing devices produce a device for realizing a function designated in one or more steps of a flow chart and/or one or more blocks in a block view.
These computer program instructions may also be stored in a computer readable memory that may guide a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce a manufacture comprising an instruction device. The instruction device realizes a function designated in one or more steps in a flow chart and/or one or more blocks in a block view. These computer program instructions may also be loaded onto a computer or other programmable data processing devices, such that a series of operational steps are performed on a computer or other programmable device to produce a computer-implemented processing, such that the instructions executed on a computer or other programmable devices provide steps for realizing a function designated in one or more steps of the flow chart and/or one or more blocks in the block view.
Hereto, various embodiments of the present disclosure have been described in detail. Some details well known in the art are not described in order to avoid obscuring the concept of the present disclosure. According to the above description, those skilled in the art would fully understand how to implement the technical solutions disclosed here.
Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art should understand that the above examples are only for the purpose of illustration but not for limiting the scope of the present disclosure. It should be understood by those skilled in the art that modifications to the above embodiments or equivalently substitution of part of the technical features may be made without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2021/120569 | 9/26/2021 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2023/044841 | 3/30/2023 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5233874 | Putty et al. | Aug 1993 | A |
| 20130307789 | Karamath | Nov 2013 | A1 |
| 20140157902 | Sugiura | Jun 2014 | A1 |
| 20160179260 | Ham | Jun 2016 | A1 |
| 20180033262 | Shah et al. | Feb 2018 | A1 |
| 20190235628 | Lacroix | Aug 2019 | A1 |
| 20200150767 | Karimi Eskandary et al. | May 2020 | A1 |
| 20220238782 | Hua | Jul 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 107665051 | Feb 2018 | CN |
| 108628530 | Oct 2018 | CN |
| 110083229 | Aug 2019 | CN |
| 110875692 | Mar 2020 | CN |
| 111176436 | May 2020 | CN |
| 113238679 | Aug 2021 | CN |
| 3620893 | Mar 2020 | EP |
| 2014020868 | Feb 2014 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20240185693 A1 | Jun 2024 | US |
