This application claims the benefit of Korean Patent Application 10-2013-0104656, filed on Sep. 2, 2013, which is hereby incorporated by reference as if fully set forth herein.
Field of the Invention
The present specification relates to a display device and, more specifically, to a display device for zooming in on a digital image including tactile feedback.
Discussion of the Related Art
A user can control a touch sensitive display device by touching the surface of the display device. The touch sensitive display device can control an object in response to a touch input of the user and generate tactile feedback in a region within which the touch input is detected. Accordingly, the user can feel tactile sensation of the touched region.
However, when a plurality of tactile feedbacks is generated in a region touched by the user, the user cannot feel correct tactile feedbacks. Particularly, when a region generating tactile feedback is small, a user cannot correctly confirm the tactile feedback. Accordingly, a method for providing correct tactile feedback to a user is needed.
Accordingly, the present specification provides a display device for providing correct tactile feedback and a method for controlling the same. In the present specification, especially, the display device needs to provide a method for zooming in on a displayed digital image in response to a detected touch input.
A display device according to an embodiment of the present specification include a display unit configured to display a digital image, the digital image including a first region to which a first tactile feedback is allocated, a sensor unit configured to detect a control input applied to the display unit, a tactile feedback unit configured to generate the first tactile feedback in the first region, and a controller configured to control the display unit, the sensor unit and the tactile feedback unit, wherein the controller zooms in on the first region to which the first tactile feedback is allocated to a size larger than a size threshold with a first magnification when the first region is smaller than the size threshold upon detection of the control input and generates the first tactile feedback in the zoomed in on first region.
In another embodiment of the present specification, a method for controlling a display device includes displaying a digital image including a first region to which a first tactile feedback is allocated, detecting a control input applied to the first region of the digital image, determining whether the first region of the digital image is smaller than a size threshold, zooming in on the first region to which the first tactile feedback is allocated to a size larger than the size threshold with a first magnification when the first region is smaller than the size threshold, and generating the first tactile feedback in the zoomed in on first region.
In another embodiment of the present specification, a display device includes a display unit configured to display a digital image, the digital image being divided into a plurality of regions to which different tactile feedbacks are allocated, a sensor unit configured to detect a control input applied to the display unit, a tactile feedback unit configured to generate tactile feedback allocated to a touch region in which the touch input is detected, and a controller configured to control the display unit, the sensor unit and the tactile feedback unit, wherein the controller detects touch input applied to the display unit, compares the size of a first region to which a first tactile feedback is allocated with the size of a second region to which a second tactile feedback is allocated when the touch region in which the touch input is detected includes the first region and the second region, generates the first tactile feedback in the touch region when the first region is larger than the second region, and generates the second tactile feedback in the touch region when the first region is smaller than the second region.
According to the present specification, the display device can zoom in on a displayed digital image to provide correct tactile feedback.
According to the present specification, the display device can control zoom-in magnification on the basis of the area or size of a region within which a touch input is detected.
According to the present specification, the display device can determine whether or not zoom-in is performed or a zoom-in ratio according to the size of a region having tactile feedback.
According to the present specification, the display device can zoom in on a digital image such that a region smaller than a size threshold becomes larger than the size threshold when a tactile feedback mode is activated.
According to the present specification, the display device can partially zoom in on a digital image of a region having tactile feedback.
According to the present specification, the display device can generate tactile feedback in a region larger than a region having the tactile feedback.
The accompanying drawings, which are included to provide a further understanding of the present specification and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the present specification and together with the description serve to explain the principle of the specification. In the drawings:
The detailed description, which will be given below with reference to the accompanying drawings, is intended to explain exemplary embodiments, rather than to show the only embodiments that can be implemented.
Although the terms used in the present specification are selected from generally known and used terms, the terms may be changed according to the intention of an operator, customs, or the advent of new technology. Some of the terms mentioned in the description of the present specification have been selected by the applicant at his or her discretion, the detailed meanings of which are described in relevant parts of the description herein. Therefore, the present specification must be understood, not simply by the actual terms used but by the meanings of each term as used herein.
In the specification, a display device may be a device including a display unit. For example, the display device can include a smartphone, a smartpad, a notebook computer, a tablet PC, a music player, a smart table, a monitor, a remote controller or a television receiver.
For example, the display device 11 can generate a first tactile feedback in the displayed first region 13 and generate a second tactile feedback in the second region 14. That is, the display device 11 can generate the first tactile feedback in any part of the first region 13 to which the first tactile feedback is allocated. In addition, the display device 11 can generate the second tactile feedback in any part of the second region 14 to which the second tactile feedback is allocated. In other words, each region included in a digital image can be defined as a set of parts having the same feedback.
Referring to the left of
Referring to the right of
To provide correct tactile feedback to the user, the display device 11 may operate in the following manner. When the touch region includes the first region and the second region, the display device 11 may generate tactile feedback allocated to a larger region in the touch region. The display device 11 may detect the touch input 15 applied to the display unit 12. When a touch region from which the touch input is detected includes the first region to which the first tactile feedback is allocated and the second region to which the second tactile feedback is allocated, the display device 11 may compare the sizes of the first region 13 and second region 14 included in the touch region.
When the first region 13 is larger than the second region 14, the display device 11 can generate the first tactile feedback in the entire touch region. That is, when the touch region includes the first region and the second region, the display device 11 can generate tactile feedback allocated to a larger region in the touch region. When the first region is smaller than the second region, the display device 11 can generate the second tactile feedback in the entire touch region. Accordingly, the display device 11 can provide correct tactile feedback of a region touched by the user to the user. That is, the display device 11 can generate single tactile feedback in the touch region corresponding to the control input.
As shown in the left of
The display device 11 may zoom in on the digital image in order to selectively generate the first tactile feedback in the touch region of the control input 15. The display device 11 may zoom in on the digital image as shown in the right of
The display device 11 may zoom in on the digital image in all directions from the region in which the control input 15 is detected. Accordingly, the user can tactually confirm the first tactile feedback allocated to the first region 13 of the zoomed digital image without moving the position of the control input 15.
If the control input 15 simultaneously touches the first region 13 and the second region adjacent thereto, the display device 11 may compare a first area corresponding to the area of the control input 15, detected in the first region, with a second area corresponding to the area of the control input 15, detected in the second region. When the first area is larger than the second area, the display device 11 can zoom in on the digital image including the first region and the second region on the basis of the first region. When the first area is smaller than the second area, the display device 11 can zoom in on the digital image including the first region and the second region on the basis of the second region.
The display device 11 may determine a zoom-in magnification of the digital image in order to selectively generate the first tactile feedback in the touch region of the control input 15. The display device 11 may determine the zoom-in magnification in response to the area of the touch region of the control input 15. According to another exemplary embodiment, the display device 11 may determine a magnification that allows the touch region to be included in the first region 13 as the zoom-in magnification.
Alternatively, the display device may determine a minimum magnification at which the first tactile feedback allocated to the first region of the digital image is discriminated from the second tactile feedback allocated to the second region adjacent to the first region as the zoom-in magnification.
The display device 11 may determine the zoom-in magnification such that the touch region of the control input 15 is included in a region having a single tactile feedback. The display device 11 may zoom in on the digital image with a first magnification such that the first region 13 includes the touch region of the control input 15. When the touch region of the control input 15 is included in the first region 13, the touch region may be a region in which tactile feedback is generated. That is, the display device 11 can zoom in on the digital image with the first magnification and generate the first tactile feedback in the region from which the control input 15 is detected. Accordingly, the display device 11 can correctly provide the first tactile feedback to the user.
In accordance with another exemplary embodiment, the display device 11 may zoom in on the digital image with the first magnification such that the first region 13 corresponding to an area greater than a predetermined percentage of the touch region of the control input 15 is included in the touch region of the control input 15. Accordingly, the display device 11 can generate the first tactile feedback in the part occupying the predetermined percentage of the touch region of the control input 15 or more and provide the correct first tactile feedback to the user.
As described above, the display device 11 can zoom in on the displayed digital image to locate a region having a single tactile feedback in the touch region in which the control input 15 is detected. Accordingly, the display device 11 can generate a single tactile feedback in the touch region in which a plurality of tactile feedbacks were generated and provide the correct tactile feedback to the user.
The display device 11 may discriminate and detect control input touch regions having different sizes. The display device 11 may adaptively determine a zoom-in magnification based on detected touch region sizes. When the size of the touch region of the control input corresponds to a first size, the display device 11 may zoom in on the digital image with the first magnification. When the size of the touch region of the control input corresponds to a second size, the display device 11 may zoom in on the digital image with a second magnification. If the second size is greater than the first size, the display device 11 may set the second magnification such that the second magnification is higher than the first magnification.
The left and right images of
Alternatively, the display device 11 may set the size of the first region 13 zoomed in with the first magnification as the size threshold. The display device 11 may zoom in on the first region 13 to a larger extent than the size threshold. Accordingly, the display device 11 can generate a single tactile feedback for the first control input 31 corresponding to the touch region having the first size.
Referring to the right of
The display device 11 may zoom in on the digital image with the second magnification such that the touch region of the second size is included in the first region 13. Here, the display device 11 may determine a minimum magnification that allows the first region 13 to include the touch region of the second size as the second magnification. According to another exemplary embodiment, the display device 11 may set the size of the first region 13 zoomed in with the second magnification as the size threshold. The display device 11 may zoom in on the first region 13 to a size larger than the size threshold. Accordingly, the display device 11 can generate a single tactile feedback for the second control input 32 having the touch region of the second size.
In the visual mode, the display device may display a digital image. The display device may not generate tactile feedback even when tactile feedback is allocated to each region of the digital image. The user may visually confirm the displayed digital image and cannot be provided with tactile feedback even when the user touches the display unit on which the digital image is displayed.
In the tactile mode, the display device may generate tactile feedback allocated to each region of the displayed digital image. The user can confirm the displayed digital image and touch the region in which the digital image is displayed to tactually confirm the tactile feedback.
The display device may zoom in on the displayed digital image with a predetermined zoom-in magnification upon activation of the tactile mode. Here, the predetermined zoom-in magnification may be a magnification that allows a region having tactile feedback according to zoom in to become larger than the size threshold. The display device may set a predetermined reference area as the size threshold. The display device may determine the average of areas of touch regions of control inputs as the reference area. In other words, the display device can determine the average of areas of touch regions on the basis of a plurality of control inputs for digital images including tactile feedback.
As shown in the left of
The display device 11 in the visual mode may display a soft button 41 to activate the tactile mode. The user may operate the soft button 41 using a touch input or a pointer 42. The display device 11 may switch from the visual mode to the tactile mode upon detection of a control input applied to the soft button 41 to activate the tactile mode. The display device 11 may change the image of the soft button 41 to use the soft button as an indicator for indicating that the display device 11 is in the tactile mode.
In the tactile mode, the display device 11 may zoom in on the displayed digital image with a zoom-in magnification. Here, the display device 11 may set a magnification that allows a region having a single tactile feedback according to zoom in to become larger than the size threshold as the zoom-in magnification. In the left of
The display device 11 may zoom in on the digital image according to the determined zoom-in magnification and thus each region included in the digital image can be zoomed in to larger than the size threshold. According to another exemplary embodiment, the display device 11 may individually zoom in on each region included in the digital image with the determined zoom-in magnification. The display device 11 may zoom in on the first region 13 corresponding to the smallest region with the determined zoom-in magnification. The display device 11 may zoom in on another region included in the digital region, to which tactile feedback is allocated, according to the determined zoom-in magnification. That is, the digital device 11 can zoom in on the second region as well as the first region according to the set zoom-in magnification.
Accordingly, the user can tactually confirm tactile feedback allocated to each region by touching each region. The display device 11 may generate the first tactile feedback in the zoomed in on first region 13. That is, the display device 11 can correctly provide the first tactile feedback allocated to the first region to the user by displaying the first region in the visual mode and displaying the zoomed in on first region in the tactile mode.
Referring to the left of
The display device 11 may set a maximum magnification that allows the first region 52 and the second region 53 included in the zoomed digital image 51 to be included in the display area of the display unit 12 as the zoom-in magnification. That is, the display device 11 can zoom in on the digital image within a range within which the first region 52 or second region 53 is not outside the display area.
The right of
The left of
Here, the display device 11 may zoom in on the first region 62 with the first magnification. The display device 11 may set the first magnification based on the size of the touch region of the control input 64 detected from the first region 62. That is, the display device 11 can increase the first magnification in proportion to the size of the touch region of the detected control input 64.
The display device 11 may generate the first tactile feedback in the zoomed in on first region 62. Accordingly, the user can tactually confirm the first tactile feedback through the zoomed in on first region 62.
The display device 11 may maintain the zoomed first region 62 during detection of the control input 64. The display device 11 may return the zoomed first region 62 to the original size thereof upon release of the control input 64.
The right of
Here, the display device 11 may zoom in on the first region 62 with the second magnification. The display device 11 may set the second magnification based on the size of the touch region of the control input 64 detected from the second region 63. That is, the display device 11 can increase the second magnification in proportion to the size of the touch region of the detected control input 64.
The display device 11 may generate the second feedback in the zoomed in on second region 63. Accordingly, the user can tactually confirm the second tactile feedback through the zoomed second region 63.
The display device 11 may maintain the zoomed second region 63 during detection of the control input 64. The display device 11 may return the zoomed second region 63 to the original size thereof upon release of the control input 64.
When the first region is smaller than the size threshold, the display device 11 may zoom in on a region in which the first tactile feedback allocated to the first region is generated to a size larger than the size threshold according to the first magnification. That is, the display device 11 can zoom in on the region in which the tactile feedback allocated to the first region is generated instead of the first region. Accordingly, the user can tactually confirm the first tactile feedback in a region wider than the first region while visually confirming the first region at the original size thereof.
At least one of the size threshold and the first magnification may be determined based on the size of the touch region of the control input. That is, the display device 11 may increase the size threshold in proportion to the size of the touch region of the control input. The display device 11 may generate the first tactile feedback in the zoomed in on region in which the first tactile feedback is generated. In this manner, the display device 11 can provide correct tactile feedback allocated to each region to the user by zooming in on a region in which tactile feedback allocated to each region is generated while maintaining the digital image and each region included therein at the original sizes thereof.
The left of
Here, the display device 11 may zoom in on the region in which the first tactile feedback allocated to the first region 72 is generated with the first magnification. The display device 11 may set the first magnification based on the size of the touch region of the control input 74 detected from the first region 72. That is, the display device 11 can increase the first magnification in proportion to the size of the touch region of the detected control input 74.
The display device 11 may generate the first tactile feedback in the zoomed first tactile feedback generation region. Accordingly, the user can tactually confirm the first tactile feedback through the zoomed first tactile feedback generation region.
The display device 11 may maintain the zoomed first tactile feedback generation region during detection of the control input 74. The display device 11 may return the zoomed first tactile feedback generation region to the original size thereof and generate the first tactile feedback in the first region 72 upon release of the control input 74.
The right of
Here, the display device 11 may zoom on in the region in which the second tactile feedback allocated to the second region is generated with the second magnification. The display device 11 can set the second magnification based on the size of the touch region of the control input 74 detected from the second region 73. That is, the display device 11 can increase the second magnification in proportion to the size of the touch region of the detected control input 74.
The display device 11 may generate the second tactile feedback in the zoomed second tactile feedback generation region . . . Accordingly, the user can tactually confirm the second tactile feedback through the zoomed second tactile feedback generation region.
The display device 11 may maintain the zoomed second tactile feedback generation region during detection of the control input 74. The display device 11 may return the zoomed second tactile feedback generation region to the original size thereof and generate the second tactile feedback in the second region 73 upon release of the control input 74.
The display unit 101 may display a digital image. The digital image may include a plurality of regions each of which is allocated a single tactile feedback.
The display unit 101 may include a light-emitting diode (LED), an organic LED (OLED), a liquid crystal display (LCD), an electronic ink panel or a flexible display. The display unit 101 may include a touch sensitive display unit and detect a control input touching the display unit. In addition, the display unit 101 may include a tactile display unit and provide tactile feedback of the tactile feedback unit, which will be described below.
The tactile feedback unit 102 may generate tactile feedback in response to a control input. The tactile feedback unit 102 may generate tactile feedback in a region to which tactile feedback is allocated in a digital image. The tactile feedback unit 102 may generate tactile feedback in a region corresponding to visual information of each region of the digital image. In addition, the tactile feedback unit 102 may set a region wider than each region of the digital image as tactile feedback generation region and generate tactile feedback.
The tactile feedback unit 102 generates tactile feedback and provides the tactile feedback to a user through the following method. The tactile feedback unit 102 may deliver tactile feedback to a user finger using a micro-vibration actuator or an ultrasonic vibration actuator. The tactile feedback unit 102 can control an oscillation frequency and vibration amplitude so as to adjust the intensity of the tactile feedback delivered to the user finger.
According to another embodiment, the tactile feedback unit 102 may generate micro current to provide tactile feedback to the user. The tactile feedback unit 102 can control current intensity and current generation period such that the user can feel different forms of tactile feedback.
In addition, the tactile feedback unit 102 may generate tactile feedback using ultrasonic resonance. The tactile feedback unit 102 may generate a plurality of ultrasonic waves and resonate the ultrasonic waves in a user finger to supply tactile feedback to the user. The tactile feedback unit 102 can control the amplitude of the resonance frequency and resonance generation period to generate different tactile feedbacks. The above-described display unit 101 and the tactile feedback unit 102 may be integrated into a tactile display unit.
The sensor unit 103 may sense a control input applied to the display device. The sensor unit 103 may sense a control input touching the display unit 101. The sensor unit 103 may sense a control input of the user using a resistive or capacitive touch sensor. The sensor unit 103 may deliver information about the sensed control input to the controller 104. The display unit 101 and the sensor unit 103 may be integrated into a touch sensitive display unit.
The controller 104 may control the display unit 101 and the tactile feedback unit 102 using information transmitted from the sensor unit 103. The controller 104 may display a digital image including a first region on the display unit 101. The controller 104 may compare the first region with a size threshold upon detection of a control input applied to the first region. The controller 104 may zoom in on the first region to a size larger than the size threshold when the first region is smaller than the size threshold. The controller 104 may zoom in on the first region with a first magnification. The first magnification may be determined based on the size of the touch region of the control input.
The controller 104 may zoom in on the first region through the following three methods. Firstly, the controller 104 can zoom in on the first region by zooming in on the digital mage. Accordingly, the controller 104 can also zoom in on other regions included in the digital image including the first region. Therefore, the user can be correctly provided with not only tactile feedback of the zoomed first region but also tactile feedbacks of the zoomed other regions.
Secondly, the controller 104 can partially zoom on in the first region. In this case, the controller 104 can selectively zoom in on only the first region while maintaining the region other than the first region in the digital image in the original size thereof. Accordingly, the user can confirm selective zoom-in of the first region selected through the control input visually and tactually.
Thirdly, the controller 104 may zoom in on a region in which the first tactile feedback allocated to the first region is generated. In this case, the controller 104 can zoom in on only the first tactile feedback generation region while maintaining each region of the digital image including the first region at the original size thereof. Accordingly, the user can tactually confirm the first tactile feedback in a region wider than the first region while visually confirming the digital image in the original size thereof.
In this manner, the controller 104 can zoom in on the first region through the three methods and thus the controller 104 can correctly provide the first tactile feedback allocated to the first region to the user.
In
The display device may display a digital image including a first region to which a first tactile feedback is allocated (S10). As described above with reference to
The display device may detect a control input applied to the display unit from the first region (S20). As described above with reference to
The display device may determine whether the first region is smaller than a size threshold (S30). As described above with reference to
When the first region is smaller than the size threshold, the display device may zoom in on the first region to a size larger than the size threshold with the first magnification (S40). As described above with reference to
Alternatively, the display device may selectively zoom in on the first region. The display device may selectively zoom in on the first region only while maintaining the region of the digital image other than the first region in the original size thereof. Accordingly, the display device can selectively zoom in on the first region selected by the control input and correctly provide the first tactile feedback to the user through the zoomed in on first region.
Alternatively, the display device may zoom in on a region in which the first tactile feedback allocated to the first region is generated. In this case, the display device can zoom in on only the first tactile feedback generation region while maintaining each region of the digital image including the first region at the original size thereof. Accordingly, the display device can correctly provide the first tactile feedback in a region zoomed in on compared to the first region to the user while displaying the digital image at the original size thereof.
The display device may determine a minimum magnification that allows the zoomed in on first region to include the touch region of the control input as the first magnification.
The display device may generate the first tactile feedback in the zoomed in on first region (S50). As described above with reference to
As described above, the display device can provide correct tactile feedback to the user by zooming in on a region smaller than the size threshold and generating tactile feedback in the zoomed in on region.
Number | Date | Country | Kind |
---|---|---|---|
10-2013-0104656 | Sep 2013 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
8018452 | Dow | Sep 2011 | B1 |
8400283 | Fadell et al. | Mar 2013 | B2 |
8405627 | Karlsson | Mar 2013 | B2 |
8451248 | Kim | May 2013 | B1 |
20030164861 | Barbanson | Sep 2003 | A1 |
20090066666 | Sagou | Mar 2009 | A1 |
20090322498 | Yun et al. | Dec 2009 | A1 |
20100156807 | Stallings et al. | Jun 2010 | A1 |
20100231541 | Cruz-Hernandez et al. | Sep 2010 | A1 |
20100267424 | Kim et al. | Oct 2010 | A1 |
20110043662 | Kim | Feb 2011 | A1 |
20110057886 | Ng et al. | Mar 2011 | A1 |
20110138275 | Yu | Jun 2011 | A1 |
20110187750 | Ko et al. | Aug 2011 | A1 |
20120079390 | Ballagh et al. | Mar 2012 | A1 |
20140022216 | Nakamura | Jan 2014 | A1 |
Number | Date | Country |
---|---|---|
WO 2012132802 | Oct 2012 | WO |
Number | Date | Country | |
---|---|---|---|
20150062024 A1 | Mar 2015 | US |