1. Field of the Invention
The present invention relates to an image displaying apparatus and an image displaying method, in particular to those that provide vibrations along with an image.
2. Description of the Related Art
An image display apparatus converts an input video signal into light to represent luminance changes. Thus, an object captured by in image capturing apparatus such as a camera is displayed on a screen. However, from a viewpoint of real representation of texture of the object, such a technique does not satisfy the user.
In recent years, an apparatus called a “tactile display” that represents unevenness of an object with expansion/shrink of moving devices has been studied. Unevenness and shape of an object can be reproduced by this display.
For example, Japanese Unexamined Patent Application Publication No. 2006-47578 discloses a tactile display apparatus that allows the user to sense a solid shape represented by sensing protruded states of tactile pins that are two-dimensionally arranged on a plane operation panel.
In the forgoing tactile display apparatus, since the size of the moving devices is as large as for example 1 to 2 mm, the tactual resolution inevitably decreases. In addition, it is difficult to say that the response speeds of the moving devices are as fast as the motion of an image. In addition, since the moving devices were not capable of representing colors of an image and luminance changes, there was a problem that even if the shape and texture of an object were able to be represented to some extent, details of an image were difficult to be represented.
In view of the foregoing, it would be desirable to tactually represent an object with both its texture and its image.
According to an embodiment of the present invention, there is provided an image display apparatus including a display section, vibrators, and a driving section. The display section displays an image. The vibrators each have a smaller size than that of each of pixels that compose the image and disposed on a display surface of the display section corresponding to the pixels. The driving section drives the vibrators.
Thus, an image is displayed with pixels of the display section and the vibrators disposed corresponding to the individual pixels that compose the image are operated.
According to an embodiment of the present invention, since an image is displayed with pixels of the display section and the vibrators disposed corresponding to the individual pixels that compose the image are operated, the user can recognize an object with his or her visual sense and tactual sense.
The invention will become more fully understood from the following detailed description, taken in conjunction with the accompanying drawings, wherein similar reference numerals denote corresponding elements, in which:
Next, with reference to the accompanying drawings, an embodiment of the present invention will be described. This embodiment is an image display apparatus that displays projection light of a projector to the screen.
The system shown in
As shown in a right-side enlarged view of
In this example, the vibration devices Pe are sufficiently smaller than the corresponding pixels P such that the vibration devices Pe do not interfere with an image displayed on the screen 200. The vibration devices Pe may be disposed on any of the front surface and the rear surface of the screen 200. Since the pixels P on the screen 200 depend on an image projection process performed on the projector 100 side. Thus, devices that compose pixels are not disposed on the screen 200.
Since the vibration devices Pe are composed of pressure-to-electricity converting devices, voltages are applied to the vibration devices Pe, horizontal data wires Ld, vertical address wires La, diodes D1, and diodes D2 are mounted on the front surface (or rear surface) of the screen 200. These devices will be described later in detail.
In this embodiment, the number of operating vibration devices Pe (or their vibration periods) disposed corresponding to pixels P can be changed based on a feature amount of an image projected on the screen 200. Specifically, the vibration devices Pe are controlled such that they are operated in an uneven area in a pattern of a displayed image and they are not operated in a flat area.
In
The number of vibrations of each of the vibration devices Pe depends on the physical size of the piezoelectric devices. Thus, in this embodiment, since the sizes of the piezoelectric devices are identical, to change the numbers of vibrations of each of the Piezo-electric devices corresponding to its mounted position, the period for which the voltage is applied to each of the Piezo-electric devices Pe is adjusted. In other words, in a finely uneven region of an image, the period for which the voltage of E volt is applied is increased, whereas in a roughly uneven region, the period for which the voltage of E volt is applied is decreased. As a result, the number of vibrations of each of the vibration devices Pe can be changed corresponding to the texture of the image. Details of controlling of the number of vibrations will be described later.
Next, with reference to
First, the structure of the projector 100 will be described. The projector 100 includes a video memory 101 that stores a video signal for one frame and a memory control section 102 that controls reading and writing of the video signal from and to the video memory 101 in synchronization with a video synchronous signal.
In addition, the projector 100 includes a vertical driving section 103 that selects a vertical address wire based on the video synchronous signal. Moreover, the projector 100 includes a horizontal driving section 104 that successively converts a video signal for one line that is output from the video memory 101 into an analog video signal under the control of the memory control section 102 and outputs the analog video signal to the horizontal data wires. The vertical address wires, horizontal data wires, and pixels P controlled therethrough are disposed on an image display panel 105 in a matrix shape. Detail structures of the vertical driving section 103 and the horizontal driving section 104 will be described later.
The screen 200 includes a control section 210, a vibration period signal memory 205, a memory control section 206, a vertical driving section 207, a horizontal driving section 208, and a vibration device panel 209 (the vertical drive section 207 and the horizontal drive section 208 serve as a driving section). The control section 210 calculates parameters with which the vibration periods of the vibration devices Pe are decided, generates a vibration period signal that represents information about the lengths of vibration periods based on the calculated parameters, and outputs the generated vibration period signal to the vibration period signal memory 205. Details of the control section 210 will be described later.
The vibration period signal memory 205 stores the vibration period signal generated in the control section 210. The memory control section 206 controls reading and writing of the vibration period signal from and to the vibration period signal memory 205 in synchronization with the video synchronous signal. The vertical driving section 207 selects a vertical address wire La (see
Next, details of the structure of the control section 210 will be described. The control section 210 includes a section that calculates the differences of adjacent pixels (referred to as the difference calculation section) 201, a section that calculates the average value of which the sum of the absolute values is divided by the number of pixels (this section is referred to as the average value calculation section) 202, a section that counts the number of polarity changes (referred to as the counting section) 203, and a vibration period determination look up table (LUT) 204 (serving as a table). The difference calculation section 201 calculates the difference values of adjacent pixels in a predetermined area around a pixel under consideration, for example N pixels (where N is a natural number) in the horizontal direction of an image. In this embodiment, the difference values of pixel values in the horizontal direction of an image are obtained. Instead, the difference values of pixel values in the vertical direction of an image may be obtained. Instead, the difference values of pixel values both in the horizontal direction and the vertical direction may be obtained.
The average value calculation section 202 adds the absolute values of the difference values of adjacent pixels in the predetermined region, which have been calculated by the difference calculation section 201, obtains the sum of the absolute values, divides the sum by the number of pixels P, and obtains the average value of which the sum of the absolute values of the difference values of adjacent pixels is divided by the number of pixels. The counting section 203 detects the number of polarity changes of pixel values in the horizontal direction of the image and counts the number of polarity changes in the predetermined region.
The vibration period deciding LUT 204 is a table that correlates the average values of which the sum of the absolute values of difference values of adjacent pixels is divided by the number of pixels, the numbers of polarity changes, and the vibration periods for which a vibration device Pe is vibrated. With the average value of which the sum of the absolute values of the difference values of the adjacent pixels is divided by the number of pixels and the number of polarity changes, the vibration period for which a vibration device Pe is vibrated can be uniquely obtained from the vibration period deciding LUT 204.
An upper row of a table shown in
In
In other words, when the number of polarity changes in a predetermined region is large, it can be determined that unevenness of an image in the region be fine. In contrast, when the number of polarity changes is small, it can be determined that unevenness of the image in the region be rough or changes of the image be simple.
In other words, the vibration period for which a voltage is applied to a vibration device Pe increases in proportion to the average value of which the sum of absolute values of adjacent pixels in a predetermined region is divided by the number of pixels and the number of polarity changes. The normalized vibration periods (hereinafter referred to as normalized vibration periods) in the vibration period deciding LUT 204 can be adjusted, for example, by multiplying them by any coefficient.
Next, with reference to
The vertical driving section 103 shown in
The horizontal driving section 104 includes the synchronous separation section 104a that separates vertical synchronous pulses and horizontal synchronous pulses from the video synchronous signal, a horizontal control signal generation section 104b that generates various types of control signals based on horizontal synchronous pulses, and a horizontal shift register 104c. In addition, the horizontal driving section 104 includes digital-to-analog conversion sections 104d1 to 104dn that convert a video signal that is output from the horizontal shift register 104c into an analog video signal.
The horizontal control signal generation section 104b generates a clear signal Cs and an enable signal Es in synchronization with horizontal synchronous pulses and pixel clock pulses and outputs these signals to the horizontal shift register 104c. The horizontal shift register 104c successively stores a video signal for one horizontal line that is output from the video memory 101 (see
The vertical driving section 207 of the vibration device panel 209 shown in
The horizontal driving section 208 includes a synchronous separation section 208a, a horizontal control signal generation section 208b, a horizontal shift register 208c, and a vibration period conversion section 208d.
The synchronous separation section 208a separates vertical synchronous pulses and horizontal synchronous pulses from the video synchronous signal. The horizontal control signal generation section 208b generates the clear signal Cs and the enable signal Es in synchronization with horizontal synchronous pulses and outputs these signals to the horizontal shift register 208c. The horizontal shift register 208c successively stores the vibration period signal for one horizontal line that is output from the vibration period signal memory 205 (see
Next, with reference to timing charts shown in
In
While the high signal is being supplied to a vibration device pe through a corresponding horizontal data wire Ld, a corresponding vibration device Pe is vibrated. While the high signal is not being supplied to the vibration device Pe, it is not vibrated.
The durations of the high signal supplied to the horizontal data wires Ld1 to Ldn are different because periods designated by the vibration period signal differ for each of the horizontal data wires Ld1 to Ldn.
In other words, a voltage supply period for an i-th, j-th vibration device Pe disposed depends on the period for the low signal supplied to the vertical address wire Lai and the period for the high signal supplied to the horizontal data wire Ldj (where i and j are any natural numbers in the vertical and horizontal directions, respectively).
Thereafter, a PWM signal is generated based on the vibration period (at step S5). When the PWM signal is supplied to a particular vibration device Pe under the control of the vertical driving section 207 and the horizontal driving section 208, the vibration device Pe is driven and vibrated (at step S6).
According to the foregoing embodiment, since the vibration devices Pe are disposed corresponding to the pixels P in the relationship of one to one, not only an image is displayed on the display screen, but the vibration devices Pe are also vibrated. Thus, the user can visually and tactually recognize an object.
In this case, since the size of each of the vibration devices Pe is sufficiently smaller than that of each of the pixels P and the vibration devices Pe are disposed corresponding to the pixels P, a presentation screen that presents an object with vibrations can have the same resolution as that of a displayed image.
In this case, a period for which a voltage is applied to a vibration device Pe is set based on a change amount of pixel values of adjacent pixels P. Thus, vibrations of the vibration devices Pe correspond to content displayed as an image.
In addition, since the vibration devices Pe are individually addressed by the vertical address wires La and the horizontal data wires Ld, the individual vibration devices Pe can be vibrated corresponding to content of a display of the pixels P corresponding to the vibration devices Pe.
According to an embodiment of the present invention, the periods for which voltages are applied to the vibration devices Pe can be obtained by referring to the vibration period deciding LUT 204 that has been prepared. In the vibration period deciding LUT 204, the vibration periods are set such that as changes of pixel values of adjacent pixels become large or the number of polarity changes becomes large, the vibration period becomes longer. Thus, at an uneven region of an image, the vibration devices Pe are vibrated. At a flat region of the image, the vibration devices Pe are not vibrated.
In the vibration period deciding LUT 204, vibration periods have been set corresponding to change amounts of pixel values and the number of polarity changes when pixel values are changed. Thus, at a finely uneven region of an image, the vibration devices Pe are strongly vibrated. At a largely uneven region of an image, the vibration devices Pe are weakly vibrated. Thus, the texture of the object can be represented by vibrations.
The foregoing embodiment was applied for a system using the rear projection type projector 100. However, an embodiment of the present invention may be a system composed of a front projection type projector and a screen. Instead, an embodiment of the present invention may be panel illumination type displays such as a liquid crystal display (LCD) and a plasma display panel (PDP).
Thus, when vibration devices Pe are disposed corresponding to pixels P in the relationship of one to one, an image and vibrations can be simultaneously presented with a display such as an LCD.
In the foregoing embodiment, pixels P and vibration devices Pe are disposed correspondingly in the relationship of one to one. Instead, pixels P and vibration devices Pe may be disposed correspondingly in the relationship of another ratio such as two to one or three to one. In other words, one vibration device Pe may be disposed every a predetermined number of pixels P such that the number of vibration devices Pe is decimated from the number of pixels P.
In addition, in the foregoing embodiment, the vibration periods for the vibration devices Pe are controlled with periods for which voltages are applied to the vibration devices Pe, respectively. Instead, the vibration periods for the vibration devices Pe may be controlled by adjusting the pulse width of the PWM signal.
In the foregoing embodiment, the vibration devices Pe are composed of piezoelectric devices. Instead, other devices may be used as long as they are pressure-to-electricity converting devices.
In the foregoing embodiments, the texture of an image displayed on a screen is reproduced by vibrations of the vibration devices Pe. Instead, for example, content represented by pseudo colors may be correlated with vibrations. When a temperature distribution in an area represented by a natural image is displayed by pseudo colors, the vibration devices Pe may be vibrated corresponding to a color that represents a portion having the highest temperature. In addition, when an image having a plane pattern and a gradation where pixel values are gradually changing is represented by pseudo colors, by vibrating vibration devices Pe disposed at boundaries of the gradation, the gradation can be represented by vibrations.
Instead, an embodiment of the present invention may be applied to a structure that by extracting edge portions of an image and vibrating only vibration devices Pe disposed at positions extracted as the edge portions, the user can easily recognize the shape of an object by his or her tactual sense.
Instead, when an object in an image is tracked by a technique such as pattern-matching or the object itself is extracted, an embodiment of the present invention may be applied to a structure that the motion of the object as a result of tracking and information about the position of the object are recognized by vibrations.
In addition, an embodiment of the present invention may be applied to a medical application that a moving image of a beating heart is reproduced by vibrations. In this case, a representative value or an average value of a moving vector may be calculated as a feature amount of the heart from the image. Instead, the area or the like of the heart may be calculated. The vibration devices Pe may be vibrated in proportion to the calculated values.
The present application contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2008-106133 filed in the Japanese Patent Office on Apr. 15, 2008, the entire content of which is hereby incorporated by reference.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alternations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Number | Date | Country | Kind |
---|---|---|---|
2008-106133 | Apr 2008 | JP | national |