Patent Application
20140380156
Touch sensitive display technologies are ever prevalent in modern devices. A variety of devices ranging from hand held mobile devices to large LCD displays incorporate touch sensitive layers to enable the user to interact with displayed content directly. Touch sensory integration in displays eliminate the need for additional devices to control the displayed content. In addition, touch sensory input may enable a heightened level of user interaction with displayed content by enabling additional levels of control such as multi-gesture input, two handed input, multiple user input, etc.
A majority of legacy touch sensitive displays do not provide tactile feedback. Lacking a feedback, a user is unable to sense an interaction with the displayed content. Those devices with tactile feedback capabilities usually implement such features in limited fashion. Devices with tactile feedback functions are usually limited to small display sizes and mostly implement vibration based technologies. Limited deployment of tactile feedback technologies take away from a more immersive user experience while interacting with displayed content.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to exclusively identify key features or essential features of the claimed subject matter, nor is it intended as an aid in determining the scope of the claimed subject matter.
Embodiments are directed to providing infrastructural haptics on wall scale interactive displays. An interactive wall may be enabled to detect a touch on a wall surface through sensors of the interactive display. Upon detecting a touch event such as a click, a button press, a dragging motion, or comparable action, the interactive wall may provide a tactile feedback corresponding to the detected touch through actuators integrated into the wall.
These and other features and advantages will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory and do not restrict aspects as claimed.
As briefly described above, infrastructural haptics may he provided on wall scale interactive displays. An interactive wall may be enabled to detect a touch on a wall surface through sensors of the interactive wall. Upon detecting the touch, the interactive wall may provide real time tactile feedback corresponding to the detected touch. In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way of illustrations specific embodiments or examples. These aspects may be combined, other aspects may be utilized, and structural changes may be made without departing from the spirit or scope of the present disclosure. The following detailed description is therefore not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims and their equivalents.
While the embodiments will be described in the general context of program modules that execute in conjunction with an application program that runs on an operating system on a computing device, those skilled in the art will recognize that aspects may also be implemented in combination with other program modules.
Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that embodiments may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and comparable computing devices. Embodiments may also he practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
Embodiments may be implemented as a computer-implemented process (method), a computing system, or as an article of manufacture, such as a computer program product or computer readable media. The computer program product may be a computer storage medium readable by a computer system and encoding a computer program that comprises instructions for causing a computer or computing system to perform example process(es). The computer-readable storage medium is a non-transition comparer readable memory device. The computer-readable storage medium can for example be implemented via one or more of a volatile computer memory, a non-volatile memory, a hard drive, a flash drive, a floppy disk, or a compact disk, and comparable physical storage media,
Throughout this specification, the term “platform” may be a combination of software and hardware components for providing infrastructural haptics on wall scale interactive displays. Examples of platforms include, but are not limited to, a hosted service executed over a plurality of servers, an application executed on a single server, and comparable systems. The term “server” generally refers to a computing device executing one or more software programs typically in a networked environment. However, a server may also be implemented as a virtual serve software programs) executed on one or more computing devices viewed as a server on the network. More detail on these technologies and example operations is provided below.
Haptics is a technology to provide tactile user feedback to touch. Sensors on a surface may detect the touch by sensing pressure. Alternatively, optical or infrared detection based sensor technologies may also be implemented. A control device may receive the sensor input and instruct actuators to move the surface. The surface movement may be dependent on the location and the sequence of the touch. The actuators may move part of the surface. Alternatively, actuators may move the whole surface based on the control service's instructions.
Embodiments are not limited to haptics as described above. A surface with haptics capabilities may be utilized for display purposes. The tactile feedback may be shaped according to displayed content. An example may be a simulation of a scroll wheel. A haptics capable surface may provide the sensation of a clickable scroll wheel as a user swipes along the surface. The haptics capable surface may utilize vibrating actuators to move the surface. Alternatively, the haptics capable surface may utilize sound producing actuators to move the surface for tactile feedback while providing audio feedback.
Embodiments provide infrastructural haptics on wall scale interactive displays. Tactile feedback may enable walls to act as interactive media while serving as displays. A user may be enabled to touch an interactive wall and receive feedback from the interactive wall displaying a projected image. Alternatively, an interactive wall may provide tactile feedback to a user utilizing a display attached to the wall. While references are made to interactive walls providing tactile feedback through sensors and actual throughout the Specification and Claims, embodiments are not limited to only vibration as a means to move the interactive wall. Tactile feedback through an interactive wall may be provided through other means applying the principles discussed herein.
Embodiments enable infrastructural haptics on wall scale interactive displays through control re Bourges using a network 120. The nets work 120 may be a local net pork or may be an external entity such as an Internet based infrastructure. It may provide wired or wireless connectivity. Interactive wall 130 and the control service 110 may connect to each other through unsecured or secured connectivity. An example of a secured connectivity may be a Virtual Private Network (VPN) established among the interactive wall and the control service with the use of encrypted communications.
The server 110 may provide tactile feedback matching a detected touch on the interactive wall 130. The server may integrate sensory input with the displayed content to retrieve matching tactile feedback. In an embodiment, the server 110 may provide the control service as a separate entity accessible through network 120. In an alternative embodiment, the control service 110 may be provided by an integrated circuit within the interactive wall. Yet in other embodiments, the control service may be on the display device for tight integration with the displayed content. Embodiments are not limited to client/server and peer-to-peer architectures. Providing infrastructural haptics on wall scale interactive displays may be accomplished using other architectures.
Embodiments introduce a user interaction model that provides a realistic tactile sensation of manipulating physical objects, environments and controls. On-screen button shapes and topology may be felt through touch without having to rely on visual occures. The tactile, incremental indents of an on-screen scroll wheel can be simulated, providing more user control. Textures can be simulated for swipe and multi-touch gestures. On-screen buttons may provide a click-back sensation when pressed insuring a positive actuation. Navigation through virtual environments can be controlled using various levels of pressure on the screen.
In a networked implementation, interactive wall 210 may detect touch, provide tactile feedback by forwarding the detected touch to control server 230, and receive instructions for providing tactile feedback through actuators. The control server 230 may manage sensory feedback and display con c it integration and transmit a corresponding tactile feedback in order for the interactive wall to play the tactile feedback.
The interactive wall 210 may initiate real time tactile feedback to sensed touch by detecting a touch on wall surface through sensors embedded within the wall (212). Alternatively, the touch may be detected through optical sensors, infrared detection based sensors, or similar ones. The touch may be a single instance of detected pressure on the interactive wall surface. Alternatively, the touch may be sequence of pressures in a varies of locations detected on the interactive wall surface. After detecting the touch, the interactive wall 210 may request a tactile feedback corresponding to the touch (214) from the control server 230. The request may include the location(s) the sequence, and the level of pressure of the touch.
Next, the control server 230 may determine the tactile feedback corresponding to the touch (216). The control server 230 may analyze the parameters of the touch such as location, sequence, and level of pressure and integrate with displayed content. In an example, if the request matches single pressure in a sensory area corresponding to a displayed button, the control server may search for tactile feedback for a button press. The control server 230 may retrieve a tactile feedback matching the touch from a data store containing variety of touches and tactile feedbacks corresponding to the touches.
Upon retrieving a corresponding tactile feedback, the control server 230 may transmit the tactile feedback to the interactive wall (218). The interactive wall 210 may play the tactile feedback through actuators installed on the wall (220). The actuators may vibrate to move the interactive wall in order to simulate a tactile feedback. An example may be a swipe motion in which the actuators move the interactive wall to create contours along the length of the swipe to simulate a fluid wall. Alternatively the actuators may move the wall continuously to maintain surfaces to duplicate the displayed content therefore giving a 3D shape o the interactive wall surface.
Additionally, it is important to manage any delays in the tactile feedback system. The tactile feedback may be played in real time within a time frame under a user's perception to detect delay. An example time frame may be under 0.1 seconds from detection of the touch to the play of the tactile feedback.
The described infrastructural haptics on wall scale interactive displays are for illustration purposes. Other tactile feedback systems on interactive walls may be used to provide tactile feedback to detected touch. Furthermore, feedback may be simulated by actuators moving the interactive wall through vibration, sound, etc.
In another embodiment, an air gap or dampening material between wall stud and the interactive wall may allow movement in between fixed surfaces 322. Sensors 324 embedded within the interactive wall section may detect touch from user(s). An actuator 330 may play a tactile feedback corresponding to the touch to simulate hardware feedback. The actuator 330 may be mounted on an actuator mounting bar 328. Additionally, the mounting bar may he fixed to an interactive wall stud 326.
According to one embodiment, the sensors are embedded on the interactive wall surface registering the touch in another embodiment, a display is projected to the interactive wall through a projector. Alternatively, the display may be overlaid on the interactive wall and utilize the display's sensors to provide sensory input to the interactive wall. The tactile feedback may be determined depending on a pressure level, a location, and a sequence of the touch.
The scenarios discussed above are provided as example embodiments. Other scenarios may he used to provide infrastructural haptics on wall scale interactive displays utilizing the principles discussed herein.
In some embodiments, diagram 400 may illustrate actuators installed as an array of actuators on an interactive wall 420 to provide tactile feedback play through apart or whole of the interactive wall. The interactive wall 420 may be adjacent to a standard wall 410. The interactive wall 420 may have studs that have fixed bars 426 holding the actuator 424. In an example, the actuators may be vibration generating devices installed on bars spanning across interactive wall studs.
In another embodiment, the actuators may be installed equidistance apart on a grid behind the interactive wall. In yet another embodiment, the actuators may be installed on studs of the interactive wall. In an example scenario, a damping agent or an air gap separates the actuators and the interactive wall to avoid vibration on the interactive wall studs while moving the interactive wall. In another example scenario, dampening agents separate the interactive wall with adjacent non-interactive walls.
In an example, the complexity of the tactile feedback may be dependent on a number of the actuators correlating a larger number of the actuators to a capability for an increased complexity of the tactile feedback. The interactive wall may be enabled to simulate a scroll wheel, buttons, clicks, swipes, multi-touch gestures, etc.
The systems and implementations of providing infrastructural haptics on wall scale interactive displays discussed above are for illustration purposes and do not constitute a limitation on embodiments. A touch dependent tactile feedback wall scale display may be implemented employing other modules, processes, and configurations using the principles discussed herein.
As discussed above, an interactive wall may provide tactile feedback depending on detected touch sensory input. Request for a tactile feedback may be transmitted from the interactive wall 511. After receiving the tactile feedback corresponding to the touch, the interactive wall may play the tactile feedback in real time. Time frame between detection of touch and play of the feedback may be under a user perception to detect a delay such as under 0.1 seconds.
Interactive wall 511 may access the control service executed on remote server(s) (e.g. one of servers 514) as discussed previously. The server s) may retrieve or store relevant data from/to data store(s) 519 directly or through database server 518.
Network(s) 510 may comprise any topology of servers, clients, Internet service providers, and communication media. A system according to embodiments may have a static or dynamic topology. Network(s) 510 may include secure networks such as an enterprise network, an unsecure network such as a wireless open network, or the Internet. Network(s) 510 may also coordinate communication over other networks such as Public Switched Telephone Network (PSTN) or cellular networks. Furthermore, network(s) 510 may include short range wireless networks such as Bluetooth or similar ones. Network(s) 510 provide communication between the nodes described herein. By way of example, and not limitation, network(s) 510 ay include wireless media such as acoustic, RF, infrared and other wireless media.
Many other configurations of computing devices, applications, data sources, and data distribution systems may be provided for infrastructural haptics on wall scale interactive displays. Furthermore, the networked environments discussed in
Sensor module 622 may be part of an interactive wall detecting sequence, location, and pressure level on the interactive wall surface. Actuator module 624 may play a tactile feedback on the interactive wall. The interactive wall may detect touch and play a corresponding tactile feedback according to the displayed contents. This basic configuration is illustrated in
Computing device 600 may have additional features or functionality. For example, the computing device 600 may also include additional data storage devices (removable and/or non-removable) such as, far example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in
Computing device 600 may also contain communication connections 616 that allow the device to communicate with other devices 618, such as over a wireless network in a distributed computing environment, a satellite link a cellular link, and comparable mechanisms. Other devices 618 ay include computer device(s) that execute communication applications, storage servers, and comparable devices. Communication connection(s) 616 is one example of communication media. Communication media can include therein computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.
Example embodiments also include methods. These methods can be implemented in any number of ways, including the structures described in this document. One such way is by machine operations, of devices of the type described in this document.
Another optional way is for one or more of the individual operations of the methods to be performed in conjunction with one or more human operators performing some. These human operators need not be co-located with each other, but each can be only with a machine that performs a portion of the program.
Process 700 may begin by detecting a touch on a wall surface through sensors of an interactive wall at operation 710. At operation 720, one or more tactile feedbacks corresponding to the detected touch may be determined. This may be accomplished, for example, by retrieving the corresponding tactile feedbacks from a look-up table, employing a database query, employing a dynamic algorithm, and comparable methods. At operation 730, the interactive wall may play the tactile feedback through actuators installed on the interactive wall (e.g., array of actuators installed in an equidistant grid pattern on bars fixed to the interactive wall studs).
Some embodiments may be implemented in a computing device that includes a communication module, a memory, and a processor, where the processor executes a method as described above or comparable ones in conjunction with instructions stored in the memory. Other embodiments ma be implemented as a computer readable storage medium with instructions stored thereon for executing a method as described above or similar ones.
The operations included in process 700 are for illustration purposes. Infrastructural haptics on wall scale interactive displays according to embodiments may be implemented by similar processes with fewer or additional steps, as well as in different order of operations using the principles described herein.
The above specification, examples and data provide a complete description of the manufacture and use of the composition of the embodiments. Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims and embodiments.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13165270 | Jun 2011 | US |
| Child | 14475425 | US |
