Embodiments of the invention are in the field of data processing systems and display interfaces. More particularly, embodiments of the invention relate to methods and systems using a rotatable three-dimensional object providing visual user information on a display.
Control interfaces on display devices typically display numerous objects which can clutter a display for a user of a computing device such as desktop computer, laptop computer, tablet, mobile phone, and etc. Such displayed objects can provide limited user information. For example, objects such as icons (e.g., an activity icon) are provided on a display to identify an application for a user to touch or select. The user can touch the display where the icon is located to launch the application. For existing control interfaces, icons or objects are simply used to launch applications without providing any additional user information.
Methods and systems are disclosed using a rotatable three-dimensional object providing visual user information on a display. For one example, a data processing system includes a display, a memory, and a processor. The memory stores one or more types of information related to a user. The processor is coupled to the display and memory, and is configured to generate a rotatable three-dimensional object visually representing one or more types of user information on the display. For one example, the display can be a coast-to-coast display for an electric or non-electric vehicle. The coast-to-coast display can include a plurality of display areas and the rotatable three-dimensional object is displayed in at least one of the display areas.
For one example, the rotatable three-dimensional object can be a polyhedron including a plurality of faces wherein each type of user information corresponds to a face of the polyhedron. Each face of the polyhedron can correspond to a type of user information includes a plurality of dots connected by lines defining the face. Each dot of each face that corresponds to a type of user information represents a data point or a parameter of the corresponding type of user information. For one example, each dot of each face that corresponds to a type of user information can be weighted that distorts the polyhedron. The polyhedron can be randomly distorted based on the weight for each dot. For one example, the processor is configured to distort the polyhedron if data points or parameters are updated or changed for each type of user information.
For one example, the data processing system also includes a hand movement capturing device that is coupled to the processor and captures hand gestures of the user. The processor is configured to rotate the polyhedron on the display based on the captured hand gestures of the user. For one example, the processor is configured to select one of the faces of the polyhedron that corresponds to a type of user information based on the captured hand gestures. For one example, the types of information can include at least entertainment, health, or activity type of user information.
Other methods and systems for using rotatable three-dimensional object providing types of user information are described.
The appended drawings illustrate examples and are, therefore, exemplary embodiments and not considered to be limiting in scope.
Embodiments and examples are disclosed using a rotatable three-dimensional object providing visual user information on a display.
For one example, a data processing system includes a display, a memory, and a processor. The memory stores one or more types of information related to a user. The processor is coupled to the display and memory, and is configured to generate a rotatable three-dimensional object visually representing one or more types of user information on the display. For one example, the display can be a coast-to-coast display for an electric or non-electric vehicle. The coast-to-coast display can include a plurality of display areas and the rotatable three-dimensional object is displayed in at least one of the display areas.
The rotatable three-dimensional object can be a polyhedron including a plurality of faces wherein each type of user information corresponds to a face of the polyhedron. Each face of the polyhedron can correspond to a type of user information and includes a plurality of dots connected by lines defining the face. Each dot of each face that corresponds to a type of user information represents a data point or a parameter of the corresponding type of user information. By using a rotatable three-dimensional object such as a rotatable polyhedron, the disclosed examples and embodiments provide improvements to display interfaces by minimizing cluttering of a display with objects that can provide more user information using faces, dots and lines of the polyhedron.
As set forth herein, various embodiments, examples and aspects will be described with reference to details discussed below, and the accompanying drawings will illustrate various embodiments and examples. The following description and drawings are illustrative and are not to be construed as limiting. Numerous specific details are described to provide a thorough understanding of various embodiments and examples. However, in certain instances, well-known or conventional details are not described in order to provide a concise discussion of the embodiments and examples. Although the following examples and embodiments are directed to an environment for an automobile, the rotating three-dimensional objects such a rotating polyhedron providing user information by way of polygonal faces, dots, or lines can be used in any display interface environments.
Exemplary Environment Using Rotatable Three-Dimensional Object
For one example, user identification device 177 is located and positioned above automobile dashboard 137 having one or cameras (e.g., a stereo camera) used to detect and identify a driver (e.g., identified driver 171 “Tim” or identified passenger 181 “Jenny”). Although not shown, environment 100 can include additional cameras located inside or outside of the vehicle or automobile to provide rearview and side view images in place of using rearview and side view mirrors which can be displayed on coast-to-coast display 102. User identification device 177 can be mounted in a location where a rearview mirror would be located in an automobile. For one example, user identification device 177 can capture images of a user (e.g., two-dimensional 2D or three-dimensional 3D images including facial features using 2D or 3D cameras). The captured images can be compared to stored images which have been registered for the automobile in order to recognize and authenticate a user (e.g., a driver or passenger) as a valid user and allow access to the automobile including controls and interfaces on coast-to-coast display 102.
For one example, gesture control device 127 is located and positioned below automobile dashboard 137 having one or more cameras (e.g., a time of flight TOF camera) and motion sensors to detect hand gestures and movement of user hand 107. For example, user hand 107 can represent a hand of a driver or a passenger (e.g., who have been properly recognized as a valid user) and gesture control device 127 can capture user gestures (e.g., gestures of user hand 107) in controlling or accessing functions, applications, information, options, icons, or objects provided on coast-to-coast display 102. For one example, gesture control/user identification device 127 can include hardware and software from Intel Realsense.®
For one example, driver tablet 110 is a tablet computer and can provide a touch screen with haptic feedback and controls. Driver tablet 110 can provide primary vehicle function controls for a driver or user such as climate control and various settings for environment 100. Driver tablet 110 or a computer within dashboard 137 can be coupled to user identification 177 and gesture control device 127 to recognize a driver (e.g., Tim) or a passenger (e.g., Jenny) and allow the driver or passenger to use gesture control device 127 and access coast-to-coast display 102. For one example, driver tablet 110 (or a computer within dashboard 137) can provide any number of representations, objects, icons, or buttons on its touchscreen providing functions, navigation user interface, phone control user interface to answer phone calls via a Bluetooth connection with mobile phone 133 or receive data and information from a wearable device such as smart watch 113, e.g., activity information such as heartbeats or number of steps climbed.
Coast-to-coast display 102 can include a light emitting diode (LED) display, liquid crystal display (LCD), organic light emitting diode (OLED), or quantum dot display, which can run from one side to the other side of automobile dashboard 137. For one example, coast-to-display 102 can be a rectangular or curved display integrated into and spans the width of automobile dashboard 137. Although not shown, dashboard 137 can include one or more automobile computers to implement interfaces and applications for coast-to-coast display 102 and other automobile controls. Coast-to-coast display 102 can provide one or more graphical user interfaces can be provided in a plurality of display areas such as display areas 1 (104), 2 (106), and 3 (108) of coast-to-coast display 102. Such graphical user interfaces can include status menus shown in, e.g., display areas 1 (104) and 3 (108).
For one example, coast-to-coast display 102 includes a plurality of display areas such as display areas 1 (104), 2 (106), and 3 (108). Display area 1 (104) can show rearview or side view images of the vehicle or automobile from one or more cameras which can be located outside or inside of the automobile in order to capture rear view of side view images. For one example, display area 2 (106) provides and displays a rotatable three-dimensional object such as rotating polyhedron 127 having polygonal faces defined by dots and lines. Alternatively, display area 3 (108) can display rotating polyhedron 127. Rotating polyhedron 127 can appear in display area 2 (106) as floating in space and can rotate at a constant or variable speed.
For one example, rotating polyhedron 127 can provide a group of information using one or more faces, dots, and lines which can provide a tangible form of various parameters and types of user information. For example, any number of drivers or users can be identified, recognize, and authenticated as a valid user with user identification device 177 having corresponding user information and applications associated with a valid user. Examples of types or groups of information associated with the driver or user can include user information and application such as “MyEntertainment”, “MyActivities”, and “MyHealth” with a corresponding face on rotating polyhedron 117 as shown in display area 2 (106). The dots or lines and number of dots and lines defining polygonal faces on rotating polyhedron 117 can also represent various parameters related to user information such as “MyEntertainment”, “MyActivities”, and “MyHealth.” For example, the number of dots defining the polygonal face for MyHealth can indicate the number of categories of health information.
For one example, a driver or user hand 107 can rotate polyhedron 127 along any axis using hand gestures captured by gesture control device 127 to select a user information or application by moving a desired face of the polyhedron 127 to the foreground, e.g., the foreground of display area 2 (106). Referring to
In order to avoid clutter on coast-to-coast display 102, a limited number of types or categories of user information can be displayed on rotating polyhedron 127 such as MyEntertainment, MyActivities, and MyHealth. That is, in environment 100, showing, e.g., 50 applications on coast-to-coast display 102 is not safe or practical. When in a driving environment, reducing information shown to a driver or user is preferred on automobile dashboard 137. In accessing user information on rotating polyhedron 117, a user hand 107 can control object control 122 to cover a polygonal face of rotating polyhedron 117 corresponding to, e.g., MyEntertainment.
Referring to
Referring to “MyEntertainment” example, when a user watches a movie a data point can be generated in the “MyEntertainment” face of rotating polyhedron 127. Referring to “MyActivities” example, a data point can be generated for a missed cell phone call. Data points can also be generated indicating unread text messages. For “MyHealth” example, some dots on rotating polyhedron 117 can be preconfigured such as indicating user weight. In other examples, a driver or user by way of driver table 110 can add dots, e.g., dots indicating blood pressure or dots keeping track of steps for health purposes. The added dots can alter the polygonal face for “MyHealth” on rotating polyhedron 117. Each driver or user can have a user account which can generate a minimum number of baseline dots in rendering rotating polyhedron 117 on coast-to-coast display 102. The driver or user can also add dots on specific types of information to tack, e.g., missed calls.
Categories, associated information and parameters can be generated or inputted by a user with driver tablet 110 or downloaded or entered using, e.g., mobile phone 133 or smart watch 113 (or any other mobile computing device) to driver tablet 110 which controls and provides information to coast-to-coast display 102. For one example, a user or driver is authenticated or identified before information and parameters can be generated or inputted for rotating polyhedron 117, which can be stored in one or more memories or databases stored in or coupled with driver tablet 110. For each user or driver, a personalized rotating polyhedron 117 can be provided and associated with respective personal information and parameters, e.g., heartbeats, heart rate, etc. For example, each user of driver can generate data points or can be automatically generated which can alter the shape of rotating polyhedron 117. The examples and embodiments for using rotating polyhedron 117 can be used any display interface environment such as a display interface for desktops, laptops, tablets, netbooks, mobile phones and devices in reducing clutter on a display.
Referring to
For one example, faces of rotating polyhedron 217 can also change color or blink to indicate new information or information or parameters generated related to, e.g., MyEntertainment 204, MyActivities 205, and MyHealth 206. A red color, e.g., for MyActivities 205, can indicate a new scheduled meeting request. For other examples, environment 100 can learn what is interesting to a driver or user and make recommendations as to activities by using a suggestion engine, e.g., as shown in display area 3 (208)—“Suggested by Byton.” For example, MyActivities 204 can include data points indicating car washes. By tracking this information, environment 100 can suggest to a user when to have a car wash and where is the nearest car wash.
Exemplary Data Processing and Computing System Architecture
For one example, real-time operating system 310 can be a Unix® based operating system which can provide cloud connection via security/online services 314 and virtual device communication via virtual device(s) environment 306. Security/online services 314 can include a smart antenna and provide a secure gateway to external cloud services requiring user authentication using high speed wireless communication such as Long-Term Evolution (LTE) standard. Bluetooth® communication can also be provided by security/online services 314 for data processing system architecture 300. Virtual devices(s) environment 306 can include, e.g., Android® based environment of devices and virtual machines which can communicate with data processing system architecture 300.
Human machine interface (HMI) middleware 302 can include software to provide graphical user interfaces and controls or a driver or user of environment 100 and driver tablet 110 or a computing system (or computer) within dashboard 137. For one example, HMI middleware 302 can include the Unity® or Softkinetics® software configured for providing user interfaces and controls to coast-to-coast displays 102, 202 and rotating polyhedrons 117, 217 of
Referring to
Examples of I/O devices 420 include mice, keyboards, printers and other like devices controlled by I/O controller 418. Network interface 417 can include modems, wired and wireless transceivers and communicate using any type of networking protocol including wired or wireless WAN and LAN protocols including LTE and Bluetooth standards. Memory 410 can be any type of memory including random access memory (RAM), dynamic random-access memory (DRAM), which requires power continually in order to refresh or maintain the data in the memory. Non-volatile storage 406 can be a mass storage device including a magnetic hard drive or a magnetic optical drive or an optical drive or a digital video disc (DVD) RAM or a flash memory or other types of memory systems, which maintain data (e.g. large amounts of data) even after power is removed from the system.
Memory devices 410 or Database 412 can be used by tablet 110 and processors 402 to store user information and parameters. For example, memory devices 410 or database 412 can store user information or parameters related to, e.g., MyHealth, MyActivities, or MyEntertainment types of user information. Although memory devices 410 and database 412 are shown coupled to system bus 201, processor(s) 402 can be coupled to any number of external memory devices or databases locally or remotely by way of network interface 417. For one example, processor(s) 402 can implement techniques and operations described in
Examples and embodiments disclosed herein can be embodied in a data processing system architecture, data processing system or computing system, or a computer-readable medium or computer program product. Aspects, features, and details of the disclosed examples and embodiments can take the hardware or software or a combination of both, which can be referred to as a system or engine. The disclosed examples and embodiments can also be embodied in the form of a computer program product including one or more computer readable mediums having computer readable code which can be executed by one or more processors (e.g., processor(s) 402) to implement the techniques and operations disclosed in
Exemplary Rotating Three-Dimensional Objects and Polyhedrons
Referring to
For one example, in generating polyhedron 517, the shape of the initial mesh or wireframe can become distorted as new dots and lines are generated based on generated or updated user information. Polyhedron 517 can morph into various meshes or wireframes randomly using any type of random generator or noise modifier to distort the mesh or wireframe defining polyhedron 517 to provide a depth of field for polyhedron 517 when shown on coast-to-coast display 102, 202. For one example, HMI middleware 302 can include a plug-in that can perform distortion and depth of field generation for rotating polyhedrons such as polyhedrons 117, 217, and 517 in real-time as user information is generated, updated, or added.
For one example, MyEntertainment 504 is highlighted to indicate that it is type of user information selected by a user and highlighted on a coast-to-coast display 102, 202. MyCommunity 506, MyActivities 502, and MyHealth 503 can be blurred to indicate that are types of user information not selected by a user. The faces for MyCommunity 506, MyActivities 502, and MyHealth 503 can also be un-highlighted to indicate they are not selected by a user. Each of the types of information for rotating polyhedron 517 have three dots and lines for MyCommunity 506, MyActivities 502, MyHealth 503, and MyEntertainment 504. Each point in rotating polyhedron 517 can indicate user information or parameter, e.g., a scheduled event for MyActivities 502 or a movie for MyEntertainment 504.
For other examples, information or parameters associated with each dot can visually affect properties such as opacity of lines connecting dots, distance of the lines and lines, color or shade of the lines and faces of rotating polyhedron 517. For example, the dot at the right point of the face for MyEntertainment 504 on rotating polyhedron 517 can represent a movie that was last seen later than the movies represented by the dots on the left side of the face for MyEntertainment 504 which are closer together indicating that those moves were seen most recently. For example, the two dots on the left of MyActivities 502 can represent two scheduled meetings that are upcoming and the dot to the right can represent a scheduled meeting later in time than the two upcoming meetings. That is, dots closer together can represent meetings sooner in time.
Referring to
MyActivities 502 can include user information and applications related to, e.g., shopping, planning events dates, suggestions based on location of the automobile. MyPrivacy 503 can include options and controls to have certain or private information locked or masked or disconnected from coast-to-coast display 102, 202, e.g., disconnecting or hiding user information and applications. MyEntertainment 504 can include user information and applications related to, e.g., music, audiobooks, movies, games, news, etc. MySupport 505 can include user information and applications related to, e.g., concierge services, online payments and services, smart home connections, delivery drop-box, etc. MyCommunity 506 can include user information and applications related to, e.g., user contacts and phone numbers, emails addresses, etc. MyOffice 507 can include user information and applications related to, e.g., office programs, integration of video conferencing, application support for meetings in automobile, etc. MyCommunication 514 can include user information and applications related to, phone calls, text messages, emails, etc.
Referring to
Referring to
Referring to
Three-dimensional object rendering engine and control 852 (engine 852) can process user information and render a rotating polyhedron as shown in
In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of disclosed examples and embodiments. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.