The present invention provides a display control apparatus that enables smooth viewpoint movement and to search an object by an intuitive operation in a space in which a plurality of information objects have different dimensions and shapes, and that realizes a proper movement direction and a proper movement speed based on geometric information of the object.
Moreover, the present invention relates to an information terminal unit provided with a display controlling apparatus and a display controlling program controlling a computer to conduct processes at the display controlling apparatus.
Japanese Laid-Open Patent Application No. 2000-172248 by the inventor of the present invention is known as a three-dimensional display controlling apparatus that provides a comfortable environment for browsing an electronic document with hypertext structure on a display unit. In this invention, an electronic document group with hypertext structure is arranged in a single virtual space based on its like structure, a display image to browse the electronic document is generated based on a view defined in the virtual space and displayed at the display unit. Moreover, in accordance with an instruction by a user, a view is consecutively changed so as to consecutively generate and display the display image at the display unit at real time based on the view at the time. Thereby, the user can browse a document by following links of hypertext so as to consecutively enlarge the document, while the user consecutively changes the view in the virtual space.
A variation example of a display screen is shown in
On the other hand, a method has already been devised in that the three-dimensional product catalog is distributed through the Internet, and the three-dimensional shape is displayed at a terminal side while the three-dimensional shape is being rotated or a like on a screen by the operation of the user. It is called a Web3D as a typical method in that the three-dimensional shape such as a product is distributed from a server on the Internet to a user terminal in a VRML (Virtual Reality Modeling Language) form or a special form, and the three-dimensional shape is displayed on the screen at the user terminal by a program for displaying such as three-dimensional shape. A display object is selected by selecting an item by using a mouse on an HTML document displayed at a general WWW browser. That is, the program is to display a single three-dimensional shape. Also, the program is realized as a plug-in of a browser. A Java™ program, or an ActiveX object.
However, in a conventional three-dimensional display controlling apparatus as described above, there are problems described below.
In the conventional three-dimensional display controlling apparatus, the single three-dimensional shape can be displayed, rotated, and partially enlarged in a window of the browser. Therefore, before the shape is displayed, it is needed to click an option by the mouse, select a menu, conduct a search condition in order to select the display object.
It is a first object of the present invention to provide a display controlling apparatus in that a viewpoint can be smoothly moved and a target object can be searched for by an intuitive operation in a space where a plurality of information objects having different dimensions and shapes.
Moreover, it is a second object of the present invention to provide an information terminal unit provided with the display controlling apparatus.
Furthermore, it is a third object of the present invention to provide a viewpoint location controlling apparatus that realizes a proper movement direction and a proper movement speed based on geometric information of the information object subject to be the viewpoint movement in the space where the plurality of information objects having different dimensions and shapes.
The first object of the present invention are achieved by a display controlling apparatus for displaying a plurality of information objects in a three-dimensional virtual space, the plurality of information objects successively linking each other and including an information object shower by a three-dimensional shape, the display controlling apparatus including: a view determining part determining a view to display as if tracing a surface of a shape based on the shape of the information object to observe by corresponding to a view movement instruction input by a user; and a display image generating part generating display images of the plurality of information objects linked each other based on the view determined by the view determining part, wherein the display images are displayed at a display unit so as to display the information objects corresponding to the view movement instruction.
In such the display controlling apparatus, display images representing the plurality of information objects linked each other is generated based on the view determined based on the shape of the information object observed by a user and is displayed at the display unit.
Accordingly, since a different view can be determined for each shape of the information objects, it is possible to display the display images in a three-dimensional virtual space by corresponding to the view movement input by the user as if the view traces on the surface of the information object.
The above-described information object may be an information object shown in the three-dimensional virtual space on the display unit by an electronic document having a hypertext structure provided through the Internet.
From an aspect in that the information object to observe can be switched to another information object based on the movement direction, the present invention can be arranged to include a link information managing part managing a relative location relationship and a relative scale ratio of each of the information objects in the three-dimensional virtual space as link information, wherein while the view determining part switches the information object to observe to the information object arranged in a movement direction indicated by the view management instruction based on the link information, the view determining part determines the view based on the shape of the switched information object, and the display image generating part select the information object to display from the plurality of the information objects linked each other based on the location relationship and the scale ratio and generates the display images.
In such the display controlling apparatus, the information object to observe is switched to another information object arranged in a movement direction based on the link information, and also the information objects to display are selected based on the location relationship and the scale ratio of the link information.
Accordingly, it is possible to automatically select the information object to be observed and other information objects to display based on a location relationship of the link information and the scale ratio in response to the movement direction such as a upward, downward, rightward, leftward, zoom-in, or zoom-out direction. Therefore, in response to the view movement, it is possible to smoothly display the information objects with successively tracing the information objects that are successively linked each other.
From another aspect in that the view movement can be conducted based on shapes of the information objects having different dimensions, the present invention can be arranged so that the view determining part includes: an observation point movement path calculating part calculating a movement path of an observation point based on a three-dimensional shape of the information object; and a view movement calculating part calculating the view movement based on the shape of the information object, wherein when the information object to observe is the three-dimensional shape, the view movement calculating part calculates the view movement based on a calculation result by the observation point movement path calculating part.
In such the display controlling apparatus, when the information object to be observed is a three-dimensional shape, the view movement is calculated based on a calculation result of the movement of the observation point. Therefore, it is possible to conduct the view movement based on each shape of the information objects having different dimensions. Also, it is possible to calculate the movement path of the observation point as if a curved surface is traced.
Moreover, the first object of the present invention can be achieved by a display controlling program for causing a computer to display the plurality of information objects in the three-dimensional virtual space, and also by a computer-readable recording medium with program code for causing a computer to display the plurality of information objects in the three-dimensional virtual space.
The second object of the present invention are achieved by an information terminal unit provided with the display controlling apparatus as claimed in any one of claims 1 through 4, including an instruction receiving part receiving a view movement instruction in the three-dimensional virtual space by an operation of a user in a view movement direction.
In such the information terminal unit, it is possible to display the information objects in the three-dimensional virtual space at real time based on the view movement instruction according to an operation directing the view movement by the user.
The second object of the present invention are achieved by a viewpoint location controlling apparatus for controlling a viewpoint location with respect to the plurality of the information objects having shapes displayed in a three-dimensional virtual space, the viewpoint location controlling apparatus including: a reference determining part determining the information object to display at a nearest location from the viewpoint location in accordance with an input by a user; and a speed changing part changing a movement speed of the view by corresponding to a length of a distance from the determined reference object to the viewpoint location, wherein based on the reference information object, the viewpoint location is controlled so as to move the viewpoint at the movement speed corresponding to the distance to the viewpoint location, and the plurality of the information objects are displayed.
In such the viewpoint location controlling apparatus, since the information object at the closest location to the viewpoint location is determined as the reference information object, it is possible to determine the information object that is subject for the viewpoint to observe. Also, the viewpoint location is controlled by the speed changing part so that the viewpoint is moved at the movement speed corresponding to the distance to the viewpoint location. Accordingly, when the viewpoint location is approaching near the information object, the viewpoint is slowly moved. On the other hand, when the viewpoint is far from the information object, it is possible to display the plurality of information objects so that the viewpoint is quickly moved.
Moreover, the third object of the present invention can be achieved by a viewpoint location controlling program for causing a computer to control a viewpoint location with respect to the plurality of the information objects in the three-dimensional virtual space, and also by a computer-readable recording medium with program code for causing a computer to control a viewpoint location with respect to the plurality of the information objects in the three-dimensional virtual space.
In the following, embodiments according to the present invention will be described with reference to the drawings.
Referring to
The information object data obtaining part 101 obtains information object data from Web information obtained through a network 118, such as the Internet, by the communication controlling part 110, and stores the obtained information object data in the information object data storing part 102. Moreover, as link information that defines a correlation between information objects, a relative position relationship and a scale ratio within a virtual space are stored.
The user instruction receiving part 103 receives data showing a view movement direction indicated by a user.
Based on the data showing the view movement direction received by the user instruction receiving part 103, in response to a shape of the information object that is to be processed and is stored in the information object data storing part 102, the view determining part 104 determines a view by using a calculation result of the view movement calculating part 107 and the observation point movement path calculating part 109.
Based on view data determined by the view determining part 104, the display image generating part 105 generates all display images of the information objects displayed in a range of the view in response to the shape of each information object.
The display controlling part 106 controls a display unit in order to display the display image generated by the display image generating part 105. That is, the display controlling part 106 generates the display image data on which an information object is displayed, based on the view data by using information object displaying part 108 corresponding to the shape of each information object.
The view movement calculating part 107 calculates a view movement amount including a movement distance, an angle change, and movement direction information, corresponding to the shape of an information object. However, when the shape of the information object is a spherical surface or a free form surface, after the movement path of the observation point is calculated by the observation point movement path calculating part 109 according to the shape of an information object, the view movement amount is calculated.
By providing the plurality of the view movement calculating parts 107 and the information object displaying parts 108, the view movement and information object suitable for each of the information object of various aspects such as a planar information object, solid information object, and a like can be displayed.
The communication controlling part 110 controls a connection and disconnection to the network 118, and controls to send and receive data.
For example, the installer 111 installs a program for executing processes conducted by each processing part described above that control the display controlling apparatus 100, from a CD-ROM 119 that is a computer-readable storage medium.
The installed program is executed by a CPU (Central Processing Unit) of the display controlling apparatus 100 and realizes each processing part described above. A medium storing the program is not limited to the CD-ROM 119 but any computer-readable medium can be used.
If necessary, in order to correspond to various shapes of the information objects, the view movement calculating part 107 and the information object displaying part 108 may be obtained from the network 118, the CD-ROM 119, or a like, and be used by the determining part 104 and the display image generating part 105.
The viewpoint movement with respect to the information object will be described with reference to
In
The viewpoint movement path 411 shows movement paths of the viewpoint accompanying a zoom-in operation and a zoom-out operation. The viewpoint movement path 412 shows movement paths of the viewpoint accompanying a right movement operation and a left movement operation. The viewpoint movement path 413 shows movement paths of the viewpoint accompanying an upward movement operation and a downward movement operation. The viewpoint movement path 414 shows movement paths of the viewpoint accompanying tilt operations. The viewpoint movement path 415 shows movement paths of the viewpoint accompanying rotation operations. Moreover, dashed line arrows in
When the zoom-in operation is conducted, the viewpoint infinitely approaches the observation point 403 on the target surface 401 along the movement path 411. Moreover, when the zoom-out operation is conducted, the viewpoint moves so as to distance far from the target surface along the movement path 411. In these zooming operations, a movement speed of the viewpoint changes in proportion to the distance between the viewpoint and the target surface. Accordingly, it seems that the viewpoint is infinitely approaching the observation point on the target surface, so as to realize a zoomed display.
When the view movement operation is conducted to right and left, and up and down, the viewpoint moves along routs shown in the viewpoint movement paths 412 and 413, respectively. At this time, the observation point 403 moves on the target surface.
Referring to
On the other hand, referring to
Referring to
Moreover, when the rotation operation for the view is conducted, the viewpoint location 402 is moved along the viewpoint movement path 415. That is, in the rotation operation, the display controlling apparatus 100 maintains a location of the observation point 403, and the distance and the tilt angle from the observation point 403 to the viewpoint location 402 to be constant, and the display controlling apparatus 100 moves the view so as to rotate centering on a perpendicular to the target surface in the observation point 403.
In order to make a process possible even if the display object has an information object shape having a spherical surface other than a flat surface as described above, it is necessary to allocate a proper shape of the target surface beforehand. It is not necessary that the target surface shape always corresponds to the information object shape. For example, the target surface being spherical can be allocated to the information object being near globular but irregular.
In the following, a process for each different target surface will be described with reference to
In
And Vx, Vy, and Vz denote vectors representing x axis, y axis, and z axis, respectively, of the viewpoint coordinate system. V0 is a location of the viewpoint, that is, V0 denotes an origin of the viewpoint coordinate system. And the observation point on the target surface is denoted by T. A straight line connecting the viewpoint V0 and the observation point T is called the visual line, and the view is defined so that the visual line becomes a centerline of the view. That is, the view is defined so that the observation point comes to a center of the screen.
Moreover, the direction of the view is defined so that the vector Vx corresponds to a screen horizontal right direction and the vector Vy corresponds to screen perpendicular down direction. The movement directions of the observation point corresponding to the view movement instruction by the user, which indicates right and left and up and down, respectively, are shown by lines Cu and Cv with arrows. A direction of Cu is defined as a direction based on the target surface shape of the line of intersection of an xz plane and the target surface of the viewpoint coordinate system. A direction of Cv is defined as a direction based on the target surface shape of the line of intersection of a yz plane and the target surface of the viewpoint coordinate system.
Moreover, in the view movement to up and down or right and left, in order not to change the tilt angle and a rotation angle of the view over the target surface, the observation point is moved along the target surface.
In an example of the target surface 421 being plane as shown in
The example of the target surface 422 being spherical as shown in
First, a process for moving the view to up, down, right, and left in a case in which the target surface is a plane will be described.
Referring to
When it is determined that the input instruction of the user is not the movement instruction to move the view upward, downward, leftward, and rightward, the user instruction receiving part 103 executes a step S103, and conducts a process corresponding to the input instruction of the user (step S103). The process goes back to the step s101 and waits for a next input instruction of the user.
On the other hand, when the user instruction receiving part 103 decides that the input instruction of the user is the movement instruction to move the view upward, downward, leftward, and rightward, the user instruction receiving part 103 activates the view determining part 104, and executes a step S104. In the step S104, the movement direction vector t of the observation point T is obtained.
For example, when the user instructs to move the view rightward, the view determining part 104 activated by the user instruction receiving part 103 obtains a direction vector of the line of intersection of the xy plane of the viewpoint coordinate system and the target surface in the observation point T, and determines the direction vector as the movement direction vector t. It should be noted that a positive direction is chosen for the movement direction vector T so as not to be an obtuse angle between the movement direction vector T and the vector Vx.
In a step S105, a movement distance d of the observation point T is calculated. That is, the view determining part 104 calculates the movement distance d by giving the obtained the movement direction vector t to the view movement calculating part 107. The view movement calculating part 107 calculates the movement distance d of the observation point T from the movement direction vector t given from the view determining part 104 based on data of the information object of the plane, which is obtained from the information object data storing part 102 and currently displayed on the display unit.
In a step S106, the view determining part 104 moves the view toward the vector t in parallel by the distance d calculated by the view movement calculating part 107.
In a step S107, the display image generating part 105 generates a drawing based on view data that are obtained from the view determining part 104 and moved in parallel. The display controlling part 106 displays the drawing corresponding to a new view on the display unit based on drawing data generated by the display image generating part 105.
In a step S108, it is determined whether or not it is an end of the process. When it is determined that it is the end of the process, the process is terminated. On the other hand, when it is determined that it is not the end of the process, the process goes back to the step S101 and receives a next input instruction by the user.
Next, a process for the view movement upward, downward, rightward, or leftward in a case in which the target surface is a curved surface will be described. When the target surface is a curved surface shown in
Referring
When it is determined that the input instruction of the user is not the movement instruction of the view upward, downward, rightward, or leftward, the user instruction receiving part 103 executes the step S103, conducts a process corresponding to the input instruction of the user (step S123), and goes back to the step S121 to waits for the next input instruction of the user.
On the other hand, when it is determined that the input instruction of the user is the movement instruction of the view upward, downward, rightward, or leftward, the user instruction receiving part 103 activates the view determining part 104, and executes a step S124. In the step S124, the user instruction receiving part 103 obtains for the tangent vector t of the movement direction of a current observation point T at the location of a current observation point T.
For example, when the instruction is made to move the view rightward, the view determining part 104 activated by the user instruction receiving part 103 obtains a tangent direction vector being a line of the intersection of the xy plane of the viewpoint coordinate system and the target surface at the observation point T, and sets the tangent direction vector as the movement direction vector t. It should be noted that the movement direction vector t is selected to be a positive direction so as not to be the obtuse angle with respect to the vector Vx.
In the step S125, the movement distance d of the observation point T is calculated. That is, the view determining part 104 calculates the movement distance d by giving the movement direction vector t obtained in the step S124 to the view movement calculating part 107. The view movement calculating part 107 calculates the movement distance of an observation point according to the distance of the viewpoint V0 and the observation point T based on data of the information object having the curved surface, which is obtained from the information object data storing part 102 and is currently displayed on the display unit.
In the step S126, furthermore, the view determining part 104 searches for a point which moves only by the distance d in the positive direction t along the target surface from the current observation point T as a new observation point T by using the observation point movement path calculating part 109, which is prepared corresponding to a type of the curved surface, based on data of the information object having the curved surface, which is obtained from the information object data storing part 102 and is currently displayed on the display unit.
In a step S127, the view determining part 104 searches for a view corresponding to a new observation point by using the view movement calculating part 107 so that the tilt angle and the rotation angle in a current view are stored.
In this method, for example, a location of the viewpoint V0 and a direction of the Vector Vz are determined so that the visual line crosses the observation point newly obtained while maintaining the distance from the view to the observation point, the tilt angle, and the rotation angle. Then, the directions of Vectors Vx and Vy are determined so as that the xy plane determined by the vectors Vx and Vy includes a tangent of the vector Cu in the new observation point T.
In a step S128, the display image generating part 105 generates drawing data based on the view data corresponding to the curved surface shape obtained from the view determining part 104. The display controlling part 106 displays a drawing corresponding to the new view on the display unit based on the drawing data generated by the display image generating part 105.
In a step S129, it is determined whether or not it is an end of the process. When it is determined that it is the end of the process, the process goes back to the step S121 to receive a next input instruction of the user.
In the above-described embodiment, the observation point movement path calculating part 109 along the target surface prepared for each shape type of each target surface may be provided. And the view determining part 104 may select the movement path calculating part corresponding to the type of corresponding target surface, based on the information object that is obtained from the information object data storing part 102 and becomes as a reference of the view movement displayed at the display unit.
Next, for example, an example of an operation realized by the above-described processes in a case in which the information objects successively linking each other and having different shapes as shown in
Referring to
In the information objects successively linking each other, for example, the information object of the link destination in each link is arranged on a smaller scale than that of the information object of the link source near the surface of the information object of the link source.
That is, the information objects A 202, B 203, and C 204 being plane as the information object of the link destination are arranged on a small scale near the surface of the information object S 201 having the spherical surface as the information object of the link source. Furthermore, the information object X 205 being cubic and the information object Y 206 being cubic as a link destination information object are arranged on a small scale near the surface of the information object A 202 being plane as the information object of the link source.
In definition of the information object of the link destination with respect to the information object of the link source, the local coordinate system is defined for each of the information objects. Then, the local coordinate system can be defined by defining the transformation matrix between those coordinate systems.
For example, regarding the information object S 201 having a spherical surface shape, a local coordinate system which center is an origin is defined. Regarding information object A 202 having the plane shape, which is linked from the information object S 201, a local coordinate system which center is an origin and the plane shape corresponds to the xy plane is defined. In contrast with the former local coordinate system, as for the origin of the latter local coordinate system, the origin comes near the sphere surface and a direction of the z axis is arranged so as to point the origin of the latter local coordinate system. This definition is defined by the transformation matrix between both coordinate systems.
Next, screen changes by the view movement for the information object successively linked as shown in
In
In a state of the screen 21, when a movement to a front direction of the view is conducted by the view movement operation of the user, that is, the zoom-in operation is conducted, the information objects A 202, B 203, and C 204 having a plane shape and defined to link from the information object S 201, appear gradually while the information object S 201 displayed on the screen 22 becomes gradually larger as shown in a screen 22.
When the view movement operation is conducted to further move to the front direction of the view, the information objects A 202, B 203, and C 204 are clearly displayed as shown in a screen 23. As described above, in a sequence of information objects successively connected with links, the information objects to be displayed at a screen are automatically selected and displayed based on a location relationship between the view and each of the information objects. In addition, in a case in which the view approaches the information object gradually, the information object that has not been visible becomes opaque gradually, and appears on the screen.
Subsequently, when the view movement operation is conducted to move the view leftward, the information objects A 202, B 203, and C 204 move rightward so as to turn to a backside of the information object S 201 having the spherical surface. As shown in a screen 24, the information object C 204 turns and hides itself behind the information object S 201 having the spherical surface. Furthermore, by successively moving the view leftward, similarly, the information object B 203 turns behind the information object S 201 having the spherical surface, and then the information object A 202 is displayed at a front on the information object S 201 as shown in a screen 25. In this case, by the view movement operation to move the view leftward, the view is moved so as to turn beside the information object S 201 along a path such as a view movement path 412 shown in
In the screen 25, the information object A 202 becomes visible at the front. When the zoom-in operation is conducted from this state, as shown in the screen 26, the information object A 202 is displayed larger, and the information object X 205 and the information object Y 206 linked from the information object A 202 appear. In addition, the information object to be the observation subject is switched from the information object S 201 to the information object A 202. Thereby, the view movement method shown in
Subsequently, when the view movement operation is conducted to move the view leftward or downward, the viewpoint moves to the viewpoint movement path 412 and 413 shown in
And simultaneously, the information object as the observation subject moves from the information object A 202 to the information object X 205. By switching the information object A 202 to the information object X, the view movement process shown in
In a screen 28, when the view movement operation is conducted to move the view leftward, the viewpoint moves to turn to a left side of the information object X 205 along the viewpoint movement path 412. Then, the information object X 205 is displayed as shown in a screen 29.
For example, an information terminal unit provided with the display controlling apparatus 100 realizing the above-described processes by a view movement operating device that enables a user to conduct the view movement operation can be configured as shown in
In
The screen 502 of the display unit 501 consecutively changes with the view movement by the user operating the remote controller 503.
For example, the remote controller 503 that conducts the view movement operation is configured as shown in
Referring to
In the example shown in
Moreover, by pressing an Up button to indicate upward and a Down button to indicate downward of the view movement buttons 523, the processes with respect to the viewpoint movement path 413 shown in
Furthermore, by pressing a Zoom In button to indicate a zoom-in and a Zoom Out button to indicated a zoom-out of the view movement buttons 523, the processes with respect to the viewpoint movement path 411 shown in
Referring to
In the example shown in
Referring to
In the above-described embodiment, according to the present invention, the view movement method is automatically selected corresponding to a form and contents of the information object that is the observation subject for a current view, from a plurality of the view movement processes described above, so that it is possible to conduct the view movement process based on the user instruction. Accordingly, even if the information object being plane and the information object being solid are mixed in a single space, the user is not required to be aware of differences and the user can browse the information objects by smoothly moving the view with a common operation.
Relative location relationships and scale ratios in the virtual space are stored and managed in the information object data storing part 102, as link information that defines correlation between the information objects. The information object to observe is automatically selected by the view determining part 104. And by the display image generating part 105, the information objects to display in the view determined are automatically selected and then display images are generated. Therefore, it becomes possible to realize changes of the view in response to the view movement instruction by the user.
Moreover, based on the link information, the zoom-in and the zoom-out can be infinitely repeated while sequentially tracing the information objects successively linked together.
Therefore, the user can search for an object by intuitive operations without clicking a mouse or a like.
A program that displays data showing three-dimensional shape on a two-dimensional screen generally determines a viewpoint location, a visual line direction, a view angle, and a like in a virtual three-dimensional space where three-dimensional shape data are arranged as the information object. And the program projects and displays the information object on the two-dimensional plane based on the viewpoint location, the visual line direction, the view angle, and the like. Since this viewpoint location, the visual line direction, and the like are changed by input from the user, a user interface can be realized so that the user can browse and operate the three-dimensional information objects from various locations or directions.
Moreover, as a method for displaying data, there is a zooming method for displaying a display object by enlarging or reducing the display object in the two-dimensional plane. The zooming method is to provide a uniform user interface with respect to the entire data image and a fine structure of each part by enlarging and reducing two-dimensional data subject to display. Especially, this is an effective display interface when data subject to display has a hierarchical structure.
In the zooming method, two ways for a movement speed when a display object is moved upward, downward, rightward, and leftward. One way is to define a change amount of a screen per unit time. This way determines how much time is needed, for example, when the display object displayed at a center of the screen is moved toward a side of the screen. In a user interface using a zoom, the change amount of the screen is generally constant, regardless of a ratio of enlargement and reduction by the zoom.
Another movement speed by the zoom is a relative velocity with respect to the display object, and shows a movement amount per unit time with respect to the display object displayed on the screen. In a case in which the change amount of the screen is constant, the relative velocity becomes greater while viewing the entire image, and the relative velocity becomes smaller while viewing details. The enlargement and reduction by the zoom with respect to the two-dimensional plane are considered as movements of approaching toward and departing from the two-dimensional plane being in the three-dimensional space. In this case, the relative velocity with respect to the display object by the zoom becomes an absolute velocity in the three-dimensional space and can be shown as changed corresponding a distance between the two-dimensional plane in the three-dimensional space and the viewpoint location.
On the other hand, in the above-mentioned user interface for displaying the three-dimensional information object, the movement speed is constant at the viewpoint location in many cases. If the movement speed is constant at the viewpoint location, in a case in which the viewpoint location is located far from the three-dimensional information object and the view movement operation is conducted broadly, the movement speed is felt slower than expected. In a case in which the viewpoint location is located closer the three-dimensional information object and the view movement operation is conducted for a detailed portion, the movement speed is felt faster than expected. Thus, a problem causes so that the user cannot conduct the fine operations for the detailed portion.
Accordingly, a distance between a location where the three-dimensional information object exists and the viewpoint location is calculated, and the movement speed is changed corresponding to the distance. Therefore, it is possible to realize the movement by a proper movement speed at the viewpoint location to view and operate with respect to the entire image and the detailed portion. This is a similar method in which the two-dimensional plane is shown in a three-dimension by the zoom.
This control of the movement speed corresponding to the distance can be enough for a case in which there is only one three-dimensional information object subject to display. However, when there is a plurality of three-dimensional information objects, there are many distances as requirements for the speed control between the viewpoint location and the plurality of three-dimensional information objects. Accordingly, the movement speed of the viewpoint at a certain location cannot be uniquely determined.
In order to overcome the above-described problem, it is required to determine one movement speed based on each of distances between the viewpoint location and the plurality of three-dimensional information objects.
Thus, the nearest information object to the viewpoint location is selected from the plurality of three-dimensional information objects, and the movement speed of the viewpoint is determined by the distance between the selected three-dimensional information object and the viewpoint location. The nearest information object is set as a reference information object. The movement speed is decelerated when the viewpoint location is getting closer to the reference information object, and the movement speed is accelerated when the viewpoint location is getting farther from the reference information object. When another three-dimensional information object becomes closer to the viewpoint location than a current reference information object during the view movement, the three-dimensional information object is set as the reference information object. Then, the movement speed of the view is changed based on the distance from the viewpoint location to the three-dimensional information object. Hereinafter, information which each of the three-dimensional information objects to calculate this distance is called a “geometric model” of each three-dimension information object”. For example, if each of the three-dimensional information objects has information showing a plane as the geometric model, the distance with respect to the plane is calculated. If each of the three-dimensional information objects has information showing a spherical surface as the geometric model, first, the distance from the viewpoint location to a center of the sphere is calculated, and then, a value deducted a radius of the sphere from its result is set as the distance.
A case of the view movement approaching toward the plane and a case of the view movement approaching toward the sphere are compared. In the case of the movement approaching toward the plane, when the view is moved toward the plane in parallel, the view movement becomes a linear movement in the three-dimensional space. On the other hand, when the same linear movement is conducted to approach toward the spherical surface, the distance from the spherical surface is changed accompanying with the linear movement. In order to move along the spherical surface, a curvilinear movement is required. It is very difficult for the user to move along the spherical surface by repeating the linear movement. However, if various movement methods are provided simultaneously to the user, it becomes inconvenience for the user because an operation system becomes complicate. It may be required more in addition to the various movement methods, that is, further movement methods can be required with respect to the three-dimensional information objects. It is desired for the user to move the view by the same operation in a method corresponding the shape of the three-dimensional information object.
Accordingly, in the above-described “geometric model”, in addition to the method for calculating a distance, information concerning the movement method with respect to the operation of the user is stored. When the viewpoint location is moved, a direction to move is obtained based on the geometric model, the movement speed is determined by the distance similarly obtained based on the geometric model, and then, the viewpoint location is moved. By this process, the viewpoint movement can be realized corresponding to each shape of the three-dimensional information objects.
In the following, a method to realize a process based on the above-described “geometric model” will be described with illustrating a three-dimensional data browsing apparatus that can be realized by a three-dimensional data browsing program.
In
The controlling part 2011 is a CPU (central processing unit) of the three-dimensional data browsing apparatus 2000, and controls the entire apparatus 2000.
The input unit 2014 includes the remote controller 503 shown in
The reference information object determination processing part 2021 determines the information object used as a reference information object by comparing distances between the viewpoint location and the plurality of the information objects. Moreover, the reference information object determination processing part 2021 can determine the movement direction and the movement speed of the viewpoint upward, downward, right ward, or leftward, based on geometric model information of the determined reference information object that is managed in the information object data managing part 2116 by the information object data DB 2016.
The viewpoint distance processing part 2022 processes the distance from the viewpoint location based on the local coordinate system shown using the geometric model information for each information object that is managed in the information object data managing part 2116 by the information object data DB 2016. Thereby, the reference information object determination processing part 2021 can compare the distances from the viewpoint location to the information objects having different geometric model information, and can properly determine the reference information object.
In
In a case of approaching the viewpoint from a state in
In
In this three-dimensional data browsing apparatus 2000, data of each information object subject to display are stored in the information object data DB 2016 by the information object data managing part 2116 beforehand, or are stored in the information object data DB 2016 by obtaining through the external network 2025 connected to the three-dimensional data browsing apparatus 2000 if necessary.
For example, the information belonging to each of the information objects 2031 through 2035 includes a link structure as shown in
Referring to
In the geometric model information 2202, a direction and endpoints of a plane are recorded if the information object is the plane, and a location of a center and a radius length of a sphere are recorded if the information object is the sphere.
The geometric model information 2202 is referred to when the viewpoint is moved by operating the input unit 2014 by the user.
In
A displaying process in the three-dimensional data browsing apparatus 2000 will be described with reference to
In
Next, the controlling part 2011 conducts a process P2000 for drawing the display data on a screen. This process P2000 determines the information object as the reference information object based on the movement distance of the viewpoint calculated in the process P1000, and draws on the display unit 2015.
Subsequently, it is determined whether or not the viewpoint movement is continuing (step S2303). When the viewpoint movement has been conducted, the displaying process goes back to the process P1000 and the same process is conducted.
On the other hand, the viewpoint movement is not continuing, it is checked whether or not a user input is received (step S2305). When no user input is received, the displaying process goes back to the step S2304, and conducts the same process again.
On the other hand, when the user input is received, it is determined whether or not user input is an end command (step S2306). When the user input is the end command, the displaying process in the three-dimensional data browsing apparatus 2000 is terminated. When the user input is not the end command, the displaying process goes back to the process P2000, and the same process is conducted.
For example, in
In this embodiment, when the viewpoint is moved, the display data is changed corresponding to the distance from the viewpoint to the nearest information object in the three-dimensional space. In this embodiment, the movement speed of the viewpoint is proportional to the distance from the nearest information object.
In
v2=(d2/d1)v1
Thus, when the movement speed in a certain reference distance d0 is set to v0, a movement speed v when the distance from the nearest information object is shown as follows:
v=(d/d0)v0
A process for obtaining the nearest information object is conducted in accordance with a flowchart shown in
In
On the other hand, when there are some information objects that have not been checked, information of information object n is retrieved from the information object data DB 2016 (step S2313). The distance dn from the viewpoint location to the information object n is set based on the information of information object n retrieved the information object data DB 2016 (step S2314), and it is determined whether or not the distance dn from the viewpoint location to the information object n is less than the value d (step S2315). When the distance dn from the viewpoint location to the information object n is greater than or equal to the value d. The reference information object determining process goes back to the step S2312 and the same process is conducted.
On the other hand, the distance dn from the viewpoint location to the information object n is less than the value d, the information object n is set as the reference information object (step S2317). The reference information object determining process goes back to the step S2312 and the same process is conducted.
The movement speed is changed based on the distance obtained by the process conducted by the reference information object determination processing part 2021.
By changing the movement speed based on the distance, it is possible to realize a proper movement speed corresponding to the size of the information object in the screen. For example, in a state of the screen in
The information object subject to browse at the three-dimensional browsing apparatus 2000 shows various shapes in the three-dimensional space.
In a case in which the information object being plane is the reference information object, the direction of the viewpoint movement when the user operates the viewpoint to move upward or downward by using the input unit 2014 will be described with reference to
In
In a case in which the information object being spherical is the reference information object, the direction of the viewpoint movement when the user operates the viewpoint to move upward or downward by using the input unit 2014 will be described with reference to
In
In order to realize movement examples as shown in
If the geometric model information 2202 properly define each of the information objects, it is possible to realize a comfortable browsing screen with respect to various shapes by the same input operation. For example, even if the viewpoint is moved among the children information objects aligned on the surface of the information object having the geometric model of the plane and even if the viewpoint is moved among the children information objects aligned on the surface of the geometric model of the sphere, the children information objects can be sequentially displayed by the same operation.
If a change of the movement speed corresponding to the distance from the reference information object and a change of the movement method using the geometric model information 2202 having the reference information object are simply used together, the operation of the user becomes difficult for user. For example, as shown in
However, since the information object A is an object to be largely displayed when the viewpoint is positioned at the viewpoint location 2, if the information object B becomes the reference information object, the viewpoint ends up to move along the spherical surface according to the geometric model of the information object B. In this case, the reference information object subject to view does not correspond to the reference information object managing the viewpoint movement. As a result, the operation of the user becomes difficult.
As for this problem, three-dimensional data browsing apparatus 2000 processes a value obtained as the distance in the three-dimensional space and then uses the value. In order to process the distance, the value as the distance being a reference in each of three stages is used as shown in
In
For example, in a case in which three distance ranges are set as shown in
In
On the other hand, when the distance d to the viewpoint location is more than the distance dA, it is determined whether or not the distance d to the viewpoint location is shorter than the distance dB (step S2323). When the distance d to the viewpoint location is shorter than the distance dB, the distance d to the viewpoint location is set to the distance d′ as the process result (step S2324). Then, the viewpoint distance process is terminated. That is, within a range where the distance d is more than the distance dA and shorter than the distance dB, the distance d is not processed and remained at the distance d′. Within this range, the above-described process for changing the movement speed is conducted.
On the other hand, when the distance d to the viewpoint location is more than the distance dB, it is further determined whether or not the distance d to the viewpoint is shorter than the distance dc (step S2325). When the distance d to the viewpoint location is more than the distance dC, as the process result, infinity is set to the distance d′ (step S2327). Then, the viewpoint distance process is terminated.
On the other hand, when the distance d to the viewpoint location is shorter than the distance dC, that is, within a range where the distance d is more than distance dB and shorter than distance dC, the distance d′ is calculated by the following expression (step S2324).
This expression shows a function in that the distance d′ becomes the distance dB when d=dB, the distance d′ is increased accompanying with increasing the distance d from the distance dB, and then, the distance d′ is asymptotically increased toward a positive infinity. That is, when the viewpoint location positions farther from the distance dB and closer to the distance dC, the distance d′ becomes more then an actual distance. When the viewpoint location positions almost at the distance dC, the distance d′ becomes almost infinity. And when the distance d is more than the distance dC, the distance d′ becomes the positive infinity. A graph showing relationship between the distance d and the distance d′ is shown in
The viewpoint distance process is conducted in the local coordinate system of each of the information objects. The distance d′ obtained in the local coordinate system of each of the information objects is converted into a value in the local coordinate system of a current reference information object. And the values converted from the distances d′ are compared with each other. As a result, the information object having the smallest value is set as the reference information object. In order to convert the value into the distance d′ in the local coordinate system of the current reference information object, the value is inversely converted based on the coordinate transformation matrix 2212 stored in the link information 2202 of the link structure 2026.
Therefore, it is possible to properly select the reference information object even in the status as shown in
The range where the distance d is shorter than the distance dC in the local coordinate system of the information object A in
As shown in
In this state, if the viewpoint distance process described above and shown in
According to the above-described embodiment, in the three-dimensional data browsing apparatus 2000, it is possible to obtain the distance from the surface of the information object to the viewpoint location along the shape of the information object based on the geometric model information.
In a case in which there are a plurality of the information objects, it is possible to determined the information object having the distance closer to the viewpoint based on the geometric model information, as the reference information object.
It is possible to conduct the viewpoint movement based to three-dimensional shape data by determining the reference information object. Moreover, the movement speed can be changed depending on the distance from the reference information object to the viewpoint location. Therefore, it can be realized to brows details of from the entire reference information object at a proper movement speed for the viewpoint location.
Moreover, it is possible to determine, as the reference information object, the information object having the distance being the closest to the viewpoint in the distances to the viewpoint location that are determined based on the local coordinate systems of the plurality of the information object, respectively, and based on predetermined ranges from the information objects to the viewpoint. Therefore, even if the viewpoint location is positioned farther from or closer to the information object, it is possible to properly determine the reference information object, so that the viewpoint movement can be conducted at a smooth speed.
In the above-described examples, a process by the view determining part 104 shown in
In the above-described examples, a process by the reference information object determination processing part 2021 shown in
This is a Divisional Application of Ser. No. 10/639,517, filed Aug. 13, 2003, now abandoned claiming foreign priority benefit of JP 2001-048770, filed Feb. 23, 2001, the disclosures of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
5276785 | Mackinlay et al. | Jan 1994 | A |
5333254 | Robertson | Jul 1994 | A |
5359703 | Robertson et al. | Oct 1994 | A |
5678015 | Goh | Oct 1997 | A |
5898435 | Nagahara et al. | Apr 1999 | A |
5926183 | Menon et al. | Jul 1999 | A |
6078329 | Umeki et al. | Jun 2000 | A |
6167142 | Nozaki et al. | Dec 2000 | A |
6184884 | Nagahara et al. | Feb 2001 | B1 |
6281877 | Fisher et al. | Aug 2001 | B1 |
6597358 | Miller | Jul 2003 | B2 |
6710788 | Freach et al. | Mar 2004 | B1 |
6828974 | Dumas et al. | Dec 2004 | B2 |
7137075 | Hoshino et al. | Nov 2006 | B2 |
7190365 | Fleury | Mar 2007 | B2 |
20040085356 | Kake et al. | May 2004 | A1 |
20040150646 | Oka | Aug 2004 | A1 |
Number | Date | Country |
---|---|---|
0 471 484 | Feb 1992 | EP |
0 767 418 | Apr 1997 | EP |
9-91109 | Apr 1997 | JP |
10-232757 | Sep 1998 | JP |
11-039132 | Feb 1999 | JP |
11-154244 | Jun 1999 | JP |
2000-20754 | Jan 2000 | JP |
2000-39949 | Feb 2000 | JP |
2000-172248 | Jun 2000 | JP |
2000-322591 | Nov 2000 | JP |
9737294 | Oct 1997 | WO |
Number | Date | Country | |
---|---|---|---|
20060103650 A1 | May 2006 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10639517 | Aug 2003 | US |
Child | 11320345 | US |