1. Field of the Invention
The present invention relates to an information processing device, an information processing method, and a medium recording an information processing program that execute a function set in advance on the basis of operation.
2. Description of the Related Art
In recent years, a keyboard and a mouse are used as input devices for operating a variety of terminals such as a computer, a personal digital assistants (PDA), and an automatic teller machine (ATM) terminal, and audio-visual (AV) equipment. In addition to the above, input methods such as voice input, a touch panel, and gesture (expression) input are studied and developed actively.
In order to start an application in a personal computer and the like, techniques such as inputting a name of the application by using a keyboard and clicking an icon indicating the application by using a mouse are generally used.
There have been disclosed a user interface device having an angular speed sensor for detecting an orientation change of a handle in a horizontal plane, and a pointing device for instructing scrolling of a screen by analog input (for example, Jpn. Pat. Appln. Laid-Open Publication No. 2001-38052 and Jpn. Pat. No. 3247630).
In the past, the user has been required to determine an application to be used and take action, such as typing a keyboard and clicking a mouse, in order to start the application. For the above reason, there has been a problem that the user needs to remember a correct spelling of the application to be started and a shape of an icon, and this is a burden for a child and an elderly person.
In recent years, the amount of information to be handled has greatly increased. Accordingly, there has been an increasing need for an operation device with which the user can intuitively handle information.
In addition, home appliances, personal computers, have had many functions. In order to operate such many functions, the user needs to repeat menu selection in more and more occasions. The above devices have been required to be more user friendly for a wide range of users.
An embodiment of the present invention provides an information processing device, an information processing method, and a medium recording an information processing program that can be operated easily.
In order to achieve the above object, an aspect of the present invention includes a solid body, a measurement section that is provided in the solid body and measures a state of the solid body with respect to three-dimensional space to obtain state information; a recognition section that recognizes a section facing a predetermined direction among a plurality of sections of the solid body based on the state information measured by the measurement section to set the recognized section as a selected section; and an execution section that selects and executes a function corresponding to the selected section among functions associated with a plurality of the sections in advance based on the selected section recognized by the recognition section.
In addition, an aspect of the present invention carries out recognizing and setting as a selected section a section facing a predetermined direction among a plurality of sections of a solid body, based on state information measured by a measurement section that is provided in the solid body and measures a state of the solid body with respect to three-dimensional space to obtain the state information; and selecting and executing a function corresponding to the selected section among functions associated with a plurality of the sections in advance based on the recognized selected section.
In addition, an aspect of the present invention is a medium recording an information processing program in a manner that the information processing program can be read out by a computer, that carries out recognizing and setting as a selected section of a section facing a predetermined direction among a plurality of sections of a solid body, based on state information measured by a measurement section that is provided in the solid body and measures a state of the solid body with respect to three-dimensional space to obtain the state information; and selecting and executing a function corresponding to the selected section among functions associated with a plurality of the sections in advance based on the recognized selected section.
Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
In the present embodiment, description will be made with respect to an information browsing system to which an information processing device according to the present invention is applied. The information browsing system is a system used for browsing information the user desires.
A configuration of the information browsing system according to the present embodiment will be described below.
The display section 13 is, for example, a display. The display section 13 displays screen information output from the host PC 12.
A configuration of the operation device 11 will be described hereinafter.
The operation device 11 can be held by the user. In addition, a shape of the operation device 11 according to the present embodiment is a cube. In addition, a surface of the operation device 11 has square surfaces G1, G2, G3, G4, G5, and G6. Although the shape of the operation device 11 is a cube in the present embodiment, other polyhedrons or a solid body such as a sphere may be used. The operation device 11 can be held by the user.
A function G1 “Area” of when the surface G1 is on a top surface indicates a function of selecting an area. A function G2 “Language” of when the surface G2 is on the top surface indicates a function of selecting a language. A function G3 “Zoom” of when the surface G3 is on the top surface indicates a function of enlarging display. A function G4 “Movie” of when the surface G4 is on the top surface indicates a function of reproducing a movie. A function G5 “Game” of when the surface G5 is on the top surface indicates a function of executing a game. A function G6 “System” of when the surface G6 is on the top surface indicates a function of introducing a system.
The acceleration sensors 31x, 31y, and 31z detect acceleration in an x-direction, a y-direction and a z-direction, respectively. Then, each of the acceleration sensors 31x, 31y, and 31z outputs an acceleration signal of an analog value. The angular speed sensors 32x, 32y, and 32z detect angular speeds of rotation around the x-axis, the y-axis, and the z-axis, respectively. Then, each of the angular speed sensors 32x, 32y, and 32z outputs an angular speed signal of an analog value. The geomagnetic sensors 33x, 33y, and 33z detect geomagnetisms in the x-direction, the y-direction and the z-direction, respectively. Then, each of the geomagnetic sensors 33x, 33y, and 33z output a geomagnetic signal of an analog value.
The A/D converters 34x, 34y, and 34z convert the acceleration signals output from the acceleration sensors 31x, 31y, and 31z, respectively, to acceleration information of a digital value. The A/D converters 35x, 35y, and 35z convert the angular speed signals output from the angular speed sensors 32x, 32y, and 32z, respectively, to angular speed information of a digital value. The A/D converters 36x, 36y, and 36z convert the geomagnetic signals output from the geomagnetic sensors 33x, 33y, and 33z, respectively, to geomagnetic information of a digital value.
The information processing section 42 generates operation device information (state information) based on the A/D converters 34x, 34y, 34z, 35x, 35y, 35z, 36x, 36y, and 36z. The operation device information includes three-axis acceleration information, three-axis angular speed information, and three-axis geomagnetic information. The three-axis acceleration information puts together the acceleration information output from the A/D converters 34x, 34y, and 34z. The three-axis angular speed information puts together the angular speed information output from the A/D converters 35x, 35y, and 35z. The three-axis geomagnetic information puts together geomagnetic information output from the A/D converts 36x, 36y, and 36z.
The wireless module 43 wirelessly transmits the operation device information to the host PC 12 at measuring intervals which are predetermined time intervals. The measuring interval is, for example, 1/64 sec.
The power supply unit 44 includes a battery and a switch. When the switch is turned on, the power supply unit 44 supplies power to each section of the operation device 11 from the battery.
A configuration of the host PC 12 will be described hereinafter.
The wireless module 23 receives the operation device information wirelessly transmitted from the wireless module 43 of the operation device 11. The wireless module 23 and the wireless module 43 carry out wireless communication using a predetermined wireless communication system (for example, Serial Port Profile of Bluetooth (trademark)).
The storage section 22 is, for example, a memory and a magnetic disc. The control section 21 is, for example, a central processing unit (CPU). The control section 21 executes the following software stored in the storage section 22.
The content DB 54 retains a content (information set in advance) which serves as a basis of screen information.
The operation recognition section 52 recognizes operation of the operation device 11 by the user based on the operation device information received from the wireless module 23. Then, the operation recognition section 52 generates an event. In addition, the operation recognition section 52 manages a state flag, stationary time, a horizontal rotational angle, attitude information, and the like. The state flag indicates whether the operation device 11 is in a stationary state or not. The stationary time indicates a period of time in which the stationary state continues. The horizontal rotational angle indicates a rotational angle around a vertical angle. The attitude information indicates an attitude of the operation device 11.
The function execution section 53 executes a function with respect to a content retained by the content DB 54 based on the event generated by the operation recognition section 52. Then, the function execution section 53 displays screen information obtained as a result of such execution on the display section 13.
Operation of the information browsing system according to the present embodiment will be described below.
Operation of the operation device 11 will be described hereinafter.
After power is supplied to the operation device 11, the information processing section 42 acquires the three-axis acceleration information, the three-axis angular speed information, and the three-axis geomagnetic information at the measuring intervals to generate the operation device information.
The wireless module 43 transmits the operation device information to the host PC at the measuring intervals.
Operation of the operation recognition section 52 will be described hereinafter.
Next, the operation recognition section 52 determines whether the wireless connection between the wireless module 23 and the operation device 11 has been terminated or not (S117). In the case where the wireless connection has not been terminated (S117, N), the processing moves to the processing of S113. In the case where the wireless connection has been terminated (S117, Y), this flow ends.
The stationary determination processing carried out by the operation recognition section 52 will be described hereinafter.
In the case where the stationary condition is satisfied (S121, Y), the operation recognition section 52 determines whether the state flag is in a stationary state (S131).
In the case where the state flag is not in a stationary state (S131, N), the operation recognition section 52 sets the stationary state of the state flag (S132). Then, the operation recognition section 52 resets stationary time and starts measurement of stationary time (S133), and this flow ends.
In the case where the state flag is in the stationary state (S131, Y), the operation recognition section 52 determines whether stationary time is equal to or greater than a stationary time threshold value (S134). In the case where the stationary time is equal to or greater than the stationary time threshold value (S134, Y), the operation recognition section 52 issues a stationary event (S135), and this flow ends. In the case where the stationary time is lower than the stationary time threshold value (S134, N), this flow ends.
In the case where the stationary condition is not satisfied (S121, N), the operation recognition section 52 determines whether the state flag is in a stationary state (S141).
In the case where the state flag is in a stationary state (S141, Y), the operation recognition section 52 releases the stationary state of the state flag (S142), and this flow ends.
In the case where the state flag is not in the stationary state (S141, N), this flow ends.
The top surface update determination processing carried out by the operation recognition section 52 will be described hereinafter.
In the case where the stationary condition is not satisfied (S151, N), this flow ends.
In the case where the stationary condition is satisfied (S151, Y), the operation recognition section 52 selects one component having an absolute value within a range of a gravitational acceleration from three components of the three-axis acceleration information and sets the selected one component as a vertical axis acceleration (S161). Here, candidates for the top surface of the six surfaces of the operation device 11 are two surfaces perpendicular to the vertical axis acceleration. Next, the operation recognition section 52 recognizes a surface ID of the top surface of the two surfaces as candidates based on a sign of the vertical axis acceleration and sets the recognized surface ID as a new top surface ID (S162).
As an example, description will be made with respect to a case where a vertical axis acceleration is a z-component and a sign of the vertical axis acceleration is negative. First, the operation recognition section 52 selects a surface G3 and a surface G6 perpendicular to the z-axis as candidates for the top surface based on that a vertical axis is the z-axis. Next, the operation recognition section 52 selects the surface G6 on the opposite side of a gravity direction as the top surface based on that a sign of the vertical axis acceleration is negative.
Next, the operation recognition section 52 determines whether the top surface ID has been updated or not based on recognition of the top surface ID (S164).
In the case where the top surface ID has been updated (S164, Y), the operation recognition section 52 issues a top surface update event including a new top surface ID and resets a horizontal rotational angle (S165). Then, this flow ends.
In the case where the top surface ID has not been updated (S164, N), this flow ends.
The rotation determination processing carried out by the operation recognition section 52 will be described hereinafter.
Next, the operation recognition section 52 calculates a new horizontal rotational angle based on a retained horizontal rotational angle, the measurement intervals, and the horizontal rotational angular speed and then updates the horizontal rotational angle (S181). Next, the operation recognition section 52 determines whether an absolute value of the horizontal rotational angle is equal to or greater than a predetermined threshold value of a horizontal rotational angle (S182). Here, the threshold value of a horizontal rotational angle is, for example, 45 degrees.
In the case where an absolute value of the horizontal rotational angle is equal to or greater than the threshold value of a horizontal rotational angle (S182, Y), the operation recognition section 52 issues a rotation event including a rotational direction (right rotation or left rotation, a sign of a horizontal rotational angle). Then, the operation recognition section 52 resets the horizontal rotational angle (S183), and this flow ends.
In the case where an absolute value of the horizontal rotational angle is lower than the threshold value of a horizontal rotational angle (S182, N), this flow ends.
Here, each of the events described above will be described. The top surface update event corresponds to selection of a function. The stationary event corresponds to determination of a selected item. These events correspond to a decision button, an OK button, an enter key, and the like in a conventional information browsing application respectively. And the rotation event corresponds to movement of a selected item. This corresponds to a scroll bar, up and down keys, left and right keys, and the like in the conventional information browsing application.
Operation of the function execution section 53 will be described hereinafter.
First, the function execution section 53 acquires an event issued by the operation recognition section 52 (S211). Next, the function execution section 53 determines whether the top surface update event is issued or not (S231).
In the case where the top surface update event is issued (S231, Y), the function execution section 53 selects a function corresponding to the top surface ID from the content DB 54 to determine a selected function (S232). Then, the function execution section 53 acquires a top page of the selected function and displays the top page on the display section 13 (S233). Then, this flow ends.
In the case where the top surface update event has not been issued (S231, N), the function execution section 53 determines whether the rotation event has been issued or not (S251).
In the case where the rotation event has been issued (S251, Y), the function execution section 53 recognizes a rotation direction included in the rotation event (S252). The function execution section 53 moves the selected item in a menu on a displayed page in the rotation direction (S253). Then, this flow ends.
For example, in the case where the rotation event indicates right rotation, the function execution section 53 selects an item obtained by increasing an item number for one in the menu on the displayed page. Then, the function execution section 53 sets the item selected in this manner as a selected item. In addition, in the case where the rotation event indicates left rotation, the function execution section 53 selects an item obtained by decreasing an item number for one in the menu on the displayed page. Then, the function execution section 53 sets the item selected in this manner as a selected item.
In the case where the rotation event has not been issued (S251, N), the function execution section 53 determines whether the stationary event has been issued or not (S271).
In the case where the stationary event has been issued (S271, Y), the function execution section 53 executes a selection function with respect to the selected item, and displays a result of such execution on the display section 13 (S272). When the execution of the selection function ends, the function execution section 53 returns to the page before the execution and displays the page on the display section 13 (S273). Then, this flow ends.
In the case where the stationary event has not been issued (S271, N), this flow ends.
A configuration of the content DB 54 will be described hereinafter.
The content DB 54 retains a plurality of contents for each of the top surface IDs.
In addition, in a matrix of page IDs shown in
A content of a function G1 “Area” will be described hereinafter.
From a menu in 12A, the user can select 13A, 13B, 13C, and 13D as a lower layer of 12A. From a menu in 13A, the user can select 14A, 14B, 14C, and 14D as a lower layer of 13A.
A content of a function G2 “Language” will be described hereinafter.
In addition, each of the pages is associated with a language that is different from the others. Here, the selection function is for setting a language as the selected item as a language used for display. The function execution section 53 moves selection of an item in a menu by the rotation event. Then, the function execution section 53 sets a language of the selected item as a language used for display by the stationary event. When the language is set, the function execution section 53 displays subsequent pages in the set language.
A content of a function G3 “Zoom” will be described hereinafter.
Here, the selection function is for displaying a page enlarging an image as the selected item. The function execution section 53 moves selection of an item in a menu by the rotation event. Then, the function execution section 53 enlarges an image of the selected item by the stationary event.
A content of a function G4 “Movie” will be described hereinafter.
The function execution section 53 moves selection of an item in a menu by the rotation event. Then, the function execution section 53 plays a movie of the selected item by the stationary event.
A content of a function G5 “Game” will be described hereinafter.
A content of a function G6 “System” will be described hereinafter.
According to the present embodiment, for example, in the case where a content is a travelling brochure, the user carries out designation of an area, designation of a language, zoom, and the like of the travelling brochure by simple operation. In this manner, the user can browse the travelling brochure.
Another application example of the information processing device of the present invention will be described hereinafter.
The operation device 11 described above can be used as a service provision tool in a variety of services which will be described hereinafter.
According to the present embodiment, the user can browse information only by looking at and moving the operation device 11. Accordingly, the user does not need to use a large number of buttons, and pointer and cursor moving functions. In addition, the user does not need to remember correct spelling and a shape of an icon of an application that the user desires to start.
In addition, according to the present embodiment, even the user who does not have prior knowledge with respect to an information browsing system can browse information smoothly. Therefore, in presentation of a showroom and the like, the user can expand presentation into a topic that interests a customer. In addition, in response to a question from the customer, the user can start a desired function without looking for a file.
Since wireless communication is established between the operation device 11 and the host PC 12, the user can remotely operate the host PC 12 by using the operation device 11. Accordingly, the user is not restricted to stay around the display section 13 and the host PC 12 and can operate a content at an arbitrary location.
In the case where the operation device 11 has a ball shape, marks indicating corresponding functions are put on a plurality of sections on a surface of the operation device 11. In this case, a function corresponding to a mark appearing on the top is executed.
In addition, the operation device 11 may have the display section 13 on part of or whole surface thereof. In this case, the operation device 11 further has functions of the operation recognition section 52 and the function execution section 53.
In the present embodiment, simple words corresponding to operation are put on each surface of the operation device 11. However, a picture, a symbol, Braille points, and the like may be put on each surface as well. By the picture and the symbol indicating operation, anyone in the world can easily operate the operation device 11 irrespective of languages. In addition, each surface of the operation device 11 configured to have a display can change information shown on each surface depending on situations.
The host PC 12 may further include a log recording section. The log recording section records an application started by the function execution section 53, a browsed item, and a log of time. In this case, an information browsing system can carry out market research and collect product information that interests a customer without making the customer aware of such a fact.
In the present embodiment, correction based on the three-axis geomagnetic information is carried out. However, this correction may be omitted. In this case, the operation device 11 does not need the geomagnetic sensors 33x, 33y, and 33z.
In addition, the information processing device of the present invention can be applied to a service support system in a shop and service space. For example, the service support system carries out calling for stuff, selecting and ordering of a menu, browsing of information and a history, control of spatial equipment (air conditioning, lighting, acoustic system) based on operation of the polyhedron.
In addition, the information processing device of the present invention may be applied to a video distribution system. For example, the video distribution system distributes through a network a video picture selected in a menu based on operation of the polyhedron. In this manner, the user can select necessary information and a video picture in an on-demand manner.
In addition, the information processing device of the present invention may be applied to an equipment operation system, such as a switch and a remote controller. According to the equipment operation system, the user can operate the information processing device at an arbitrary location without moving.
In addition, the information browsing system according to the present embodiment uses a general wireless communication system that enables easy connection for communication between the operation device 11 and the host PC. Accordingly, by carrying around only the operation device 11, the user can use the host PC set in any location and an application therein.
In addition, the function execution section 53 and the content DB54 have a schedule management function. In this manner, each surface of the operation device 11 shows a destination of an owner. Also, the host PC 12 can acquire information on the destination and manage a schedule.
In addition, the display section 13 includes a voice (music) reproduction function, and the function execution section 53 and the content DB 54 include a management function of voice information. In this manner, the user can select voice information and adjust a sound volume by simple operation of the operation device 11. In this case, for example, the function execution section 53 controls size of a sound volume by the rotation event.
In addition, the display section 13 includes a lighting function, and the function execution section 53 and the content DB 54 include a function for controlling brightness. In this manner, the user can adjust lighting by simple operation of the operation device 11. In this case, for example, the function execution section 53 controls size of brightness of lighting by the rotation event.
In addition, an existing application may be controlled in such a manner that the operation recognition section 52 generates a command of the application in place of carrying out a variety of events, based on the operation device information.
In addition, the operation recognition section 52 generates an output that is similar to a mouse and a keyboard in place of a variety of events based on the operation device information. In this manner, the user can use the operation device 11 in place of a mouse and a keyboard.
In addition, operation by a plurality of the operation devices 11 may be recognized in such a manner that there are a plurality of the operation devices 11, each of the operation devices 11 has an operation device ID which is inherent thereto, and the operation recognition section 52 manages a plurality of the operation device IDs that are wirelessly connected.
In addition, the information processing device according to the present invention may carry out control in which the functions described above are combined.
In addition, the operation recognition section 52 may recognize that the operation device 11 is raised in an upward direction along a vertical axis to generate a rise event. Then, the function execution section 53 detecting the rise event may carry out enlarging and the like of a page currently displayed.
In addition, the operation device 11 may further include the three-axis geomagnetic sensor so as to be able to output the three-axis geomagnetic information which is information of geomagnetism in the x-direction, the y-direction, and the z-direction. In this case, the operation recognition section 52 can recognize an attitude of the operation device by using the three-axis geomagnetic information. In addition, the operation recognition section 52 can carry out correction of the attitude of the operation device obtained from the three-axis acceleration information and the three-axis angular speed information by using the three-axis geomagnetic information.
Further, a program that executes each of the steps described above in a computer configuring the information processing device can be provided as an information processing program. The program described above is stored in a recording medium which can be read out by a computer. In this manner, the program can be executed by a computer configuring the information processing device. Here, the recording medium which can be read out by a computer described above includes an internal storage device implemented internally in a computer such as a ROM and a RAM, a CD-ROM and a flexible disc, a DVD disc, a magneto-optical disc, a portable storage medium such as an IC card, and a database retaining a computer program, or other computers and a database thereof, and further an online transmission medium.
The present invention can be implemented in a variety of other forms without deviating from a gist and a principal characteristic thereof. Therefore, the embodiment described above is a mere exemplification in every aspect, and does not allow the invention to be interpreted in a limiting manner. A range of the present invention is shown by claims, and not restricted by a content of the description in any way. Further, all deformation, a variety of improvements, substitutions, modifications belonging to a uniform range of claims are all included in claims.