This application is based on and claims priority under 35 U.S.C. 119 from Japanese Patent Application Nos. 2011-285972 and 2012-039058, which were filed on Dec. 27, 2011 and Feb. 24, 2012, respectively.
The present invention relates to technology for displaying an image on multiple devices.
A technology for displaying an image captured by a camera-equipped mobile phone on a large-screen television using wireless communication is known. In general, a larger screen can provide a better view of an image than a smaller screen.
In an aspect of the present invention, there is provided an information-processing system including: a first display; a second display, which is a device separate from the first display; and a controller that causes the first display and the second display to display an image, wherein the controller includes: a first display controller that causes the first display to display a first image in accordance with image data; and a second display controller that causes the second display to display selectively the first image having a first magnification, or a second image that is a partial image of the first image and has a second magnification greater than the first magnification.
Exemplary embodiments of the present invention will now be described in detail based on the following figures, wherein:
Display system 10 is configured to include monitor 100, controller 200, and main device 300. It is to be noted, however, that display system 10 may be configured to include another controller other than controller 200, or may be provided with multiple controllers 200. Further, display system 10 may be used without use of monitor 100.
Monitor 100 is a device for displaying an image, and may be, for example, a television set for receiving a television broadcast. In this explanation, monitor 100 is a stationary-type device. It is to be noted that monitor 100 does not have to have a function of receiving a television broadcast, and may be a device of a personal computer, or the like. It is assumed that monitor 100 has display area 101 having a larger size than display area 241 of controller 200. Further, display area 101 of monitor 100 and display area 241 of controller 200 do not have to have the same aspect ratio.
Controller 200 is a terminal on which an image is displayed, and is held by a user to perform various operations. Controller 200 herein is a portable device that has display area 241 and is to be held and operated by a user.
Main device 300 is a controller for controlling operation of monitor 100 and controller 200. To achieve the purpose, controller 300 is connected to each of monitor 100 and controller 200 via wired or wireless communication. It is assumed here that main device 300 conducts wireless communication with controller 200 and conducts wired communication with monitor 100, though the communication may be performed in another manner.
On the front side of controller 200, there are provided A button 261A, B button 261B, X button 261X, Y button 261Y, and cross button 261D, in addition to display area 241. On the perimeter side of controller 200, there are provided L button 261L and R button 261R. Further, on the rear side of controller 200, there are provided ZL button 261ZL and ZR button 261ZR. In the following description, these buttons may simply be referred to as “buttons 261.”
Buttons 261 are hardware keys that can be pressed. It is to be noted here that a hardware key is a key provided at a predetermined position of controller 200, and may also be referred to as a physical key. Buttons 261 generate operation information that indicates a state of pressing of each button or indicates whether each button is pressed.
Further, in addition to buttons 261, slide pad 262 is provided on the front side of controller 200. Slide pad 262 generates operation information that represents a strength and a direction of a force that is imparted to slide pad 262 by a finger of the user.
It is also to be noted that the way of holding controller 200 is not limited to the example shown in
Controller 210 is a means for controlling operations of various units of controller 200. Controller 210 includes a processing device such as a CPU (Central Processing Unit), a memory serving as a main memory device, an input/output interface for communicating information with various units of controller 200, and so on, and executes a program(s) to control display of images or data transmission and reception to and from main device 300. Further, controller 210 includes a codec for compressing image data to be sent to main device 300 and expanding image data received from main device 300. The format for compression and expansion performed by the codec is H.264, for example, though the format is not particularly limited.
Auxiliary storage unit 220 is a means for storing data used by controller 210. Auxiliary storage unit 220 is a flash memory, for example. Auxiliary storage unit 220 is capable of storing data such as bookmarks, which will be described later.
Communication unit 230 is a means for communicating with main device 300. Communication unit 230 includes an antenna or the like for communicating with main device 300 wirelessly.
Display 240 is a means for displaying an image. Display 240 includes a display panel having pixels formed by liquid crystal elements or organic EL (electroluminescence) elements, and a drive circuit for driving the display panel, and displays, in display area 241, an image in accordance with image data provided from controller 210.
Touch screen 250 is a means for receiving an operation performed by a user, and generating and supplying coordinate information that represents a position in display area 241. Touch screen 250 includes a sensor disposed to overlap display area 241, and a control circuit for generating coordinate information representing a position detected by the sensor and providing the coordinate information to controller 210. Touch screen 250 may be of resistive type, or may be of another type such as capacitive type.
Touch screen 250 provides software keys in cooperation with display 240. A software key is a key that is provided in display area 241 by a software process. Unlike a hardware key, the position of a software key is changeable, and display/hiding of a software key can be switched.
Operation unit 260 is another means for receiving an operation performed by a user. Operation unit 260 includes the aforementioned buttons 261 and slide pad 262, and provides controller 210 with operation information in accordance with an operation performed by a user.
Motion detection unit 270 is a means for detecting a motion of controller 200. Motion detection unit 270 includes magnetic sensor 271, acceleration sensor 272, and gyro sensor 273, whereby motion detection unit 270 generates motion information that indicates motion of controller 200 and supplies the motion information to controller 210. Motion information represents a change in geomagnetism (namely direction) detected by magnetic sensor 271, a change in acceleration detected by acceleration sensor 272, and a change in angle or angular velocity (namely, tilt) detected by gyro sensor 273. It is to be noted that motion detection unit 270 may be configured only to include at least one of magnetic sensor 271, acceleration sensor 272, and gyro sensor 273.
Controller 200 does not move unless an operation is performed by a user, and is caused to move as a result of shaking, tilting, or another operation performed by a user. Therefore, it can be said that motion detection unit 270 detects a motion or operation of a user by detecting a motion of controller 200. Thus, in this description, the motion information generated by motion detection unit 270 is included in operation information.
Controller 310 is a means for controlling operations of various units of main device 300, and corresponds to a “computer” in the present invention. Controller 210 includes a processing device such as a CPU, a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor) or the like, a memory serving as a main memory device or a VRAM (Video Random Access Memory), an input/output interface for communicating information with various units of main device 300, and so on, and executes a program(s) to control generation of image data to be transmitted to monitor 100 and controller 200. The programs that can be executed by controller 310 include a game program, a browser program for browsing webpages, and so on, such programs being described later. Further, controller 310 includes a codec for compressing image data to be sent to controller 200 or monitor 100 and expanding image data received from controller 200.
Auxiliary storage unit 320 is a means for storing data used by controller 310. Auxiliary storage unit 320 is a flash memory or a hard disk, for example. Auxiliary storage unit 320 is capable of storing programs to be executed by controller 310 and data acquired via network communication unit 340 or terminal communication unit 350.
Disk drive unit 330 is a means for reading data stored in an optical disk or other optical storage medium. The optical disk may store data necessary for playing a game, such as a game program, for example.
Network communication unit 340 is a means for communicating via a network such as the Internet. The communication performed by network communication unit 340 may be wired or wireless communication. Network communication unit 340 receives data from an external server device or transmits data thereto in accordance with instructions from controller 310.
Terminal communication unit 350 is a means for communicating with controller 200. In a case where a controller other than controller 200 is used, terminal communication unit 350 may communicate with the other controller. The wireless communication performed by terminal communication unit 350 may utilize any communication technology such as Wi-Fi, Bluetooth, or infrared communication.
AV interface unit 360 is a means for supplying to monitor 100 image data, sound data, or the like. AV interface unit 360 includes one or more interfaces such as an HDMI (High-Definition Multimedia Interface) terminal or the like.
First display controller 311 is a means for controlling display of an image by monitor 100. First display controller 311 causes monitor 100 to display an image such as a webpage, and causes the image to be magnified or scrolled, as required. Scroll herein indicates a mode of display in which an image that is not displayed in its entirety in the display area is caused to move in a prescribed direction such that the portion that has not been displayed is visualized. In the present embodiment, “scroll” not only indicates movement of an image in an up-down direction (i.e., vertical direction) or left-right direction (i.e., horizontal direction), but also may include movement of an image in an oblique direction. Further, first display controller 311 has a function of causing monitor 100 to display a frame image (indicator image), which will be described later.
Second display controller 312 is a means for controlling display of an image by controller 200. Similarly to first display controller 311, second display controller 312 causes controller 200 to display an image such as a webpage, and causes the image to be magnified or scrolled, as required. When an operation for displaying a magnified image (hereinafter referred to as a “magnifying operation”) is performed, second display controller 312 changes the magnification of the image accordingly. Namely, second display controller 312 selectively performs control for causing an image to be displayed with a predetermined magnification and control for causing a part of the image to be displayed with a magnification greater than the predetermined magnification. Further, second display controller 312 may cause controller 200 to display an image different from that caused to be displayed on monitor 100 by first display controller 311, though second display controller 312 may operate in cooperation with first display controller 311 such that the image displayed on monitor 100 and the image displayed on controller 200 have a prescribed relationship.
Information acquisition unit 313 is a means for acquiring information. The information acquired by information acquisition unit 313 includes operation information relating to an operation performed by a user. Operation information is information transmitted from controller 200 in response to a user operation. In addition to a state of pressing of respective buttons 261, operation information may include coordinate information provided by touch screen 250 and motion information provided by motion detection unit 270.
Object selection unit 314 is a means for selecting, in accordance with an operation by a user, an object included in an image displayed in the display area. An object herein is an item to be operated, and an image such as an icon, a button used in a GUI (Graphical User Interface), a scroll bar, or a widget (also referred to as a control) such as a text box may be an object. Further, a character may function as a selectable object. For example, in a case where the image displayed in the display area is a webpage, a string of characters functioning as a hyperlink may be an object. Object selection unit 314 selects an object based on the operation information acquired by information acquisition unit 313. It is to be noted that object selection unit 314 can make an object selectable in each of the states where controller 200 is displaying a magnified image and where controller 200 is not displaying a magnified image.
Further, when, after an object is caused to be in a selectable state, a user performs a predetermined operation for the object in the selectable state (such as pressing of a button), object selection unit 314 may select the object. It is to be noted here that an object in the selectable state is an object that is given input focus.
Display controller 318 (i.e., first display controller 311 and second display controller 312) can vary the image to be displayed in accordance with the operation information acquired by information acquisition unit 313 and/or the object selected by object selection unit 314. For example, in a state where a webpage is displayed, when an object included in the webpage and indicating a certain hyperlink is selected, first display controller 311 and second display controller 312 can cause monitor 100 and controller 200 to display another webpage indicated by the selected object.
Holding detection unit 315 is a means for detecting holding of controller 200 by a user. Holding detection unit 315 utilizes predetermined operation information to detect that the user is holding controller 200 in a prescribed manner. In this embodiment, when it is found that each of ZL button 261ZL and ZR button 261ZR is pressed, holding detection unit 315 detects that the user is holding controller 200 with both hands, as shown in
Holding detection unit 315 may detect holding of controller 200 by a user based on another operation. For example, holding detection unit 315 may detect holding of controller 200 by a user based on pressing of L button 261L and R button 261L instead of based on pressing of ZL button 261ZL and ZR button 261ZR, or may detect holding of controller 200 when all of these four buttons are pressed. Further, instead of detecting pressing of a hardware key, holding detection unit 315 may detect holding of controller 200 by a user based on interaction with another sensor (e.g., touch sensor) by a user.
Position specifying unit 316 is a means for specifying a certain position in the image displayed on controller 200. The certain position here refers to a position of a portion of the image displayed on controller 200 that is to be magnified. In this exemplary embodiment, position specifying unit 316 can determine the position based on operation information input by the user. Further, position specifying unit 316 may also specify the position by referring to display position information, which will be described later.
Image generation unit 317 is a means for interpreting data of a webpage (hereinafter, “content”) written in a markup language such as HTML (HyperText Markup Language), and generating bitmap data representing the webpage. In addition to the data of webpage itself, which is written in Markup Language, a content herein may include, style sheet, image data, script, and so on.
Image generation unit 317 acquires a content via network communication unit 340, determines an image to be displayed by, based on the content, arranging a character(s) and an image(s) and adjusting an appearance of the character(s), and generates bitmap data that represents the determined image as a bitmap image. Namely, image generation unit 317 has principal functions as a web browser (user agent, parser, and renderer). Image generation unit 317 records the bitmap data in a VRAM. When a webpage is displayed, first display controller 311 and second display controller 312 each read out from the VRAM the bitmap data thus generated by image generation unit 317, and cause the image to be displayed.
It is to be noted that main device 300 does not have to include every unit shown in
The foregoing is a description of the configuration of display system 10. In this configuration, main device 300 causes at least one of monitor 100 and controller 200 to display an image. Depending on a user operation and/or a type of an image to be displayed, main device 300 may cause only one of monitor 100 and controller 200 to display an image or may cause each of monitor 100 and controller 200 to display an image. It is to be noted that, in a case where an image is displayed on each of monitor 100 and controller 200, main device 300 may cause the same image to be displayed on monitor 100 and controller 200, or may cause different images to be displayed on monitor 100 and controller 200.
For example, in a case where a game is played and there are multiple users such as family members or friends, a mode of use may be assumed in which a particular user views and operates controller 200, while the other users check the progress of the game using monitor 100. In such a case, if there are multiple controllers 100 or there is a controller(s) other than controller 200, multiple users can participate in the game.
Further, by using display system 10, a user not only can play a game but also can browse webpages. Moreover, a user may browse a captured images (moving images or still images) or electronic documents. In doing so, the user may display the image on each of monitor 100 and controller 200, or may display the image on only one of monitor 100 and controller 200.
In this exemplary embodiment, display system 10 can cause each of monitor 100 and controller 200 to display an image based on the same content. In doing so, display system 10 can operate in one of two operation modes: in one mode, the image displayed on monitor 100 is displayed in its entirety on controller 200; and in the other mode, a part of the image displayed on monitor 100 is magnified and displayed on controller 200. In the following description, the former operation mode will be referred to as a “normal-size mode” while the latter operation mode will be referred to as a “magnifying mode.” There are multiple ways for magnification to be performed in the magnifying mode, as will be described in the following.
On the other hand, when the operation mode is switched from the normal-size mode to the magnifying mode, image Im12a, which is an image obtained by enlarging a part of image Im12 displayed in the normal-size mode, is caused to be displayed in region 241 of controller 200. Further, in the magnifying mode, frame image Im13 that indicates the position of image Im12a is caused to be displayed in display area 101 of monitor 100 in addition to image Im11. Frame image Im13 is an example of an indicator image of the invention. It is to be noted that, instead of frame image Im13, it is possible to use, as the indicator image, an image showing the area displayed on controller 100 with one or more dots, or an image that changes the color within the area from that of another area (e.g., an image highlighting the area or an image causing the area to flicker).
In the magnifying mode, the user can view a part of the image displayed on monitor 100 using controller 200. Namely, the user can view an entirety (or a large part) of the image with monitor 100, and at the same time, can view a specific part of the image in detail with controller 200, when necessary. In addition, since controller 200 is provided with a variety of operation means, the user can perform an appropriate operation while viewing the image in detail using controller 200.
It is assumed that in a normal mode of use of display system 10, the user of the system holds controller 200 at a position a certain distance from monitor 100 (several meters or more). In other words, controller 200 is closer to the user than monitor 100 is. Therefore, controller 200 is considered to be a device that is more convenient for the user to use to view the image in detail and to perform an operation, than monitor 100.
The following description describes an operation when a webpage is viewed, as an example of display performed by display system 10. In the following description, explanation may be given separately of the display control for monitor 100 and of the display control for controller 200 for the convenience of explanation. However, it is to be noted that, actually, the display control for monitor 100 and the display control for controller 200 are carried out in parallel.
Upon receipt of the page data, controller 310 generates bitmap data based on the page data (step S12). Controller 310 executes a process such as rendering to generate bitmap data, and stores the bitmap data temporarily in a VRAM.
Subsequently, controller 310 executes predetermined image processing on the bitmap data (step S13). Predetermined image processing here refers to image processing for displaying an image in accordance with the size of display area 241 of controller 200. In this exemplary embodiment, controller 310 performs a thinning process in which pixels constituting the bitmap data are thinned out to reduce the number of pixels. This thinning process may be performed by means of any known thinning technique for reducing bitmap data. For example, controller 310 may reduce the number of pixels in each of the vertical direction and the horizontal direction to ½ (1/n), so that the total number of pixels is reduced to ¼ (1/n2).
Then, controller 310 generates image data based on the bitmap data after the thinning process has been performed, and transmits the image data to controller 200 via terminal communication unit 350 (step S14). Image data is data of an image and is obtained by compressing the bitmap data using a predetermined compressing technique. Further, the image data may include an image corresponding to an operation object, which will be described later. Upon receipt of the image data, controller 210 of controller 200 causes the corresponding webpage image to be displayed in display area 241.
It is to be noted that the number and arrangement of operation objects are not particularly limited. For example, instead of being arranged at the top and the bottom like menu images Im22 and Im23, operation objects may be arranged on the left and right, or may be displayed collectively either at the top, at the bottom, on the left, or on the right. Further, display of an operation object is not mandatory.
In the following description, to distinguish from a magnified image, which will be described later, an image as shown in
Main device 300 causes controller 200 to display an image as described above, and also causes monitor 100 to display an image. Specifically, based on the same content from which the image displayed on controller 200 is derived, main device 300 generates image data to be provided to monitor 100 by performing a process similar to that shown in
It is to be noted that the image displayed on monitor 100 may include only image Im21 shown in
When main device 300 causes monitor 100 and controller 200 to display an image as described in the foregoing, a state of display illustrated in
In the following description, magnification or reduction in the first mode will be referred to as “quick zoom,” and magnification or reduction in the second mode will be referred to as “step zoom.” In this embodiment, quick zoom is carried out in response to pressing of Y button 261 Y, while step zoom is carried out in response to pressing of reduce icon Id1 or magnify icon Ic2. It is to be noted that these keys (hardware keys and software keys) are merely given as examples, and the keys for performing magnification or reduction may be other keys. For example, quick zoom may be performed in response to pressing of L button 261L or R button 261R, or may be performed in response to pressing of a predetermined icon (namely, a software key) provided in display area 241.
Upon acquisition of operation information, controller 310 of main device 300 identifies the operation indicated by the operation information (step S21). Then, controller 310 determines whether the identified operation is a magnifying operation (step S22). If the identified operation is not a magnifying operation, controller 310 executes a process corresponding to the identified operation (step S27). The process in step S27 may be a process of switching the displayed normal-size image page-by-page, for example.
Further, if the identified operation is a magnifying operation, controller 310 executes different processes depending on the operation. Specifically, controller 310 determines whether the magnifying operation is an operation for conducting quick zoom (i.e., operation of Y button 261Y) (step S23), and executes a process in accordance with the result of the determination.
If it is determined that an operation for quick zoom is performed, controller 310 reads out bitmap data that is stored in VRAM and that has not been subjected to the thinning process yet (i.e., bitmap data that has not been reduced), together with display position information representing a position of a portion of a normal-size image to be magnified and displayed (step S24), and, based on these data, generates image data and transmits the same (step S25). The process of step S25 is carried out in a manner similar to that of step S14, but differs in the point that the process of step S25 utilizes the display position information.
Display position information is information indicating which part of a normal-size image is to be magnified and displayed, and its initial value indicates a predetermined position (hereinafter, “initial position”). The initial position herein is a center of a normal-size image, though it may be an end portion of a normal-size image (e.g. an upper left end portion) or the like. As will be described later, display position information is changed as a result of scrolling of an image. Display position information is indicated by the coordinate of each of the vertices of a quadrangle corresponding to display area 241, for example, though it may be indicated by the coordinate of a specific vertex representing the vertices.
On the other hand, if it is determined that an operation for step zoom is performed, controller 310 regenerates bitmap data in accordance with a magnification by which the image is to be magnified (step S26). Namely, controller 310 again executes processes, such as rendering, based on the page data. Then, based on the regenerated bitmap data, controller 310 generates image data and transmits the same (step S25).
When a magnified image is displayed, it is possible, as shown in
The mode of display when step zoom is performed is similar to that when quick zoom is performed. However, in the case where step zoom is performed, reduce icon Id1 and magnify icon Ic2 may continue to be displayed. Further, it is preferred that the magnifications that can be adopted when step zoom is performed include magnifications other than the magnification for performing quick zoom (four times the normal-size image); for example, magnifications smaller than the magnification for quick zoom (1.2 times, 1.5 times, 2 times, etc.).
Since the magnified image is displayed as described in the foregoing, a user can view the magnified image in two ways. In the case where quick zoom is used, since the same data as the bitmap data used for displaying an image on monitor 100 is used, it is not necessary to execute processes for generating bitmap data (such as rendering) again, and therefore, it is possible to reduce the time required for displaying the image or the load on the hardware resources, as compared to the case where step zoom is used. On the other hand, when step zoom is used, a magnified image with a magnification not relying upon the number of pixels of the normal-size image can be displayed.
Furthermore, in this embodiment, it is possible to display a magnified image without requiring multiple presses or a long press of Y button 261 Y, and hence, the time required for starting display of a magnified image can be reduced, as compared to the case where these operations are required for performing magnified display. Thus, combined with the feature of not requiring processes such as rendering, quick zoom of the present embodiment can achieve quick display of the magnified image. Further, the combination of quick zoom and step zoom allows a user to use selectively quick display of a magnified image and display of a magnified image with a smaller magnification.
In this embodiment, the scroll operation can be achieved by the following three ways of operation; the first operation is a touch operation on display area 241, the second operation is an operation using slide pad 262, and the third operation is an operation of moving controller 200. The third operation is processed, for example, in such a manner that, when a user moves controller 200 leftward, the image displayed in display area 241 is caused to move rightward so that the left-hand image that has been hidden comes into view. It is to be noted that the third operation may include scrolling of an image in response to inclination of controller 200 or varying an amount of scroll of an image in accordance with the velocity and/or acceleration given to controller 200.
It is also to be noted that the scroll operation does not have to be achieved by three ways of operation, and may be achieved by only one or two ways. Further, if there are multiple ways of scroll operation, it is preferred that an order of priority of operations should be predetermined to avoid conflict between operations. In the present embodiment, the operation information of a touch operation on display area 241 is given top priority (i.e., the highest priority), and the motion information is given the lowest priority. In this case, when controller 310 acquires the operation information of a touch operation and the motion information, controller 310 processes the former with priority. For example, if the operation information of a touch operation indicates leftward scrolling while the motion information indicates rightward scrolling, controller 310 determines that leftward scrolling should be performed.
Upon acquisition of operation information, controller 310 of main device 300 identifies the operation indicated by the operation information (step S31). This step is performed in a manner similar to that in step S21 shown in
If it is determined that an operation other than the scroll operation is performed, controller 310 executes a process corresponding to this operation (step S36). The process executed in step S36 may include the process executed when the magnifying operation is performed (see
If the identified operation is a scroll operation, controller 310 determines the type of scroll operation. Specifically, controller 310 determines whether the acquired operation information includes the motion information generated by motion detection unit 270 (step S33). If the operation information includes the motion information, controller 310 determines further whether the operation information includes operation information indicating that ZL button 261ZL and ZR button 261ZR are pressed (step S34).
It is to be noted that, instead of the process of step S34, or in addition to the process of step S34, controller 310 may determine whether the amount of motion (amount of movement, extent of inclination) indicated by the acquired motion information is equal to or greater than a predetermined amount, and may proceed to the process of step S35 if the amount of motion is equal to or greater than the predetermined amount. Namely, an operation of pressing of ZL button 261ZL and ZR button 261ZR may be dispensable. In other words, detection of holding by holding detection unit 315 is not mandatory.
Controller 310 executes a scroll process in the case where the operation information does not include motion information or in the case where the operation information includes motion information and ZL button 261ZL and ZR button 261ZR are pressed (step S35). On the other hand, in the case where the operation information includes motion information but ZL button 261ZL or ZR button 261ZR is not pressed, controller 310 does not perform the scroll process, and disregards the motion information. Namely, in this embodiment, the scroll operation indicated by the motion information is made effective by pressing of ZL button 261ZL and ZR button 261ZR, and is ineffective if these buttons are not pressed.
If it is determined that quick zoom is being performed, controller 310 causes the currently displayed magnified image to be scrolled in accordance with the scroll operation performed by the user (step S352). Then, controller 310 updates the recorded display position information in accordance with movement of the magnified image resulting from the scrolling (step S353). Specifically, controller 310 records, as the display position information, the position of the displayed magnified information in the normal-size image.
It is to be noted that the display position information recorded in step S353 will be read out in the aforementioned step S24 when an operation for quick zoom is performed again. In this way, controller 310 retains the display position of the magnified image when the magnifying operation is terminated (i.e., when the operation for quick zoom is terminated), so that when the magnifying operation is performed again without the scroll operation being performed after the retention of the display position, the magnified image at the previous display position can be displayed.
On the other hand, if it is determined that quick zoom is not being performed, controller 310 causes the currently displayed normal-size image to be scrolled in accordance with the scroll operation performed by the user (step S354). When the display of the normal-size image itself is changed, controller 310 changes the display position information, such that the position of the magnified information reverts to the predetermined initial position (step S355). The initial position is a central portion of the currently displayed normal-size image, for example. Therefore, the initial position changes in accordance with the scrolling of the normal-size image. Namely, relative to the currently displayed normal-size image, the initial position is a fixed position, but relative to the whole of the normal-size image (including the portion not displayed currently), the initial position is not necessarily a fixed position. For this reason, controller 310 records the display information position as a coordinate in the normal-size image.
After causing the normal-size image or the magnified image to scroll as described in the foregoing, controller 310 determines whether the scroll operation is terminated (step S356), and repeats the process from step 5351 to S355 until the scroll operation is terminated. It is to be noted that, as is obvious from the description in
In
On the other hand, in
Since the scroll operation in this embodiment is performed as an operation independent of the magnifying operation, it is possible, for example, to start the magnifying operation while the scroll operation is performed, or to start the scroll operation while the magnifying operation is performed. Thus, the user can perform one of the two operations as necessary, irrespective of whether the other is being performed.
Further, the scroll operation of this embodiment requires pressing of ZL button 261ZL and ZR button 261ZR for the motion information generated by the motion detection unit 270 to be effective as the operation information indicating the scroll operation. Namely, ZL button 261ZL and ZR button 261ZR function as switches that can be pressed in this case, and only when the switches are on (pressed), scrolling of an image is carried out. As is described in the foregoing, when ZL button 261ZL and ZR button 261ZR are pressed using both hands, the user can hold controller 200 firmly, and thus, more precise motion information is acquired.
For example, if the user is allowed to operate controller 200 by a single hand, controller 200 tends to make an unintended motion (motion different from that intended for the scroll operation), and it becomes difficult to distinguish between the unintended motion and the motion for the scroll operation, which increases a possibility that unintended scrolling of an image is performed by the user. In contrast, if a rule is introduced that requires the user to press ZL button 261ZL and ZR button 261ZR when the scroll operation is performed, the user is prompted to hold controller 200 in a preferred way (see
An image (normal-size image or magnified image) is displayed on controller 200, as described in the foregoing. When an image is displayed on controller 200, controller 310 changes an image displayed on monitor 100, as required. In the case where a normal-size image is displayed on controller 200, a similar image is caused to be displayed on monitor 100. Namely, in this case, where a normal-size image is displayed on controller 200, controller 310 causes the image displayed on monitor 100 to change, following a change in the normal-size image. For example, when a scroll operation is performed in a state where a normal-size image is displayed, controller 310 causes the image on monitor 100 to scroll in accordance with scrolling of the normal-size image (step S354).
On the other hand, in the case where a magnified image is displayed on controller 200, controller 310 causes an image to be displayed on monitor 100 in a manner different from that when a normal-size image is displayed on controller 200. Specifically, controller 310 controls display of an image in a manner corresponding to the position of the magnified image (or frame image) relative to the image displayed on monitor 100.
In this process, controller 310 of main device 300 first causes a webpage image (display image) and a frame image to be displayed (step S41). Since controller 310 also conducts control for displaying an image on controller 200, controller 310 can specify the position of the image displayed on controller 200. Controller 310 specifies the position of the frame image by specifying the position of the image displayed on controller 200.
Then, controller 310 determines whether a scroll operation is performed via controller 200 (step S42). If it is found that the scroll operation is not performed, controller 310 terminates the process without causing the image to scroll. On the other hand, if it is found that the scroll operation is performed, controller 310 determines whether the frame image has reached the boundary of display area 101 in the direction in which the scroll operation is performed (step S43).
When the frame image has reached the boundary of display area 101, controller 310 determines whether scrolling is possible in the direction in which the scroll operation is performed (step S44). If further scrolling is not possible, such as when an end portion of the webpage is displayed in the display area 101, controller 310 terminates the process without causing the image to scroll. On the other hand, if further scrolling is possible, controller 310 causes the image displayed on monitor 100 to scroll in the direction in which the scroll operation is performed, so that an image other than the displayed image (i.e., a part of the image that has not been displayed up to this point) is displayed (step S45).
Further, if the frame image has not reached the boundary of display area 101, controller 310 causes the display position of the frame image to move without causing the webpage image displayed on monitor 100 to scroll (step S46). It is to be noted, however, that in this case also, scrolling of the image displayed on controller 200 is performed.
In the state shown in
In the state shown in
In this exemplary embodiment, the user can cause the image displayed on monitor 100 to scroll as required, by performing a scroll operation for scrolling the image displayed on controller 200. Further, the user can see the part of the image that is not displayed in display area 241 of controller 200 by viewing the display area 101 of monitor 100, and can know the positional relationship between the image displayed in display area 101 and the image displayed in display area 241 by referring to the frame image.
The exemplary embodiment described in the foregoing is one embodiment for carrying out the present invention. The present invention is not limited to the exemplary embodiment, and can be carried out in other embodiments, as shown by the following modifications. It is to be noted that multiple modifications may be combined as required in carrying out the invention.
In the present invention, a magnifying operation does not have to be performed to switch the operation mode when an image is displayed. It is also possible to set the operation mode in advance before an image is displayed. In this case, if the “magnifying mode” is set as the operation mode, the user can cause a magnified image (partial image) to be displayed on controller 100 as a default setting, without performing a magnifying operation.
The configuration corresponding to holding detection unit 315 may be provided to controller 200, instead of main device 300. In this case, controller 200 may transmit data, such as a flag, that indicates detection of holding by the user to main device 300, though it is also possible that controller 200 transmits motion information to main device 300 when it detects holding by the user, and does not do so when holding by the user is not detected.
Display area 101 of monitor 100 does not have to be larger than display area 241 of controller 200, and may be the same size as or smaller than display area 241. Further, the device (first display) corresponding to monitor 100 and the device (second display) corresponding to controller 200 may be connected to each other by wire, so long as they are configured as separate bodies.
In the state where an unmagnified or magnified image is displayed in display area 241, the user can select an operation object displayed in display area 241. In other words, main device 300 can receive an operation for selecting an operation object in each of the state where the magnifying operation is being performed and the state where the magnifying operation is not being performed. The user may select an operation object by touching display area 241, though the user may select an operation object by performing another operation. For example, cross button 261D and A button 261A of controller 200 may be used as keys for selecting an operation object.
As a method for selecting an operation object using cross button 261D and A button 261 A, for example, cross button 261 D is used to switch a selection candidate among the operation objects, and A button 261A is used to select the selection candidate (namely, to confirm the operation object to be selected).
On the other hand,
As is described in the foregoing, in the case where the magnifying operation is performed the first selection candidate may be different from that in the case where the magnifying operation is not performed. Further, the number of operation objects that can be selected may also be different. Therefore, in some cases, by performing the magnifying operation to cause a magnified image to be displayed, the user can select a desired operation object by carrying out fewer operations. For example, the minimum number of pressing operations of cross button 261D required for selecting icon “K” when the magnified image is displayed as shown in
In this example, cross button 261D may also be used for performing the scroll operation. For example, it is possible that, when the user instructs “upward” using cross button 261D in the state shown in
Like image Im12 shown in
Namely, the normal-size image displayed in display area 241 does not have to have the same magnification (or the same size) as that of the image displayed in display area 101 of monitor 100. The term “unmagnified” of the normal-size image means that the image is unmagnified compared to a magnified image, and does not refer to comparison with the image displayed on monitor 100. It is to be noted that the magnification of the displayed image is represented relative to the normal-size image displayed on controller 200, though it is also possible to represent the magnification relative to the image displayed on monitor 100.
Main device 300 may magnify not only the image displayed on controller 200 but also the image displayed on monitor 100, as required. For example, in response to a magnifying operation, main device 300 may magnify the image displayed on monitor 100 in accordance with the image displayed on controller 200.
The operation that causes the position indicated by the display position information to revert to the initial position is not limited to the scroll operation. For example, controller 310 may cause the position indicated by the display position information to revert to the initial position in such cases as when an operation object such as a hyperlink is selected or when an icon displayed in menu images Im22 and Im23 is selected.
The present invention does not have to be carried out in main device 300, an information-processing system including main device 300 and controller 200, or an information-processing system (display system 10) further including monitor 100, but also may be carried out in a device including integrally a configuration corresponding to main device 300 and a configuration corresponding to controller 200. Alternatively, the present invention may be configured such that part or all of the control relating to the present invention (namely, control such as that performed by first display controller 311 and second display controller 312) is performed by monitor 100 and controller 200, or may be configured such that the display control for the devices is performed by each device, whereby a configuration corresponding to main device 300 is omitted. Furthermore, the device of the present invention does not have to be of a shape to be held with both hands, but may be of such a shape that it is to be held with a single hand, or may be adapted to be placed on a desk or the like when operated. The controller of the present invention does not have to have a game function.
Further, the present invention may be carried out not only as a controller or an information-processing system as described in the foregoing, but also as an image-displaying method for causing a device to display a magnified image (partial image) or an information-processing program for executing such an image-displaying method. Furthermore, the information-processing program of the present invention may be stored in a storage medium such as an optical disk or a semiconductor memory, or may be downloaded to an information-processing device via a network such as the Internet.
The foregoing description of the embodiments of the present invention is provided for purposes of illustration and description, and is in no way to be taken as either exhaustive or specifically limitative of the present invention; and it will be obvious to those skilled in the art that a wide range of modifications and variations can be applied to the invention described in the exemplified embodiments, with such embodiments having been chosen merely with a view to providing a clear explanation of the principles of the present invention and its range of practical application, thereby to enable others skilled in the art to understand the invention in the context of a variety of embodiments, which can be adopted in the scope of the invention so as to best suit a contemplated use. The scope of the invention is intended to be defined by the claims that follow and equivalents thereof.
Number | Date | Country | Kind |
---|---|---|---|
2011-285972 | Dec 2011 | JP | national |
2012-039058 | Feb 2012 | JP | national |