This application claims the benefit of Japanese Priority Patent Application JP 2017-027642 filed Feb. 17, 2017, the entire contents of which are incorporated herein by reference.
The present disclosure relates to an information processing system, an information processing method, and a program.
In the past, touch panels capable of detecting the contact or proximity of a user's finger with respect to a display screen have been developed.
For example, JP 2004-272835A describes a technology in which, when a user performs a gesture of drawing a rectangle or circle with a finger, pen, or the like, the size of a window is prescribed according to the size of the gesture.
However, in the technology described in Patent Literature 1, no consideration is given for displaying a window by switching the display mode of the window to an enlarged display mode by an appropriate method.
Accordingly, the present disclosure proposes a new and improved information processing system, information processing method, and program capable of appropriately deciding the direction of a display object when the display mode of the display object is switched to an enlarged display mode.
According to the present disclosure, there is provided an information processing system including: an acquisition unit configured to acquire direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen; and a decision unit configured to decide, on a basis of the direction information, a direction of the display object with respect to the display screen when a display mode of the display object is switched to an enlarged display mode, in which the rotational angle of the display object is different from a rotational angle of the display screen.
Also, according to the present disclosure, there is provided an information processing method including: acquiring direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen; and deciding, by a processor, on a basis of the direction information, a direction of the display object with respect to the display screen when a display mode of the display object is switched to an enlarged display mode, in which the rotational angle of the display object is different from a rotational angle of the display screen.
Also, according to the present disclosure, there is provided a program causing a computer to function as: an acquisition unit configured to acquire direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen; and a decision unit configured to decide, on a basis of the direction information, a direction of the display object with respect to the display screen when a display mode of the display object is switched to an enlarged display mode, in which the rotational angle of the display object is different from a rotational angle of the display screen.
According to the present disclosure as described above, the direction of a display object can be decided appropriately when the display mode of the display object is switched to an enlarged display mode. Note that the advantageous effect described herein is not necessarily limited, and may also be any of the advantageous effects described in this disclosure.
Hereinafter, (a) preferred embodiment(s) of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
Also, in this specification and the appended drawings, multiple component elements having substantially the same functional configuration may in some cases be distinguished by different letters appended to the same sign. For example, multiple components having substantially the same functional configuration are distinguished like the window 30a and the window 30b as appropriate. On the other hand, when it is not necessary to particularly distinguish each of multiple component elements having substantially the same functional configuration, only the same sign will be given. For example, the window 30a and the window 30b will be simply designated the window 30 when not being particularly distinguished.
In addition, the detailed description of the embodiments in this section will be given in the order indicated below.
1. Configuration of information processing system
2. Detailed description of embodiment
3. Hardware configuration
4. Modifications
First, an exemplary configuration of the information processing system 10 according to an embodiment of the present disclosure will be described. FIG, 1 is an explanatory diagram illustrating an exemplary configuration of the information processing system 10 according to an embodiment of the present disclosure. Note that in this specification, a system may mean a configuration for executing predetermined processes. A system may include a single device, or may include multiple devices. Also, it is sufficient for the information processing system 10 according to the present embodiment to be configured to be capable of executing predetermined processes as the information processing system 10 as a whole, and which components inside the information processing system 10 are to be treated as a single device may be arbitrary.
Referring to
The display unit 124a displays various types of information on top of a table 90a. The display unit 124a may be a projection unit (projector). For example, as illustrated in
Although details will be described later, the information processing system 10a may include multiple applications 200. In this case, the display unit 124a, under control by each of the multiple applications 200, is able to display display objects corresponding to each of the applications 200. Herein, display objects are windows or UI objects, for example. A UI object is one example of an operation object in the present disclosure. A UI object is, for example, a predetermined image (still image or moving image) that accepts various operations (such as selection and input) by a user. For example, a UI object is an image that includes a graphical user interface (GUI) part (such as a button, slider, checkbox, text box, or software keyboard, for example). Also, UI objects may be arranged inside a window.
Meanwhile, publicly known window systems are designed under the presupposition of basically being operated from the front direction of the screen, as illustrated in
On the other hand, in the information processing system 10a according to the present embodiment, display objects (for example, windows 30) corresponding to individual applications 200 can be displayed on the display unit 124 at arbitrary rotational angles with respect to a reference angle for the screen 20, as illustrated in
The sensor unit 122a includes, for example, a camera that images the table 90a with a single lens, or a stereo camera capable of imaging the table 90a with two lenses and recording information in the depth direction. For the stereo camera, a visible light camera, an infrared camera, or the like may be used, for example. Also, the sensor unit 122a additionally may include a sound input device such as a microphone that picks up speech uttered by users, or environmental sounds from the surrounding environment.
In the case in which the camera images the table 90a with a single lens as the sensor unit 122a, the information processing system 10a is able to analyze an image taken by the camera (taken image), and thereby detect the position of an object (such as a users hand, for example) positioned on the screen 20. Also, in the case in which a stereo camera is used as the sensor unit 122a, the information processing system 10a is able to analyze a taken image taken by the stereo camera, and thereby acquire position information regarding an object positioned on the screen 20, as well as depth information regarding the object. On the basis of the depth information, the information processing system 10a becomes able to detect the contact or proximity of a user's hand on the screen 20 in the height direction, and the removal of the hand from the screen 20. Note that in the following description, the user causing an operating body (such as the users hand, for example) to contact or come into proximity of the screen 20 will also be collectively referred to simply as “contact”. Note that the sensor unit 122a may also include a depth sensor instead of the stereo camera. In this case, the depth sensor is capable of acquiring depth information regarding an object positioned on the screen 20.
In the present embodiment, on the basis of a taken image taken by the sensor unit 122a, the position of an operating body on the screen 20 is detected, and in addition, various types of information is input on the basis of the detected position of the operating body. In other words, the user is able to perform various types of operation input by moving the operating body over the screen 20. For example, by detecting the contact of the user's hand with respect to the window 30 or a UI object, operation input with respect to the window 30 or the UI object is performed. Note that in the following description, an example in which the operating body is a user's hand is described as an example, but the operating body is not limited to such an example, and may be any of various types of operating members, such as a stylus.
Additionally, the camera included in the sensor unit 122a may not only photograph the top face of the table 90a, but also photograph users present around the table 90a. In this case, the information processing system 10a is able to detect the positions of users around the table 90a on the basis of a taken image taken by the sensor unit 122a. Also, on the basis of a taken image, the information processing system 10a may extract physical features (such as face and body size) by which individual users may be specified, and thereby perform personal recognition of users.
Note that operation input of a user may also be executed by another method, without being limited to the example described above. For example, the sensor unit 122a may also be installed as a touch panel on the top face (screen 20a) of the table 90a, and in addition, operation input of a user may be detected by the contact of the user's finger or the like with respect to the touch panel. Additionally, operation input of a user may also be detected by a gesture with respect to a camera included in the sensor unit 122a.
The above describes a configuration of the information processing system 10a according to the present embodiment. Note that the configuration of the information processing system according to the present embodiment is not limited. to the example illustrated in
Also, in the example illustrated in
The above describes another exemplary configuration of the information processing system according to the present embodiment. By the way, it is also desired for the window 30 projected onto the screen 20 to be displayed in full screen on the screen 20. However, with the publicly known technology, the window 30 is displayed in full screen without changing the current direction of the window 30 with respect to the screen 20. For this reason, if the window 30 is displayed in full screen while still being rotated with respect to the screen 20, as illustrated in
Accordingly, focusing on the above circumstances led to the creation of the information processing system 10 according to the present embodiment. The information processing system 10 is capable of acquiring direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen, and in addition, is capable of deciding, on the basis of the direction information, the direction of the display object with respect to the display screen when a. display mode of the display object is switched to an enlarged display mode. With this arrangement, the direction of the display object can be decided appropriately when the display mode of the display object is switched to the enlarged display mode.
Herein, the reference angle for the display screen is an internal (logical or relative) reference angle of software included in the information processing system 10, and may be an angle with respect to an “x-axis” as a reference (for example, 0 degrees with respect to the x-axis). Also, the rotational angle of the display object may be the angle from the x-axis of the display object with respect to the reference angle for the display screen (in other words, the reference angle in software). In other words, each of the “reference angle for the display screen” and the “rotational angle of the display object” is invariable, even if the display unit 124a (such as a projector) illustrated in
Also, in the present embodiment, a rotational angle of the display screen may mean an angle in physical space of the entire projection region projected or displayed on the screen 20. For example, the rotational angle of the display screen is the rotational angle of the display unit 124a (such as a projector), the physical rotational angle of the display unit 124c (touch display) illustrated in
Also, the display mode includes a normal display mode and an enlarged display mode. The normal display mode may be a mode in which multiple display objects are displayed typically. Also, in the normal display mode, the display objects may be displayed at least smaller than during the enlarged display mode. Note that in the normal display mode, only a single display object may also be displayed.
Also, the enlarged display mode may be a mode in which the display object is displayed on the display screen larger than in the normal display mode. For example, the enlarged display mode includes a full screen mode. Alternatively, in the enlarged display mode, the display object displayed enlarged may also be displayed on the display screen at a size smaller than full screen. Also, in this case, other display objects may also be displayed in the leftover portions (that is, the portions where the display object is not being displayed).
Next, a functional configuration according to the present embodiment will be described in detail.
The platform unit 100 may include one or multiple processing circuits (such as the central processing unit (CPU) 150 described later, for example). The platform unit 100 centrally controls the operation of the information processing system 10. For example, the platform unit 100 uses the one or multiple processing circuits to realize the functions of an operating system (OS), middleware, and the like related to the information processing system 10. Also, as illustrated in
The acquisition unit 102 receives, or acquires by performing a readout process or the like, direction information related to the window 30 projected onto the screen 20 by the display unit 124. For example, the acquisition unit 102 acquires direction information related to the window 30 whose display mode is switched from the normal display mode to the full screen display mode among all windows 30 projected onto the screen 20 by the display unit 124. Herein, the direction information may indicate the current direction of the window 30 with respect to the screen 20.
Alternatively, the direction information may indicate the direction in which a user (for example, a user who performs an operation on the window 30) is positioned with respect to the screen 20. In this case, for example, the acquisition unit 102 acquires the direction information on the basis of a sensing result by the sensor unit 122. As an example, the acquisition unit 102 first acquires an image photographed by the sensor unit 122 as sensor data from the sensor unit 122 by receiving or performing a readout process or the like. Next, by performing image recognition on the image, the acquisition unit 102 recognizes the direction in which the user's hand (arm) is extended with respect to the screen 20, for example. Subsequently, the acquisition unit 102 acquires the recognized result as the direction information.
Alternatively, in the case in which the camera is capable of photographing even the surroundings of the screen 20, by performing image recognition with respect to the image photographed by the camera, the acquisition unit 102 may recognize individual users positioned around the screen 20 (such as each user who performs operations on the window 30, for example), and in addition, acquire the recognized result as the direction information. In this case, the direction information may indicate the directions in which individual users are positioned with respect to the screen 20, or the direction in which most users are positioned with respect to the screen 20.
Note that the image recognition may also be performed by the sensor unit 122 instead of the acquisition unit 102. Alternatively, via a communication network 54, the image may be transmitted to an external device (such as a server) able to communicate with the communication unit 120, and in addition, the external device may perform image recognition with respect to the image. In this case, the acquisition unit 102 may acquire a result of image recognition from the external device. Herein, the communication network 54 may include the Internet, any of various types of local area networks (LANs), and the like, for example.
The decision unit 104 decides the direction and size of the window 30 with respect to the screen 20 when the display mode of the window 30 projected onto the screen 20 is switched from the normal display anode to the full screen display mode, on the basis of the direction information acquired by the acquisition unit 102, and information related to the screen 20. Herein, the information related to the screen 20 includes the shape and size of the screen 20, for example. For example, the decision unit 104 decides the size of the window 30 when the display mode of the window 30 is switched from the normal display mode to the full screen display mode to be a value appropriate to the size of the screen 20.
Hereinafter, a decision example of deciding the direction and size of the window 30 when the display mode is switched to a full screen display mode will be described in further detail, For example, the decision unit 104 decides the direction and size of the window 30 with respect to the screen 20 when the display mode of the window 30 projected onto the screen 20 is switched to the full screen display mode, on the basis of the current direction of the window 30 with respect to the screen 20 (indicated by the direction information acquired by the acquisition unit 102). As one example, on the basis of the direction information, the decision unit 104 decides the direction of the window 30 with respect to the screen 20 in the full screen display mode to be a direction in units of 90 degrees (for example, a value rounded to units of 90 degrees). More specifically, in the case in which the current rotational angle of the window 30 is “equal to or greater than −45 degrees, but less than 45 degrees”, the decision unit 104 decides the rotational angle of the window 30 when the display mode is switched to the full screen display mode to be “0 degrees”. Also, in the case in which the current rotational angle of the window 30 is “equal to or greater than 45 degrees, but less than 135 degrees”, the decision unit 104 decides the rotational angle of the window 30 when the display mode is switched to the full screen display mode to be “90 degrees”. Also, in the case in which the current rotational angle of the window 30 is “equal to or greater than 135 degrees, but less than 225 degrees”, the decision unit 104 decides the rotational angle of the window 30 when the display mode is switched to the full screen display mode to be “180 degrees”. Also, in the case in which the current rotational angle of the window 30 is “equal to or greater than 225 degrees, but less than 315 degrees”, the decision unit 104 decides the rotational angle of the window 30 when the display mode is switched to the full screen display mode to be “270 degrees”. According to these decision examples, in the case in which the screen 20 is rectangular, for example, inconsistencies are not produced between the shape of the screen 20 and the shape of the window 30 during full screen display.
At this point, the above function will be described in further detail with reference to
Also,
Also,
Alternatively, as illustrated in
Alternatively, in the case in which the application 200 corresponding to the window 30 supports displaying the window 30 with a rectangular layout, as illustrated in
Also,
In this case, when the display mode of the window 30a is switched from the normal display mode to the full screen display mode, as illustrated in
Alternatively, in the case in which the application 200 corresponding to the window 30 supports displaying the window 30 with a non-rectangular layout, as illustrated in
Also, the decision unit 104 is also capable of deciding the direction and size of the window 30 with respect to the screen 20 when the display mode of the window 30 projected onto the screen 20 is switched from the normal display mode to the full screen display mode, on the basis of a direction in which users are positioned with respect to the screen, which is indicated by the direction information acquired by the acquisition unit 102. At this point, the above function will be described in further detail with reference to
For example, as illustrated in
Alternatively, as illustrated in
Also, the decision unit 104 is also capable of deciding the direction and size of the window 30 when the display mode of the window 30 projected onto the screen 20 is switched from the normal display mode to the full screen display mode, on the basis of a specification result regarding the presence or absence of an object on the screen 20 by the specification unit 106 described later. For example, the decision unit 104 decides the direction and size of the window 30 when the display mode of the window 30 is switched to the full screen display mode in accordance with a region other than the region of an object placed on the screen 20, which is specified by the specification unit 106.
At this point, the above function will be described with reference to
Note that, as illustrated in
Alternatively, in the example illustrated in
Note that although the above description describes an example of deciding the rotational angle of the window 30 with respect to the screen 20 when the display mode of the window 30 is switched to the full screen display mode to be a value obtained by rounding the current rotational angle of the window 30 to units of 90 degrees, the configuration is not limited to such an example. As a modification, the decision unit 104 may also decide the rotational angle of the window 30 when the display mode is switched to the full screen display mode to be a value obtained by rounding the rotational angle of the window 30 during the normal display mode to units of 180 degrees. In this case, since the shape of the window 30 during full screen display (such as the numbers of vertical and horizontal pixels, for example) becomes constant, the implementation of the platform unit 100 can be simplified, for example.
Also, as another modification, the rotational angle of the window 30 with respect to the screen 20 when the window 30 is displayed in full screen may also be changeable by a user on demand. For example, the rotational angle of the window 30 during full screen display may be changeable by a user with an operation on a predetermined GUI projected in association with the window 30, a gesture (such as a touch operation), a speech command, or the like.
Also, When the display mode of the window 30 is switched (reverted) from full screen mode to normal display mode, the decision unit 104 is capable of changing each of the direction and the size of the window 30 with respect to the screen 20 to the direction and the size of the window 30 from immediately before being switched to the full screen display mode. For example, when the display mode of the window 30 is switched from the full screen display mode to the normal display mode, the decision unit 104 first decides the direction of the window 30 after switching to be the direction of the window 30 with respect to the screen 20 from immediately before being switched to the full screen display mode, which is stored in the storage unit 126 described later. Furthermore, the decision unit 104 decides the size of the window 30 after switching to be the size of the window 30 from immediately before being switched to the full screen display mode, which is stored in the storage unit 126.
Note that, as described earlier, the window 30 may include at least one UI object 32. In this case, when the display mode of the window 30 is switched from the normal display mode to the full screen display mode, the entire window 30 may be displayed in full screen as illustrated in
Also, the display modes of the window 30 additionally may include a full window display mode (in addition to the normal display mode and the full screen display mode). Herein, the full window display mode is a display mode in which, in the case in which the window 30 includes at least one UI object 32, one of the at least one UI objects 32 is displayed enlarged up to a size inscribed in the current window 30.
For example, when a UI object 32 included in the 30a as illustrated in
Note that when the display mode of the window 30 is switched from the normal display mode to the full window display mode, as illustrated in
Note that whether or not the display modes of individual windows 30 are switchable to the full window display mode may also be predetermined for each application 200 corresponding to the windows 30. Alternatively, for each window 30, whether or not the display mode is switchable to the full window display mode may be changeable on demand by a user. Note that while the display mode of the window 30 is the full window display mode, the display mode may also be switchable (from the full window display mode) to either of the normal display mode and the full screen display mode.
The specification unit 106 specifies the presence or absence of an object placed on the screen 20, on the basis of a sensing result with respect to the screen 20. Furthermore, in the case of recognizing that an object is present, the specification unit 106 specifies a region in which the object is placed on the screen 20, on the basis of the sensing result. For example, on the basis of a result of image recognition (including object recognition) with respect to an image in which the screen 20 is imaged, a result of sensing with respect to the screen 20, or the like, the specification unit 106 specifies the presence or absence of an object on the screen 20, and in the case of recognizing that an object is present, specifies the region in which the object is placed on the screen 20.
Note that the image recognition may be performed by the specification unit 106, or by the sensor unit 122. Alternatively, via a communication network 54, the image may be transmitted to an external device (such as a server) able to communicate with the communication unit 120, and in addition, the external device may perform image recognition with respect to the image. In this case, the specification unit 106 may acquire a result of image recognition from the external device.
The display control unit 108 controls the projection by the display unit 124. For example, the display control unit 108 causes the display unit 124 to project a display object onto the screen 20, with the direction of the display object decided by the decision unit 104. As an example, when the display mode of the window 30 is switched from the normal display mode to the full screen display mode, and when the display mode of the window 30 is switched from the full screen display mode to the normal display mode, the display control unit 108 updates the display content with respect to the screen 20 as a whole, and additionally causes the display unit 124 to project the updated display content.
When the display mode of the window 30 is switched from the normal display mode to the full screen display mode, the output unit 110 outputs the size of the window 30 after switching to the application 200 corresponding to the window 30. At this time, the output unit 110 additionally may output the direction (such as the rotational angle) of the window 30 after switching to the application 200 corresponding to the window 30.
Also, when the display mode of the window 30 is switched from the full screen display mode to the normal display mode, the output unit 110 outputs the size of the window 30 after switching to the application 200 corresponding to the window 30. At this time, the output unit 110 additionally may output the direction of the window 30 after switching to the application 200 corresponding to the window 30.
The communication unit 120 transmits and receives information to and from an external device through the communication network 54, for example.
The storage unit 126 stores various types of data and various types of software. For example, the storage unit 126 stores the position of the window 30 on the screen 20, the direction of the window 30 with respect to the screen 20, and the size of the window 30 from immediately before when the display mode of the window 30 is switched from the normal display mode to the full screen display mode (for example, until the display mode of the window 30 is reverted to the normal display mode).
The application 200 performs a process of drawing at least one window 30 corresponding to the application 200. For example, when the display mode of the window 30 is switched from the normal display mode to the full screen display mode, the application 200 corresponding to the window 30 changes the layout of the window 30 to conform to the size of the window 30 during the full screen display mode output by the output unit 110, and additionally updates the drawing of the window 30. Also, when the display mode of the window 30 is switched from the full screen display mode to the normal display mode, the application 200 corresponding to the window 30 changes the layout of the window 30 to conform to the size of the window 30 during the normal display mode output by the output unit 110, and additionally updates the drawing of the window 30.
Note that the application 200 may also be processed by a processor or the like different from the display control unit 108 (or the decision unit 104). Alternatively, in the case in which the display control unit 108 (or the decision unit 104) is capable of executing processes other than the processes for acting as the platform unit 100, the display control unit 108 (or the decision unit 104) may execute the processes of the application 200.
The above describes a functional configuration according to the present embodiment. Next, process flows according to the present embodiment will be described in “2-2-1. Flow of processes when switching from normal display to enlarged display” and “2-2-2. Flow of processes when switching from full screen display to normal display”.
First, a “flow of processes when switching from a normal display to an enlarged display” will be described with reference to
As illustrated in
After that, the application 200 corresponding to the window 30 requests the platform unit 100 to switch the window 30 to the full screen display (or the full window display mode). For example, the application 200 calls an application programming interface (API) for requesting the platform unit 100 to switch the window 30 to the full screen display (or the full window display mode) (S103).
After that, the decision unit 104 of the platform unit 100 confirms whether or not a window lock mode associated with the window 30 is on (S105). In the case in which the window lock mode is on (S105: Yes), first, the decision unit 104 decides to switch the display mode of the window 30 to the full window display mode (S107). Subsequently, the decision unit 104 decides the size of the window 30 after switching to be the size of the window 30 during the normal display mode (S109). After that, the platform unit 100 performs the process of S115 described later.
On the other hand, in the case in which the window lock mode is off (S105: No), the decision unit 104 decides to switch the display mode of the window 30 to the full screen display mode (S111). Subsequently, the decision unit 104 performs the “process of deciding the display direction/size during full screen display” described later (S113).
Next, the output unit 110 outputs the size of the window 30 after the switching of the display mode decided in S109 or S113 to the application 200 (S115).
After that, the application 200 changes the layout of the window 30 on the basis of the size input in S115, and in addition, updates the drawing of the window 30 (S117). Subsequently. the application 200 notifies the platform unit 100 of the completion of processing (S119).
After that, the display control unit 108 of the platform unit 100 updates the drawing with respect to the screen 20 as a whole, and in addition, causes the display unit 124 to project the updated display content (S121).
Herein, the flow of the “process of deciding the display direction/size during full screen display” in S113 will be described in detail with reference to
Next, the decision unit 104 sets the title bar and window frame of the window 30 to outside the drawing target during full screen display (S153).
Next, the decision unit 104 sets the position of the window 30 when the display mode is switched to the full screen display mode to the origin (0, 0) (S155).
Next, the decision unit 104 decides the rotational angle of the window 30 with respect to the screen 20 when the display mode is switched to the full screen display mode to be a value obtained by rounding the current rotational angle to units of 90 degrees (S157).
Next, the decision unit 104 determines whether or not the rotational angle decided in S157 is “90 degrees” or “270 degrees” (S159). In the case in which the decided rotational angle is “90 degrees” or “270 degrees” (S159: Yes), the decision unit 104 decides the size of the window 30 when the display mode is switched to the full screen display mode to be a size that is the horizontal and vertical inverse of the screen 20 (S161). Subsequently, the process ends.
In the case in which the decided rotational angle is not “90 degrees” or “270 degrees” (that is, in the case of “0 degrees” or “180 degrees”) (S159: No), the decision unit 104 decides the size of the window 30 when the display mode is switched to the full screen display mode to be the same size as the size of the screen 20 (S163). Subsequently, the process ends.
Next, the “flow of processes when switching from the full screen display to the normal display” will be described with reference to
As illustrated in
After that, the application 200 corresponding to the window 30 requests the platform unit 100 to switch the display mode of the window 30 from the full screen display mode to the normal display mode. For example, the application 200 calls an API for requesting the platform unit 100 to cancel the full screen display of the window 30 (S203).
After that, the platform unit 100 performs a “process of canceling the full screen display” described later (S205).
Next, the output unit 110 of the platform unit 100 outputs the size of the window 30 decided in S205 to the application 200 (S207).
After that, the application 200 changes the layout of the window 30 on the basis of the size input in S207, and in addition, updates the drawing of the window 30 (S209). Subsequently, the application 200 notifies the platform unit 100 of the completion of processing (S211).
After that, the platform unit 100 updates the drawing with respect to the screen 20 as a whole, and in addition, causes the display unit 124 to project the updated display content (S213).
Herein, the flow of the “process of canceling the full screen display” in S205 will be described in detail with reference to
Next, the decision unit 104 decides the size of the window 30 when the display mode is switched from the full screen display mode to the normal display mode to be the size of the window 30 (from immediately before the display mode is switched to the full screen display mode) which is stored in the storage unit 126 (S253).
Next, the decision unit 104 decides the position of the window 30 on the screen 20 when the display mode is switched from the full screen display mode to the normal display mode to be the position of the window 30 (from immediately before the display mode is switched to the full screen display mode) which is stored in the storage unit 126 (S255).
After that, the decision unit 104 decides to cause the window 30 to be displayed with the addition of the title bar and the window frame when the display mode is switched from the full screen display mode to the normal display mode (S257).
As described above, the platform unit 100 according to the present embodiment acquires direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen, and in addition, decides, on the basis of the direction information, the direction of the display object with respect to the display screen when the display mode of the display object is switched to an enlarged display mode. For this reason, the direction of the display object can be decided appropriately when the display mode of the display object is switched to the enlarged display mode.
For example, even in the case in which the window 30 is displayed in full screen while still being rotated with respect to the screen 20, the window 30 can be displayed in full screen on the screen 20 to match the size of the screen 20. Also, the platform unit 100 can realize full screen display of the window 30 that conforms to the shape of the screen 20 and the characteristics of the equipment. Consequently, the usefulness of the equipment can be improved.
Also, according to the present embodiment, for example, the direction and size of the window 30 when the display mode is switched to the full screen display mode are decided not by the application 200, but by the platform unit 100 In other words, it is not necessary that the application 200 judge whether or not the equipment enables omnidirectional operations. For this reason, it is not necessary to build in special functions in the application 200. Consequently, excess costs are not imposed on the creation of the application 200.
Also, for similar reasons, in the information processing system 10, existing applications 200 can be utilized as-is. Furthermore, even in the case in which equipment of a new form appears in the future, since the platform unit 100 can correct the direction and size (during full screen display) according to the form of the equipment, there is an advantage in that it is not necessary to correct existing applications 200.
Next, a hardware configuration of the information processing system 10 according to the present embodiment is described with reference to
The CPU 150 functions as a computational processing device and a control device, and controls the overall operation in the information processing system 10 in accordance with various programs. In addition, the CPU 150 realizes the function of the platform unit 100 in the information processing system 10. Moreover, the CPU 150 includes a processor such as a microprocessor.
The ROM 152 stores programs and data for control and the like such as operation parameters, which are used by the CPU 150.
The RAM 154 temporarily stores, for example, programs and the like executed by the CPU 150.
The bus 156 includes a CPU bus and the like. This bus 156 connects the CPU 150, the ROM 152, and the RAM 154 to each other.
The interface 158 connects the bus 156 to the input device 160, the output device 162, the storage device 164, and the communication device 166.
The input device 160 includes, for example, an input mechanism for a user to input information, such as a touch panel, a button, a switch, a dial, a lever, or a microphone, an input control circuit, which generates an input signal on the basis of the input by the user and outputs the input signal to the CPU 150, and the like.
The output device 162 includes, for example, a display device such as a projector, a liquid crystal display device, an organic light emitting diode (OLED) device, or a lamp. In addition, the output device 162 includes an audio output device such as a speaker. The output device 162 can realize the function of the display unit 124 in in the information processing system 10.
The storage device 164 is a device for data storage. The storage device 164 includes, for example, a storage medium, a recording device that records data in the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded in the storage medium, or the like. This storage device 164 can realize the function of the storage unit 126 in the information processing system 10.
The communication device 166 is a communication interface including, for example, a communication device or the like for connection to the communication network 54. In addition, the communication device 166 may be a wireless LAN compatible communication device, a Long-Term Evolution (LTE) compatible communication device, or a wire communication device that performs wired communication. This communication device 166 can realize the function of the communication unit 120 in the information processing system 10.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
For example, the foregoing embodiment describes an example in which the projection target in the present disclosure is the screen 20, but the configuration is not limited to such an example. The projection target may also be a solid body that acts as the target of projection by the display unit 124.
Also, the foregoing embodiment describes an example in which the display unit 124 projects an image onto the screen 20, but the configuration is not limited thereto. For example, as illustrated in
Also, in the case in which the display unit 124 is a head-mounted (for example, an eyewear-style or the like) display, the display unit 124 may be a transmissive display or a non-transmissive display. In the latter case, a picture of the front of the display unit 124 may be projected by a camera attached to the display unit 124. In addition, the platform unit 100 or each application 200 may cause the display unit 124 to display display objects superimposed onto the image photographed by the camera.
Also, as another modification, as illustrated in
Also, a device (information processing device) including the platform unit 100 according to the present embodiment may also include one or more of the communication unit 120, the sensor unit 122, and the display unit 124. For example, the information processing device may be a projector unit that includes the platform unit 100 and the display unit 124 (projection unit).
Alternatively, the information processing device may be configured in an integrated manner with the table 90. Alternatively, the information processing device may be a device connected via the communication network 54, for example, to at least one of the communication unit 120, the sensor unit 122, and the display unit 124. For example, the information processing device may be a server, a general-purpose personal computer (PC), a tablet-style terminal, a game console, a mobile phone such as a smartphone, a portable music player, a wearable device such as a head-mounted display (HMD), augmented reality (AR) glasses, or a smartwatch, for example, or a robot.
Also, the application 200 may be implemented inside the information processing device, or may be implemented inside a different device capable of communicating with the information processing device.
Further, the steps in the processing procedure described above are not necessarily to be executed in the described order. For example, the steps may be executed in the order changed as appropriate. In addition, the steps may be executed in parallel or individually in part, instead of being executed in chronological order. In addition, some of the steps described may be omitted, or an additional step may be added.
Further, according to the above-described embodiments, a computer program for causing hardware such as the CPU 150, the ROM 152, and the RAM 154 to execute the function equivalent to the function of each configuration of the information processing system 10 (in particular, the platform unit 100) according to the embodiment described above can be provided. in addition, a recording medium in which the computer program is recorded is provided.
Further, the effects described in this specification are merely illustrative or exemplified effects, and are not limitative. That is, with or in the place of the above effects, the technology according to the present disclosure may achieve other effects that are clear to those skilled in the art from the description of this specification.
Additionally, the present technology may also be configured as below.
(1) An information processing system including:
an acquisition unit configured to acquire direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen; and
a decision unit configured to decide, on a basis of the direction information, a direction of the display object with respect to the display screen when a display mode of the display object is switched to an enlarged display mode, in which
the rotational angle of the display object is different from a rotational angle of the display screen.
(2) The information processing system according to (1), in which
the display object is projected by a. projection unit onto a projection target that includes the display screen.
(3) The information processing system according to (2), in which
the display object is a window.
(4) The information processing system according to (2), in which
the display object is an operation object included in a window.
(5) The information processing system according to any one of (2) to (4), in which
at least two display objects are projected by the projection unit onto the projection target, and
the respective directions of the at least two display objects with respect to the projection target are different from each other.
(6) The information processing system according to any one of (2) to (5), in which
at least two display objects are projected by the projection unit onto the projection target, and
the decision unit decides the direction of the display object whose display mode is switched to the enlarged display mode among the at least two display objects, on a basis of the direction information of the display object switched to the enlarged display mode.
(7) The information processing system according to any one of (2) to (6), in which
the enlarged display mode is a full screen display mode.
(8) The information processing system according to any one of (2) to (7), in which
the direction information indicates a direction in which a user performing an operation on the display object is positioned.
(9) The information processing system according to any one of (2) to (7), in which
at least one user is positioned around the projection target, and
the direction information indicates a. direction in which most users are positioned with respect to the projection target.
(10) The information processing system according to any one of (2) to (9), in which
the decision unit additionally decides, on a basis of the direction information, a size of the display object when the display mode of the display object is switched to the enlarged display mode.
(11) The information processing system according to any one of (2) to (10), in which the acquisition unit additionally acquires information related to the projection target, and
the decision unit additionally decides, on a basis of the information related to the projection target, a size of the display object when the display mode of the display object is switched to the enlarged display mode.
(12) The information processing system according to (10) or (11), in which
the decision unit additionally decides, on a basis of a result of object recognition with respect to an image in which the projection target is imaged, the size of the display object when the display mode of the display object is switched to the enlarged display mode.
(13) The information processing system according to (12), further including:
a specification unit configured to specify, on the basis of the result of object recognition with respect to the image, a region other than a region of an object placed on the projection target, in which
the decision unit decides the size of the display object when the display mode of the display object is switched to the enlarged display mode to be a size corresponding to the region other than the region of the object placed on the projection target.
(14) The information processing system according to any one of (2) to (13), in which
display modes of the display object include a normal display mode and the enlarged display mode,
the information processing system further includes a storage unit configured to store a direction of the display object with respect to the projection target from immediately before the display mode of the display object is switched from the normal display mode to the enlarged display mode, and
when switching from the enlarged display mode to the normal display mode, the decision unit changes the direction of the display object with respect to the projection target to the direction of the display object with respect to the projection target from immediately before switching to the enlarged display mode stored in the storage unit.
(15) The information processing system according to (14), in which
the storage unit additionally stores a size of the display object from immediately before the display mode of the display object is switched from the normal display mode to the enlarged display mode, and
when switching from the enlarged display mode to the normal display mode, the decision unit additionally changes the size of the display object to the size of the display object from immediately before switching to the enlarged display mode stored in the storage unit,
(16) The information processing system according to any one of (2) to (15), in which
the enlarged display mode is a full screen display mode,
the display object is a window,
display modes of the window include a normal display mode, the full screen display mode, and a full window display mode,
when the display mode of the window is switched from the normal display mode to the full screen display mode, the decision unit changes a direction of the window with respect to the projection target on a basis of the direction information, and
when the display mode of the window is switched from the normal display mode to the full window display mode, the decision unit does not change the direction of the window with respect to the projection target.
(17) The information processing system according to any one of (2) to (16), further including:
a display control unit configured to cause the projection unit to project the display object onto the projection target, with the direction of the display object decided by the decision unit.
(18) The information processing system according to any one of (1) to 17), in which
the decision unit decides, on a basis of the direction information, the direction of the display object with respect to the display screen in the enlarged display mode to be a direction in units of 90 degrees.
(19) An information processing method including:
acquiring direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen; and
deciding, by a processor, on a basis of the direction information, a direction of the display object with respect to the display screen when a display mode of the display object is switched to an enlarged display mode, in which
the rotational angle of the display object is different from a rotational angle of the display screen.
(20) A program causing a computer to function as:
an acquisition unit configured to acquire direction information indicating a rotational angle of a display object displayed on a display screen, the rotational angle being with respect to a reference angle on the display screen, or a direction in which a user is positioned with respect to the display screen; and
a decision unit configured to decide, on a basis of the direction information, a direction of the display object with respect to the display screen when a display mode of the display object is switched to an enlarged display mode, in which
the rotational angle of the display object is different from a rotational angle of the display screen.
Number | Date | Country | Kind |
---|---|---|---|
2017-027642 | Feb 2017 | JP | national |