Patent Application
20200356160
The present invention relates to an electronic apparatus, a control method, and a program.
There is an electronic apparatus which makes a transition to a usable state when a person approaches and to a standby state in which functions except some of the functions are stopped when the person leaves (for example, Japanese Unexamined Patent Application Publication No. 2016-148895).
However, a certain length of detection time may be required to detect the presence or absence of a person. In this case, for example, when a user who has been watching a video on an electronic apparatus leaves there while leaving the video played back, the playback of the video is continued during at least the above detection time despite the fact that the user has not watched the video during the detection time even if the playback of the video can be stopped by detecting the leaving of the user. Therefore, when the user watches the continuation part of the video at the next time after coming back, the user is required to rewind the video to seek a playback position in order to watch the continuation part of the video where the user has watched, and this operation is troublesome.
The present invention has been made in view of the above circumstances, and it is an object thereof to provide an electronic apparatus, a control method, and a program, for controlling playback of a video properly according to the presence or absence of a person.
The present invention has been made to solve the above problem, and an electronic apparatus according to the first aspect of the present invention includes: a system processing unit configured to execute system processing based on a system; a playback processing unit configured to execute video playback processing in the system processing; a person detection unit configured to spend a first period in detecting a change from a first detection state in which a person is present within a predetermined detection range to a second detection state in which no person is present; an operation control unit configured to instruct the system processing unit to cause an operating state of the system to make a transition to a first operating state in which at least part of the system processing is limited when the change from the first detection state to the second detection state is detected by the person detection unit, and instruct the system processing unit to activate the operating state of the system from the first operating state based on the fact that a predetermined condition is satisfied; and a playback control unit configured to instruct the playback processing unit to start playback of a video with reference to a playback position at a first timing of the first period in response to activation of the operating state of the system from the first operating state when the video was being played back at the first timing of the first period.
In the above electronic apparatus, the playback control unit may instruct the playback processing unit to stop the video being played back according to a last timing of the first period.
In the above electronic apparatus, the playback control unit may instruct the playback processing unit to start playback of the video with reference to a playback position set as the playback position at the first timing of the first period by rewinding the video by a length of time corresponding to at least a part of the video played back during the first period.
The above electronic apparatus may be such that the system processing unit executes login processing based on an instruction from the operation control unit for activation from the first operating state, and the playback control unit instructs the playback processing unit to start playback of the video with reference to the playback position at the first timing of the first period according to the timing of completion of the login processing.
The above electronic apparatus may also be such that the person detection unit further detects a change from the second detection state to the first detection state, and when the change from the second detection state to the first detection state is detected by the person detection unit, the operation control unit determines that the predetermined condition is satisfied, and instructs the system processing unit to activate the operating state of the system from the first operating state.
The above electronic apparatus may further be such that, when giving an instruction to start playback of the video according to the timing of completion of the login processing, the playback control unit sets, as the playback position at the first timing of the first period, a playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during a second period from when the change from the second detection state to the first detection state is detected until the login processing is completed, and by the length of time corresponding to the part of the video played back during the first period, and instructs the playback processing unit to start playback of the video with reference to the set playback position.
In the above electronic apparatus, the playback control unit may instruct the playback processing unit to start playback of the video from a playback position obtained by rewinding the video by a predetermined length of time from the playback position at the first timing of the first period.
In the above electronic apparatus, the person detection unit may detect whether a person is present within the predetermined detection range or not based on a detection result of distance to an object present within the predetermined detection range.
In the above electronic apparatus, the person detection unit may spend the first period in detecting, based on the detection result, a change in the distance varying with breathing of a person present within the predetermined detection range to determine whether the person is present within the predetermined detection range or not.
Further, according to the second aspect of the present invention, there is provided a control method for an electronic apparatus including a system processing unit configured to execute system processing based on a system, and a playback processing unit configured to execute video playback processing in the system processing, the control method including: a person detection step of causing a person detection unit to spend a first period in detecting a change from a first detection state in which a person is present within a predetermined detection range to a second detection state in which no person is present; an operation control step of causing an operation control unit to instruct the system processing unit to cause an operating state of the system to make a transition to a first operating state in which at least part of the system processing is limited when the change from the first detection state to the second detection state is detected in the person detection step, and to instruct the system processing unit to activate the operating state of the system from the first operating state based on the fact that a predetermined condition is satisfied; and a playback control step of causing a playback control unit to instruct the playback processing unit to start playback of a video with reference to a playback position at a first timing of the first period in response to activation of the operating state of the system from the first operating state when the video was being played back at the first timing of the first period.
Further, according to the third aspect of the present invention, there is provided a program for a computer as an electronic apparatus including a system processing unit configured to execute system processing based on a system, and a playback processing unit configured to execute video playback processing in the system processing, the program causing the computer to execute: a person detection step of spending a first period in detecting a change from a first detection state in which a person is present within a predetermined detection range to a second detection state in which no person is present; an operation control step of instructing the system processing unit to cause an operating state of the system to make a transition to a first operating state in which at least part of the system processing is limited when the change from the first detection state to the second detection state is detected in the person detection step, and instructing the system processing unit to activate the operating state of the system from the first operating state based on the fact that a predetermined condition is satisfied; and a playback control step of instructing the playback processing unit to start playback of a video with reference to a playback position at a first timing of the first period in response to activation of the operating state of the system from the first operating state when the video was being played back at the first timing of the first period.
The above-described aspects of the present invention can control playback of a video properly according to the presence or absence of a person.
An embodiment of the present invention will be described below with reference to the accompanying drawings.
First, the outline of an electronic apparatus 1 according to the embodiment will be described. The electronic apparatus 1 according to the embodiment is, for example, a laptop PC (Personal Computer). Note that the electronic apparatus 1 may be any other type of electronic apparatus, such as a desktop PC, a tablet terminal, or a smartphone.
The electronic apparatus 1 can make a transition at least between a normal operating state (power-on state) and a standby state as system operating states. The normal operating state is an operating state capable of executing processing without being particularly limited, which corresponds, for example, to SO state defined in the ACPI (Advanced Configuration and Power Interface) specification. The standby state is a state in which at least part of system processing is limited. For example, the standby state includes a state in which at least the display of the display unit appears to be OFF (screen OFF) or a screen lock state. The screen lock is a state where an image preset to make a processed content invisible (for example, an image for a screen lock) is displayed on the display unit to indicate that the system is unusable until the lock is released (for example, user authentication is performed). For example, the standby state may be the standby state or a sleep state, or a state corresponding to modern standby in Windows (registered trademark) or S3 state (sleep state) defined in the ACPI specification. For example, the standby state is an operating state lower in power consumption than the normal operating state.
In the following, a transition of the system operating state from the standby state to the normal operating state may also be called “boot.” In the standby state, since the activation level is generally lower than the normal operating state, the boot of the system of the electronic apparatus 1 leads to the activation of the operation of the system in the electronic apparatus 1.
By the HPD processing, the electronic apparatus 1 also controls playback of a video operating in the system processing as well as control of the operating state of the system. For example, when leaving of the person is detected during playback of the video, the electronic apparatus 1 stops the video being played back and causes the system to make a transition to the standby state. Stopping the video means stopping the playback of the video and remaining the video at the playback position (i.e., pausing the video (Pause)). After that, when the approach of the person is detected, the electronic apparatus 1 causes the system to make a transition from the standby state to the normal operating state, and then starts playback of the paused video.
Here, a certain time lag from the time when the person actually left the electronic apparatus 1 to the time when the electronic apparatus 1 detects leaving of the person may occur (for example, about 40 seconds at the maximum). In this case, even when the video being played back is stopped in response to the fact that leaving of the person is detected, playback of the video is continued during this time lag even though the user does not watch the video. Therefore, if the video is played back from the paused position at the next playback of the video, the user will watch a part of the video moved forward by a length of time corresponding to the time lag, rather than the continued part of the video watched by the user at the last time. Therefore, when the user approaches again after leaving during playback of the video, the electronic apparatus 1 starts playback of the video after rewinding the video to a playback position as a timing at which it is estimated that the user left. For example, the electronic apparatus 1 starts playback of the video after rewinding the video by a length of time corresponding to a part played back due to the time lag in detecting the leaving of the person.
When the electronic apparatus 1 detects the leaving of the person, a certain time lag (for example, about 2 to 10 seconds) also occurs from the boot of the system until authentication processing (for example, login processing) is completed (until the user can watch playback of the video). Although the user cannot watch playback of the video during this time lag, the electronic apparatus 1 may start the playback of the video in the background before the completion of the login processing. Therefore, the electronic apparatus 1 may start the playback of the video after further rewinding the video by a length of time corresponding to a part played back due to the time lag in this login processing.
Thus, when the user comes back after leaving during playback of the video, the electronic apparatus 1 can start playback from a playback position (a playback position as a timing at which it is estimated that the user left) rewound by a length of time corresponding to a part of the video played back despite that the user was not able to watch the part due to the time lag (for example, about 40 seconds at the maximum) in detecting the leaving of the person and the time lag (for example, about 2 to 10 seconds) from the time when the approach of the person is detected until the login processing is completed.
Further, suppose that the user approaches the electronic apparatus 1 (User Approach) and the electronic apparatus 1 detects the approach of a person (user) (Detect Approach) at time t20. In this case, the electronic apparatus 1 boots the system from the standby state in response to detecting the approach of the person (user) and executes login processing. In this instance, the application program in which the video was played back before the transition to the standby state may start the playback of the video in conjunction with the boot of the system. During a period up to login processing time T2 (Login time) from time t20, at which the approach of the person (user) is detected, to time t25 at which the login processing is completed (Login comp), the playback of a part of the video that the user cannot watch moves forward. Therefore, in response to the completion of the login processing, the electronic apparatus 1 starts the playback of the video at time t30 after rewinding the video by a length of playback time of a part of the video played back during the detection time T1 and by a length of playback time of another part of the video played back during the login processing time T2 (Rewind). In other words, in response to the completion of the login processing, the electronic apparatus 1 starts the playback of the video from a playback position as a timing at which it is estimated that the user left. Note that the time taken to rewind the video (from time t25 to time t30) varies with the length of video parts to be rewound and the rewind speed (the speed of rewinding the video in the application program). Thus, the user can watch the video continuously from the playback position at which the user had watched the video before left without any particular operation when the user comes back after once leaving during the playback of the video. Note that the electronic apparatus 1 may play back the video after rewinding the video by further adding, as a margin, a predetermined time to the sum of the detection time T1 and the login processing time T2.
Next, the structure/configuration of the electronic apparatus 1 according to the embodiment will be described in detail.
The electronic apparatus 1 includes a first chassis 10, a second chassis 20, and a hinge mechanism 15. The first chassis 10 and the second chassis 20 are coupled by using the hinge mechanism 15. The first chassis 10 is rotatable around an axis of rotation formed by the hinge mechanism 15 relative to the second chassis 20. The direction of the axis of rotation is parallel to side faces 10c and 20c on which the hinge mechanism 15 is placed.
The first chassis 10 is also called A cover or a display chassis. The second chassis 20 is also called C cover or a system chassis. In the following description, side faces on which the hinge mechanism 15 is provided among side faces of the first chassis 10 and the second chassis 20 are referred to as the side faces 10c and 20c, respectively. Among the side faces of the first chassis 10 and the second chassis 20, faces opposite to the side faces 10c and 20c are referred to as side faces 10a and 20a, respectively. In the figure, the direction from the side face 20a to the side face 20c is referred to as “back,” and the direction from the side face 20c to the side face 20a is referred to as “front.” The right hand and left hand in the backward direction are referred to as “right” and “left,” respectively. The left side faces of the first chassis 10 and the second chassis 20 are referred to as side faces 10b and 20b, respectively, and right side faces are referred to as side faces 10d and 20d, respectively. Further, a state where the first chassis 10 and the second chassis 20 overlap each other and are completely closed (a state of open angle θ=0°) is referred to as a “closed state.” The faces of the first chassis 10 and the second chassis 20 on the face-to-face sides in the closed state are referred to as respective “inner faces,” and the faces opposite to the inner faces are referred to as “outer faces.” Further, a state opposite to the closed state, where the first chassis 10 and the second chassis 20 are open is referred to as an “open state.”
The external appearance of the electronic apparatus 1 in
A display unit 110 is provided on the inner face of the first chassis 10. The display unit 110 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display, and the like. Further, an imaging unit 120 and a proximity sensor 130 are provided in a peripheral area of the display unit 110 on the inner face of the first chassis 10. The imaging unit 120 is arranged on the side of the side face 20a in the peripheral area of the display unit 110. The proximity sensor 130 is arranged on the side of the side face 20c in the peripheral area of the display unit 110.
In the open state, the imaging unit 120 captures an image of an object within a predetermined angle of view in a direction (front) to face the inner face of the first chassis 10. The predetermined angle of view is an imaging angle of view defined by an imaging element included in the imaging unit 120 and an optical lens provided in front of an imaging surface of the imaging element.
The proximity sensor 130 detects an object (for example, a person) present in the neighborhood of the electronic apparatus 1. For example, the proximity sensor 130 is an infrared distance sensor configured to include a light-emitting part for emitting infrared light and a light-receiving part for receiving reflected light which is the infrared light returned after being emitted and reflected on the surface of the object. The proximity sensor 130 detects, with a predetermined sampling frequency (for example, 1 Hz), light received by the light-receiving part, and outputs a detection signal according to the distance to the object (for example, the person) by using a triangulation method for calculating the distance based on the imaging position of the received light or a ToF (Time of Flight) method for converting, to a distance, a time difference from light-emitting to light-receiving, or the like.
Note that the proximity sensor 130 may be a sensor using infrared light emitted by a light-emitting diode, or a sensor using infrared laser emitting a light beam narrower in wavelength band than the infrared light emitted by the light-emitting diode. Further, the proximity sensor 130 is not limited to the infrared distance sensor, and it may be a sensor using any other method, such as an ultrasonic sensor or a sensor using an UWB (Ultra Wide Band) radar, as long as the sensor detects a distance to the object.
Returning to
In the closed state where the first chassis 10 and the second chassis 20 are closed, the display unit 110, the imaging unit 120, and the proximity sensor 130 provided on the inner face of the first chassis 10 are covered with the inner face of the second chassis 20, and put in a state of being disabled from fulfilling their functions. In the state where the first chassis 10 and the second chassis 20 are completely closed, the open angle θ is 0°.
The imaging unit 120 captures an image of an object within a predetermined angle of view in a direction (front) to face the inner face of the first chassis 10, and outputs the captured image to the system processing unit 300. For example, when the face of a person approaching the electronic apparatus 1 is contained within the angle of view of the imaging unit 120, the imaging unit 120 captures a face image of the person, and outputs the captured face image to the system processing unit 300. The imaging unit 120 may be an infrared camera or a normal camera. The infrared camera is a camera including an infrared sensor as an imaging element. The normal camera is a camera including, as an imaging element, a visible light sensor for receiving visible light.
The proximity sensor 130 detects an object (for example, a person) present in a direction (front) to face the inner face of the first chassis 10, and outputs, to the EC 200, a detection signal indicative of the detection result. The power button 140 outputs, to the EC 200, operation signals according to user's operations.
The input device 150 is an input unit for accepting user's input, which is configured to include, for example, the keyboard 151 and the touch pad 153. In response to accepting operations on the keyboard 151 and the touch pad 153, the input device 150 outputs, to the EC 200, operation signals indicative of the content of the operations.
The power supply unit 400 supplies power through a power system for supplying power to each unit of the electronic apparatus 1 according to the operating state of each unit. The power supply unit 400 includes a DC (Direct Current)/DC converter. The DC/DC converter converts, the voltage of DC power, supplied from an AC (Alternate Current)/DC adapter or a battery pack, to voltage requested for each unit. The power with the voltage converted by the DC/DC converter is supplied to each unit through each power system. For example, the power supply unit 400 supplies power to each unit through each power system based on a control signal according to the operating state of each unit input from the EC 200.
The EC 200 is a microcomputer configured to include a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), an I/O (Input/Output) logic circuit, and the like. The CPU of the EC 200 reads a control program prestored in the ROM thereof and executes the read control program to fulfill the function. The EC 200 operates independently of the system processing unit 300 to control the operation of the system processing unit 300 and manage the operating state of the system processing unit 300. The EC 200 is connected to the proximity sensor 130, the input device 150, and the power supply unit 400.
For example, the EC 200 communicates with the power supply unit 400 to acquire information on a battery state (remaining battery capacity, and the like) from the power supply unit 400 and to output, to the power supply unit 400, a control signal or the like in order to control the supply of power according to the operating state of each unit of the electronic apparatus 1. Further, the EC 200 acquires operation signals from the input device 150, and outputs, to the system processing unit 300, an operation signal related to processing of the system processing unit 300 among the acquired operation signals. Further, the EC 200 acquires a detection signal indicative of the detection result from the proximity sensor 130 to execute the HPD processing based on the detection result. For example, as a functional configuration related to the HPD processing, the EC 200 includes a person detection unit 210, an operation control unit 220, and a playback control unit 230.
Based on the detection signal acquired from the proximity sensor 130, the person detection unit 210 detects a person (more specifically, an object estimated to be a person) present within a predetermined detection range. For example, based on the detection signal acquired from the proximity sensor 130, the person detection unit 210 detects a distance to the person present within the predetermined detection range in front of the electronic apparatus 1. The predetermined detection range is a range preset to detect a person in front of the electronic apparatus 1, which is referred to as a person detection range below. This person detection range is a range defined by the detection angle of view indicative of the angle of view as a detection target and the maximum detection distance indicative of the distance as a detection target. For example, the person detection range corresponds to the sensor detection range of the proximity sensor 130. Specifically, for example, the detection angle of view in the person detection range corresponds to the detection angle of view FoV (see
For example, when acquiring a detection signal according to the distance to the person acquired from the proximity sensor 130, the person detection unit 210 detects that the person is present within the person detection range and detects the distance to the person. On the other hand, when the detection signal according to the distance to the person cannot be acquired from the proximity sensor 130, the person detection unit 210 detects that no person is present within the person detection range.
Further, when detecting a person after no person is detected within the person detection range, the person detection unit 210 determines that the person approaches the front of the electronic apparatus 1 and detects the approach of the person to the electronic apparatus 1. Further, when continuing to detect a person after detecting the person within the person detection range, the person detection unit 210 determines that the person is present in front of the electronic apparatus 1. Further, when no longer detecting the person after the person is detected within the person detection range, the person detection unit 210 determines that the person present in front of the electronic apparatus has left and detects leaving of the person from the electronic apparatus 1.
Here, the detection signal according to the distance to the person acquired from the proximity sensor 130 will be acquired even if the detection target is any object other than the person. When the object present within the person detection range is no longer detected or when an object absent within the person detection range is detected, the object is a moving object and can be roughly estimated as the person from the situation. On the other hand, when the electronic apparatus 1 is used in a small room, a box seat, or the like, a wall or the back of a chair may be present at a short distance (within the person detection range) even when the user leaves the electronic apparatus 1. In this case, since the person detection unit 210 continues to detect the presence of an object such as the wall or the back of the chair within the person detection range, there is a concern that leaving of the user cannot be detected correctly. Therefore, the person detection unit 210 uses motion of the breast with breathing of a person (more specifically, minute movement of breathing, heartbeat, or the like to maintain life) to detect whether the person is present within the detection range or not.
For example, the person detection unit 210 determines whether an object present within the person detection range is the person or an object other than the person by determining whether there are minute distance variations caused by the breathing of the person based on the distance to the object detected by the proximity sensor 130.
Returning to
Further, when the person detection unit 210 continues to detect the person within the person detection range, the operation control unit 220 restricts the system not to make a transition to the standby state by the system processing unit 300 so as to continue the normal operating state. However, even when the person detection unit 210 continues to detect a person within the person detection range, the operation control unit 220 may make a transition from the normal operating state to the standby state depending on a predetermined condition (for example, when the duration of non-operation lasts for a preset period of time and when no video is not being played back).
Further, when the person detection unit 210 no longer detects the person within the person detection range after the person is detected (that is, when the person detection unit 210 detects leaving of the person from the electronic apparatus 1), the operation control unit 220 instructs the system processing unit 300 to cause the system to make a transition from the normal operating state to the standby state. More specifically, the operation control unit 220 outputs a standby signal to instruct the system processing unit 300 to cause the system to make a transition from the normal operating state to the standby state. When acquiring the standby signal, the system processing unit 300 causes the system to make the transition from the normal operating state to the standby state. After that, the operation control unit 220 outputs, to the power supply unit 400, a control signal to stop the supply of power unnecessary in the standby state.
In addition to the HPD processing, the operation control unit 220 controls the operating state of the system based on an operation on the power button 140, and an operation to the input device 150 for selection from an operation control menu (logout (sign-out), sleep, shutdown, restart, or the like) prepared by the OS. For example, the operation control unit 220 acquires an operation signal from the power button 140, and instructs the system processing unit 300 to cause the operating state of the system to make a transition to the normal operating state or the standby state based on the acquired operation signal. For example, in the standby state, when acquiring an operation signal indicating that the power button 140 is held down, the operation control unit 220 outputs, to the system processing unit 300, a control signal (boot signal) for booting the system. Further, in the normal operating state, when acquiring the operation signal indicating that the power button 140 is held down, the operation control unit 220 outputs, to the system processing unit 300, a control signal to cause the operating state of the system to make a transition from the normal operating state to the standby state. More specifically, for example, when acquiring an operation signal indicating that the power button 140 is held down for a time shorter than a predetermined time in the normal operating state, the operation control unit 220 may output a control signal to cause the operating state of the system to make a transition to a sleep state, while when acquiring an operation signal indicating that the power button 140 is held down for a time longer than the predetermined time (long-press operation), the operation control unit 220 may output a control signal to cause the operating state of the system to make a transition to a shutdown state.
The playback control unit 230 controls video playback processing executed by the system processing unit 300. For example, when a video is being played back at the first timing of the detection time T1 (see
Further, when the approach of the person is detected by the person detection unit 210, the playback control unit 230 uses a timer (login processing timer) to measure the login processing time T2 (see
Further, the playback control unit 230 may instruct the system processing unit 300 to start the playback of the video from a playback position further rewound by a predetermined length of time (for example, ten seconds, one minute, or the like) from the playback position obtained by rewinding the video by a length of time played back during the detection time T1 and the login processing time T2 (that is, the playback position at the first timing of the detection time T1).
The system processing unit 300 is configured to include a CPU (Central Processing Unit) 302, a GPU (Graphic Processing Unit) 304, a memory controller 306, an I/O (Input-Output) controller 308, a system memory 310, and an authentication processing unit 321, where processes of various application programs are executable on an OS (Operating System) by system processing based on the OS. Note that the CPU 302 and the GPU 304 may be collectively called a processor.
The CPU 302 executes processes by the OS and processes by an application program(s) running on the OS. Further, the CPU 302 makes a transition of the operating state of the system by the HPD processing performed by the EC 200 based on the detection result of the proximity sensor 130. For example, when the operating state is the standby state and the boot signal is input from the EC 200, the CPU 302 executes boot processing for making a transition from the standby state to the normal operating state. For example, in the case where the operating state is the sleep state, a hibernation state, or a power-off state, when power is supplied from the power supply unit 400 and the boot signal is input from the EC 200, the CPU 302 starts boot processing. In the boot processing, the CPU 302 detects and initializes the minimum devices such as the system memory 310 and the storage unit 360 (pre-boot). The CPU 302 loads system firmware from the storage unit 360 into the system memory 310 to detect and initialize the other devices such as the communication unit 350 and the display unit 110 (post-processing). Initialization includes processing such as initial parameter settings. In a transition (resume) from the sleep state to the normal operating state, part of the post-processing may be omitted. After completion of the boot processing, the CPU 302 starts execution of the system processing based on the OS (boot). For example, when the operating state is the standby state and the boot signal is input from the EC 200, the CPU 302 resumes execution of an application program(s) the execution of which has been stopped.
In the boot processing, the CPU 302 executes login processing to determine whether to allow access to the OS. When the boot processing by the OS is started, the CPU 302 executes the login processing before allowing access to the OS, and the transition to the normal operating state is paused until login is allowed in the login processing. In the login processing, user authentication processing is performed to determine whether the person using the electronic apparatus 1 is a preregistered, authorized user or not. As the authentication, there are password authentication, face authentication, fingerprint authentication, and the like. In the embodiment, an example of using face authentication processing will be described. Specifically, the description will be made later with reference to
In addition to making the transition of the operating state by the HPD processing described above, the CPU 302 also makes a transition of the operating state as OS processing. For example, when the duration of non-operation lasts for a preset period of time in the normal operating state, the CPU 302 makes a transition from the normal operating state to the standby state by the OS processing. The preset period of time is a threshold value for determining the transition to the standby state when the duration of non-operation has lasted, which is settable in the OS system settings. For example, when the duration of non-operation has lasted, there are options such as “screen OFF time” to determine a transition to a state where the display of the display unit 110 is turned OFF (screen OFF), “sleep time” to determine a transition to the sleep state, and the like, and the user can select and set an option arbitrarily from among these options. In addition to time options (for example, “one minute,” “two minutes,” “four minutes,” “ten minutes,” “half-hour,” “one hour,” . . . ), a setting of prohibiting the transition to screen OFF or a setting of prohibiting the transition to the sleep state (for example, “none”), and the like are included.
The GPU 304 is connected to the display unit 110. The GPU 304 executes image processing under the control of the CPU 302 to generate display data. The GPU 304 outputs the generated display data to the display unit 110. Note that the CPU 302 and the GPU 304 may be integrally formed as one core, or the load may be allocated between the CPU 302 and the GPU 304 formed as individual cores, respectively. The number of processors is not limited to one, and it may be plural.
The memory controller 306 controls reading data from and writing data to the system memory 310, the storage unit 360, and the like, by the CPU 302 and the GPU 304.
The I/O controller 308 controls input/output of data from the communication unit 350, the display unit 110, and the EC 200.
The system memory 310 is used as a reading area of an execution program of the processor and a working area to write processed data.
The communication unit 350 is connected to other devices communicably through a wireless or wired communication network to send and receive various data. For example, the communication unit 350 is configured to include a wired LAN interface such as the Ethernet (registered trademark), a wireless LAN interface such as Wi-Fi (registered trademark), and the like.
The storage unit 360 is configured to include storage media, such as an HDD (Hard Disk Drive), a secure NVRAM (Non-Volatile RAM), a ROM (Read Only Memory), and the like. The HDD stores the OS, device drivers, various programs such as applications, and various data acquired by the operation of the programs. In the secure NVRAM, authentication data used to authenticate each user are stored. Stored in the authentication data are identification information of each user and authentication information in association with each other. The secure NVRAM is protected (locked) not to be able to be accessed from an OS operating environment via the I/O controller 308. Note, however, that the lock is released upon power-on and reset of the CPU 302, and the system firmware is executed upon completion of the pre-boot to start the lock.
Next, the login processing executed by the system processing unit 300 and a functional configuration of playback processing will be described.
The authentication processing unit 321 executes face authentication processing based on a captured image output from the imaging unit 120. The face authentication processing includes face detection processing and face matching processing. The face detection processing is processing for defining a face area as an area of a face image from image data of the captured image output from the imaging unit 120. The face image is an image of the face of a person present in front of the electronic apparatus 1. Note that depth information acquired by the imaging unit 120 may be used in the authentication processing unit for face detection processing. The face matching processing has a step of determining the positions of plural face feature points (for example, mouth, eyes, nose, etc.) representing the features of the face from the face area, normalizing the position and size of the face area to be predetermined position and size, respectively, and defining a distribution of the normalized face feature points as image feature values, and a step of matching the defined image feature values with image feature values of the face image of a predetermined person to identify the person having image feature values with which matching is successful. In the storage unit 360, authentication information is set for each account as an authorized user who logs in to the account. The authentication information includes image feature values of the face image of the user. The authentication information is stored in further association with user information indicating the user. The user information may be information capable of identifying the user of the electronic apparatus 1, such as a user name, a user ID (Identifier), or the like.
As a result of matching the face image of the person captured by the imaging unit 120 with the authentication information on the set user, when it can be determined to match with each other, the authentication processing unit 321 determines that the face authentication is successful. On the other hand, for example, when a person other than the person using the electronic apparatus 1 cuts across in front of the electronic apparatus 1 by chance, the authentication processing unit 321 detects no face area from the image captured by the imaging unit 120. The authentication processing unit 321 outputs, to the login processing unit 322, the authentication result indicative of success/failure of the face authentication.
The login processing unit 322 executes login processing to log in (allow the user to access the OS) based on the authentication result by the authentication processing unit. Specifically, in the boot processing, the login processing unit 322 instructs the authentication processing unit 321 to execute the face authentication processing before allowing access to the OS, and pauses the subsequent boot processing. When the authentication result by the authentication processing unit 321 is successful, the login processing unit 322 allows the login, and resumes the execution of the paused boot processing. On the other hand, when the authentication result by the authentication processing unit 321 is unsuccessful, the login processing unit 322 outputs a notification of not allowing the login and leaves the execution of the boot processing paused.
The logoff processing unit 323 executes logoff processing to log off from the login state. For example, when receiving a logoff instruction (an instruction to make a transition to the standby state) with a user's operation, by the OS processing, by the HPD processing, or the like, the logoff processing unit 323 executes the logoff processing.
The playback processing unit 324 is a function implemented by executing a video playback application program running on the OS, which plays back a streaming video or a video stored in the form of a file such as MP4. Images of the video played back are displayed on the display unit 110. For example, when the system is in the normal operating state, the playback processing unit 324 acquires, from the EC 200, an operation signal indicative of an operation in response to a user's operation to any one of operation buttons corresponding to functions, such as “playback,” “stop (pause),” “rewind,” and “fast forward,” displayed on the display unit 110 based on the application program to execute “playback,” “stop (pause),” “rewind,” or “fast forward” corresponding to the operation signal. Further, when the system makes a transition from the normal operating state to the standby state or a transition from the standby state to the normal operating state, the playback processing unit 324 executes the playback, stop, rewind, or the like of the video according to the “playback command,” the “stop command,” the “rewind command,” or the like acquired from the playback control unit 230 of the EC 200.
Next, the operation of operating state control processing for controlling the operating state of the system by the HPD processing will be described. First, the operation of boot processing to boot the system when the EC 200 detects the approach of a person to the electronic apparatus 1 will be described.
(Step S101) Based on a detection signal acquired from the proximity sensor 130, the EC 200 determines whether the approach of a person to the electronic apparatus 1 is detected. When a person is detected after no person is detected within the person detection range, the EC 200 determines that the approach of a person to the electronic apparatus 1 is detected. When no person remains detected within the person detection range, the EC 200 determines that the approach of a person to the electronic apparatus 1 is not detected. Then, when determining that the approach of a person to the electronic apparatus 1 is not detected (NO), the EC 200 performs processing in step S101 again. On the other hand, when determining that the approach of a person to the electronic apparatus 1 is detected (YES), the EC 200 proceeds to processing in step S103.
(Step S103) The EC 200 boots the system by the system processing unit 300. Specifically, when booting the system by the system processing unit 300, the EC 200 outputs, to the power supply unit 400, the control signal to supply power necessary for the operation of each unit of the electronic apparatus 1. Further, the EC 200 outputs the boot signal to instruct the system processing unit 300 to boot the system. When acquiring the boot signal, the system processing unit 300 starts boot processing. Then, the procedure proceeds to processing in step S105.
(Step S105) The system processing unit 300 executes login processing (authentication processing). For example, the system processing unit 300 executes the login processing by face authentication based on a captured image acquired from the imaging unit 120, and proceeds to processing in step S107.
(Step S107) The system processing unit 300 determines whether the authentication result is successful or not. When determining that the authentication result is successful (YES), the system processing unit 300 proceeds to processing in step S109. On the other hand, when determining that the authentication result is unsuccessful (NO), the system processing unit 300 proceeds to processing in step S113.
(Step S109) When the authentication result is successful, the system processing unit 300 outputs a notification that the login is successful (for example, displays the notification on the display unit 110) to continue the boot processing. Then, the procedure proceeds to processing in step S111.
(Step S111) The system processing unit 300 completes the login processing and makes a transition to the normal operating state. Here, it takes the login processing time T2 (see
(Step S113) When the authentication result is unsuccessful, the system processing unit 300 outputs a notification that the login is unsuccessful (for example, displays the notification on the display unit 110), and returns to the authentication processing in step S105. When the authentication processing is unsuccessful continuously a predetermined number of times, the system processing unit 300 may stop the authentication processing and make a transition to a state of disabling the login.
Next, the operation of standby state transition processing to cause the system to make a transition from the normal operating state to the standby state when the EC 200 detects leaving of a person from the electronic apparatus 1 will be described.
(Step S151) Based on the detection signal acquired from the proximity sensor 130, the EC 200 determines whether leaving of a person from the electronic apparatus 1 is detected or not. Here, as described above, the EC 200 spends the detection time T1 (see
(Step S153) The EC 200 makes a transition of the system by the system processing unit 300 from the normal operating state to the standby state. Specifically, the EC 200 outputs a standby signal to instruct the system processing unit 300 to cause the system to make a transition to the standby state. When acquiring the standby signal, the system processing unit 300 makes a transition from the normal operating state to the standby state. Further, the EC 200 outputs, to the power supply unit 400, a control signal to stop the supply of power unnecessary in the standby state.
Next, the operation of playback control processing for controlling the stop and resume of a video being played back by the HPD processing will be described. First, the operation of measurement processing for leaving detection time to measure the detection time T1 when the EC 200 detects leaving of a person will be described.
(Step S201) Based on the detection signal acquired from the proximity sensor 130, the EC 200 determines whether leaving detection processing to detect leaving a person is started or not. When determining that the leaving detection processing is started (YES), the EC 200 proceeds to processing in step S203. On the other hand, when determining that the leaving detection processing is not started (NO), the EC 200 repeats processing in step S201.
(Step S203) The EC 200 starts counting up the leaving detection timer at the timing of starting the leaving detection processing to measure the detection time T1 (see
(Step S205) The EC 200 determines whether leaving of a person is detected or not. When determining that leaving of the person is not detected (NO), the EC 200 proceeds to processing in step S207. On the other hand, when determining that leaving of the person is detected (YES), the EC 200 proceeds to processing in step S209.
(Step S207) When a person (presence or approach of a person) is detected within the person detection range based on the detection signal acquired from the proximity sensor 130 (YES), the EC 200 determines that the person is not left, and proceeds to processing in step S211. On the other hand, when no person is detected within the person detection range (NO), the EC 200 returns to processing in step S203 to continue to count up the leaving detection timer.
(Step S209) The EC 200 stops counting of the leaving detection timer at the timing when leaving of the person is detected and stores the timer value (detection time T1). Here, the timing when leaving of the person is detected corresponds to the timing of time t15 in
(Step S211) The EC 200 resets the leaving detection timer and ends the leaving detection time measuring processing.
Next, the operation of login processing time measuring processing in which the EC 200 measures the login processing time T2 will be described.
(Step S301) Based on the detection signal acquired from the proximity sensor 130, the EC 200 determines whether the approach of a person is detected or not. When determining that the approach of a person is detected (YES), the EC 200 proceeds to processing in step S303. On the other hand, when determining that the approach of a person is not detected (NO), the EC 200 repeats processing in step S301.
(Step S303) The EC 200 starts counting up the login processing timer at the timing when the approach of the person is detected to measure the login processing time T2 (see
(Step S305) In the boot processing started in response to the fact that the approach of the person is detected, the EC 200 determines whether the login processing is completed or not. When determining that the login processing is not completed (NO), the EC 200 returns to processing in step S303 to continue to count up the login processing timer. On the other hand, when determining that the login processing is completed (YES), the EC 200 proceeds to processing in step S307.
(Step S307) The EC 200 stops counting of the login processing timer at the timing when the login processing is completed and stores the timer value (login processing time T2). Here, the timing when the login processing is completed corresponds to the timing of time t25 in
(Step S309) The EC 200 resets the login processing timer and ends the login processing time measuring processing.
Next, the operation of playback stop processing in which the EC 200 stops the video being played back when leaving of a person from the electronic apparatus 1 is detected will be described.
(Step S401) The EC 200 determines whether leaving of a person is detected or not. When determining that leaving of a person is not detected (NO), the EC 200 repeats processing in step S401. On the other hand, when determining that leaving of a person is detected (YES), the EC 200 proceeds to processing in step S403.
(Step S403) In the processing of the system processing unit 300 (playback processing unit 324), the EC 200 determines whether the video is being played back or not. When determining that the video is not being played back (NO), the EC 200 ends the playback stop processing without controlling the video. On the other hand, when determining that the video is being played back (YES), the EC 200 proceeds to processing in step S405.
(Step S405) The EC 200 instructs the system processing unit 300 to stop the video being played back. For example, at the last timing of the detection time T1 (see
Next, the operation of playback resume processing in which the EC 200 resumes the playback of the video when the approach of a person to the electronic apparatus 1 is detected will be described.
(Step S501) The EC 200 determines whether the login processing is completed or not. When determining that the login processing is not completed (NO), the EC 200 repeats processing in step S501. On the other hand, when determining that the login processing is completed (YES), the EC 200 proceeds to processing in step S503.
(Step S503) The EC 200 transmits, to the system processing unit 300, the “rewind command” to give an instruction to cause the playback position of the video to go back. Then, the procedure proceeds to processing in step S505.
(Step S505) The EC 200 transmits, to the system processing unit 300, the “playback command” to give an instruction to start (resume) playback at the timing when a given length of time has passed after the transmission of the “rewind command.” The given length of time mentioned above is the time necessary for rewinding the video by a length of time played back during the detection time T1 and the login processing time T2. Specifically, based on the measured value (timer value) of the detection time T1 stored in step S209 of
Note that the EC 200 may start (resume) playback of the video from a playback position rewound by a playback time obtained by adding a predetermined time to the length of time played back during the detection time T1 and the login processing time T2. Further, the EC 200 may transmit the “stop command” to the system processing unit 300 before transmitting the “rewind command” in step S503 or before transmitting the “playback command” in step S505.
As described above, the electronic apparatus 1 according to the embodiment includes the system processing unit 300, the playback processing unit 324, the person detection unit 210, the operation control unit 220, and the playback control unit 230. The system processing unit 300 executes system processing based on the system (for example, the OS). The playback processing unit 324 executes video playback processing in the system processing. The person detection unit 210 spends the detection time T1 (an example of a first period) in detecting a change from a first detection state in which a person is present within the person detection range (an example of a predetermined detection range) to a second detection state in which no person is present (that is, leaving of the person from the electronic apparatus 1 (Leave)). When the change from the first detection state to the second detection state is detected by the person detection unit 210, the operation control unit 220 instructs the system processing unit 300 to cause the operating state of the system to make a transition to the standby state (an example of a first operating state) in which at least part of system processing is limited, and based on the fact that a predetermined condition is satisfied, the operation control unit 220 instructs the system processing unit 300 to activate (boot) the operating state of the system from the standby state. Here, the predetermined condition is to detect approach of a person to the electronic apparatus 1, accept user's input (for example, an operation to the input device 150) in order to activate (boot) the system, or the like. When the video is being played back at the first timing of the detection time T1, the playback control unit 230 instructs the playback processing unit 324 to start the playback of the video with reference to the playback position at the first timing of the detection time T1 in response to the fact that the operating state of the system is activated (booted) from the standby state.
Thus, when the user comes back again after leaving during playback of the video, the electronic apparatus 1 can resume playback from a playback position as the continuation of a part where the user had watched before leaving. Therefore, the user who has come back is not required to perform an operation to rewind the video so as to search for the playback position when watching where the user left off, allowing the user to continue to watch the video from the continued part where the user had watched before leaving. Thus, the electronic apparatus 1 can control the playback of the video properly according to the presence or absence of a person.
Further, the playback control unit 230 instructs the playback processing unit 324 to stop the video being played back according to the last timing of the detection time T1 (the example of the first period).
Thus, when leaving of the user is detected during playback of the video, since the video being played back is stopped, the electronic apparatus 1 can control the playback of the video properly according to the presence or absence of a person.
Further, the playback control unit 230 sets, as a playback position at the first timing of the detection time T1, a playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during at least the detection time T1 (the example of the first period), and instructs the playback processing unit 324 to start the playback of the video with reference to the playback position.
Thus, when the user comes back again after leaving during playback of the video, the electronic apparatus 1 can play back the video from the playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during a period from when the user left until leaving is detected.
Further, the system processing unit 300 executes login processing based on the instruction from the operation control unit 220 to activate (boot) the operating state of the system from the standby state (the example of the first operating state). According to the timing when the login processing is completed, the playback control unit 230 instructs the playback processing unit 324 to start the playback of the video with reference to the playback position at the first timing of the detection time T1 (the example of the first period).
Thus, when the user comes back again after leaving during playback of the video, the electronic apparatus 1 can resume the playback of the video from the playback position as the continuation of a part where the user had watched before leaving after the login processing is completed to make a transition to the operating state where the user can watch the video.
The person detection unit 210 further detects a change from the second detection state in which no person is present within the person detection range (the example of the predetermined detection range) to the first detection state in which a person is present (that is, approach of a person to the electronic apparatus 1 (Approach)). Then, when the change from the second detection state to the first detection state is detected by the person detection unit 210, the operation control unit 220 determines that a predetermined condition is satisfied and instructs the system processing unit 300 to activate (boot) the operating state of the system from the standby state (the example of the first operating state).
Thus, when the user comes back again, the electronic apparatus 1 can detect that the user comes back and automatically boot the system the operating state of which was transited to the standby state when the user once left during playback of the video.
Further, when giving the instruction to start the playback of the video according to the timing when the login processing is completed, the playback control unit 230 sets, as the playback position at the first timing of the detection time T1, a playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during the login processing time T2 (an example of a second period) from when the change from the second detection state, in which no person is present within the person detection range (the example of the predetermined detection range), to the first detection state in which a person is present (that is, approach of a person to the electronic apparatus 1 (Approach)) is detected until the login processing is completed, and during the detection time T1 (the example of the first period). Then, the playback control unit 230 instructs the playback processing unit 324 to start the playback of the video with reference to the playback position.
Thus, when the user comes back again after leaving during playback of the video, the electronic apparatus 1 can play back the video from the playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during a period from when the user left until leaving is detected and by a length of time corresponding to a part of the video played back during the login processing.
Further, the playback control unit 230 instructs the playback processing unit 324 to start the playback of the video from a playback position further rewound by a predetermined length of time (for example, ten seconds, one minute, or the like) from the playback position at the first timing of the detection time T1 (the example of the first period). For example, the playback control unit 230 may give an instruction to start the playback of the video from a playback position further rewound by a predetermined length of time (for example, ten seconds, one minute, or the like) from the playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during the detection time T1 and the login processing time T2.
Thus, when the user comes back again after leaving during playback of the video, the electronic apparatus 1 can resume the playback of the video from a playback position shortly before the playback position corresponding to a part where the user had watched before leaving. Therefore, the user can watch the continued part of the video while easily remembering the content of the video watched before leaving.
Further, based on the detection result of the distance to an object present within the person detection range (the example of the predetermined detection range), the person detection unit 210 detects whether a person is present within the person detection range or not.
Thus, the electronic apparatus 1 can detect the distance to a person to detect the presence or absence of the user with a simple configuration and at a low load.
Further, based on the detection result of the distance to an object present within the person detection range (the example of the predetermined detection range), the person detection unit 210 spends the detection time T1 (the example of the first period) in detecting a distance variation generated according to the cycle of breathing of a person present within the person detection range to detect whether a person is present within the person detection range or not.
Thus, the electronic apparatus 1 can detect a person in distinction from any object other than the person, and hence the detection accuracy of the presence or absence of a person can be improved.
In the above embodiment, when the user comes back again after leaving during playback of the video, the electronic apparatus 1 resumes the playback of the video after rewinding the video by a playback time during the detection time T1 and by a playback time during the login processing time T2. However, when the video is not played back during the login processing time T2 (or when the time of being played back is short), the electronic apparatus 1 may resume the playback of the video after rewinding the video by a playback time during the detection time T1 alone. Further, the electronic apparatus 1 may give an instruction to start the playback of the video from a playback position further rewound by a predetermined length of time (for example, ten seconds, one minute, or the like) from the playback position obtained by rewinding the video by a length of time corresponding to a part of the video played back during the detection time T1.
Further, the electronic apparatus 1 may store the playback position at the first timing (time t10 in
In the above embodiment, the example in which the person detection unit 210 detects a person (more specifically, an object estimated to be a person) present within the person detection range based on the detection signal (that is, the distance to the object) acquired from the proximity sensor 130 has been described, but the person detection method is not limited thereto. For example, the person detection unit 210 may detect a person or the face of the person from a captured image acquired by the imaging unit 120 to detect the person present within the person detection range.
Further, in the above embodiment, the configuration example in which the imaging unit 120 is incorporated in the electronic apparatus 1 has been described, but the configuration is not limited thereto. For example, the imaging unit 120 does not have to be incorporated in the electronic apparatus 1, which may also be connected to the electronic apparatus 1 wirelessly or by wire as an external accessory.
Further, in the above embodiment, the EC 200 configured to operate independently of the system processing unit 300 may be any processing unit such as a sensor hub or a chipset, or the above-described processing may be executed by any processing unit other than the EC 200 instead of the EC 200. It is usually the case that the sum of power consumption of the processing unit such as this EC 200 and the proximity sensor 130 is significantly less than the power consumption of the system processing unit 300.
Further, in the standby state described above, a hibernation state, a power-off state, or the like may also be included. The hibernation state corresponds, for example, to S4 state defined in the ACPI specification. The power-off state corresponds, for example, to S5 state (shutdown state) defined in the ACPI specification.
Note that the electronic apparatus 1 described above has a computer system therein. Then, a program for implementing the function of each component included in the electronic apparatus 1 described above may be recorded on a computer-readable recording medium so that the program recorded on this recording medium will be read into the computer system and executed to perform processing in each component included in the electronic apparatus 1 described above. Here, the fact that “the program recorded on the recording medium is read into the computer system and executed” includes installing the program on the computer system. Here, it is assumed that the “computer system” includes the OS and hardware such as a peripheral device and the like. Further, the “computer system” may also include two or more computers connected through a network including the Internet, WAN, LAN, and a communication line such as a dedicated line. Further, the “computer-readable recording medium” means a storage medium such as a flexible disk, a magneto-optical disk, a ROM, a portable medium like a CD-ROM, or a hard disk incorporated in the computer system. The recording medium with the program stored thereon may be a non-transitory recording medium such as the CD-ROM.
A recording medium internally or externally provided to be accessible from a delivery server for delivering the program is included as the recording medium. Note that the program may be divided into plural pieces, downloaded at different timings, respectively, and then united in each component included in the electronic apparatus 1, or delivery servers for delivering respective divided pieces of the program may be different from one another. Further, the “computer-readable recording medium” includes a medium on which the program is held for a given length of time, such as a volatile memory (RAM) inside a computer system as a server or a client when the program is transmitted through the network. The above-mentioned program may also be to implement some of the functions described above. Further, the program may be a so-called differential file (differential program) capable of implementing the above-described functions in combination with a program(s) already recorded in the computer system.
Further, some or all of the functions of the electronic apparatus 1 in the above-described embodiment may be realized as an integrated circuit such as LSI (Large Scale Integration). Each function may be a processor implemented individually, or part or whole thereof may be integrated as a processor. Further, the method of circuit integration is not limited to LSI, and it may be realized by a dedicated circuit or a general-purpose processor. Further, if integrated circuit technology replacing the LSI appears with the progress of semiconductor technology, an integrated circuit according to the technology may be used.
Further, the electronic apparatus 1 in the above-described embodiment is not limited to a PC, a tablet terminal, or a smartphone, and the present invention can be applied to a household electric appliance or a commercial electric appliance. As the household electric appliance, the present invention can be applied to a TV set capable of playing back a video recorded as a streaming video or a video file. For example, ON/OFF control of the TV screen and playback control of the video can be performed according to the approach or leaving of a person. Further, as the household electric appliance, the present invention may be applied to a refrigerator, a microwave oven, or the like, provided with a display unit capable of playing back a video recorded as a streaming video or a video file (for example, a product instruction manual video, a recipe video, or the like). As the commercial electric appliance, the present invention can be applied to a multimedia station or the like provided with a display unit capable of playing back a video recorded as a streaming video or a video file. For example, ON/OFF control of the screen of the display unit of the multimedia station and playback control of the video can be performed according to the approach or leaving of a person.
While the embodiment of this invention has been described in detail with reference to the accompanying drawings, the specific configuration is not limited to the above-described embodiment, and design changes shall be included without departing from the scope of this invention. Further, respective components described in the above-described embodiment can be combined arbitrarily.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019088004 | May 2019 | JP | national |
