Patent Application
20230414171
Various embodiments of the disclosure relate to a technology for providing information for improving the sleep quality of a user through an electronic device.
As the use of mobile electronic devices has become more common due to the recent development of mobile communication technology, services or functions provided through the mobile electronic devices are gradually diversifying. For example, a healthcare service for continuously monitoring a user's biometric information through the mobile electronic device and managing health may be provided.
The mobile electronic device may acquire biometric data of the user from one or more sensors or a wearable device (for example, a smart watch) which can be linked to the mobile electronic device and analyze a health condition of the user on the basis of the acquired biometric signal. The mobile electronic device may allow the user to maintain a healthy body by providing information on an exercise state during an activity time of the user or a sleep state during a sleep time of the user.
As the interest in health increases, providing information on a sleep activity accounting for about 25% of the day has become an important function. A current mobile electronic device may analyze sleep states of a user on the basis of biometric data collected through a link with one or more sensors included in the electronic device or a wearable device and provide the analysis result to the user. For example, the electronic device may analyze sleep levels, such as awakening during sleep, light non-rapid-eye-movement (REM) sleep, deep non-REM sleep, or REM sleep, on the basis of biometric data collected while the user sleeps, score the analyzed sleep level, and provide the same to the user. However, current mobile electronic devices simply provide the sleep analysis result and have limitations in providing practical feedback to improve a sleep state of the user.
Accordingly, one or more embodiments of the disclosure continuously analyze and manage the sleep habit of the user by collecting action information of the user which may influence sleep and sleep evaluation information and analyzing a pattern of action information on the basis of the sleep evaluation information. Further, various embodiments for providing actual sleep guide information that helps for improving the sleep state of the user on the basis of the analyzed sleep habit of the user may be provided.
The technical subject matter pursued in embodiments of the disclosure may not be limited to the above mentioned technical subject matter, and other technical matter which are not mentioned may be clearly understood, through the following descriptions, by those skilled in the art of the disclosure.
An electronic device according to an embodiment of the disclosure includes a display, at least one processor operatively connected to the display, and a memory operatively connected to the at least one processor, wherein the memory is configured to store instructions causing the at least one processor to, when executed, identify sleep time information of a user, acquire sleep evaluation information and action information corresponding to the sleep time information, analyze a pattern of the action information, based on the sleep evaluation information, generate sleep guide information for the user, based on a result of the analysis, and output the generated sleep guide information to the display.
A method of operating an electronic device according to one or more embodiments of the disclosure includes identifying sleep time information of a user, acquiring sleep evaluation information and action information corresponding to the sleep time information, analyzing a pattern of the action information, based on the sleep evaluation information, generating sleep guide information for the user, based on a result of the analysis, and outputting the generated sleep guide information to the display.
Various embodiments of the disclosure can analyze an action pattern which may influence the sleep quality of the user to provide feedback corresponding to a sleep habit of the user. Further, one or more embodiments can provide information on the correlation between the sleep quality and the sleep habit to the user on the basis of statistical data on the sleep habit of the user and provide a detailed guide for improving the sleep quality.
In addition, various effects directly or indirectly detected through the disclosure can be provided.
In connection with description of drawings, the same or similar reference numerals may be used for the same or similar elements.
Hereinafter, various embodiments of the disclosure are described with reference to the accompanying drawings. However, this does not limit various embodiments of the disclosure to the specific form, and it should be understood that various modifications, equivalent, and/or alternative of the disclosure are included.
Referring to
The processor 120 may execute, for example, software (e.g., a program 140) to control at least one other component (e.g., a hardware or software component) of the electronic device 101 coupled with the processor 120, and may perform various data processing or computation. According to one embodiment, as at least part of the data processing or computation, the processor 120 may store a command or data received from another component (e.g., the sensor module 176 or the communication module 190) in volatile memory 132, process the command or the data stored in the volatile memory 132, and store resulting data in non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 121. For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or to be specific to a specified function. The auxiliary processor 123 may be implemented as separate from, or as part of the main processor 121.
The auxiliary processor 123 may control at least some of functions or states related to at least one component (e.g., the display module 160, the sensor module 176, or the communication module 190) among the components of the electronic device 101, instead of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or together with the main processor 121 while the main processor 121 is in an active state (e.g., executing an application). According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., the neural processing unit) may include a hardware structure specified for artificial intelligence model processing. An artificial intelligence model may be generated by machine learning. Such learning may be performed, e.g., by the electronic device 101 where the artificial intelligence is performed or via a separate server (e.g., the server 108). Learning algorithms may include, but are not limited to, e.g., supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-network or a combination of two or more thereof but is not limited thereto. The artificial intelligence model may, additionally or alternatively, include a software structure other than the hardware structure.
The memory 130 may store various data used by at least one component (e.g., the processor 120 or the sensor module 176) of the electronic device 101. The various data may include, for example, software (e.g., the program 140) and input data or output data for a command related thererto. The memory 130 may include the volatile memory 132 or the non-volatile memory 134.
The program 140 may be stored in the memory 130 as software, and may include, for example, an operating system (OS) 142, middleware 144, or an application 146.
The input module 150 may receive a command or data to be used by other component (e.g., the processor 120) of the electronic device 101, from the outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing record. The receiver may be used for receiving calls. According to an embodiment, the receiver may be implemented as separate from, or as part of the speaker.
The display module 160 may visually provide information to the outside (e.g., a user) of the electronic device 101. The display module 160 may include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.
The audio module 170 may convert a sound into an electrical signal and vice versa. According to an embodiment, the audio module 170 may obtain the sound via the input module 150, or output the sound via the sound output module 155 or a headphone of an external electronic device (e.g., an electronic device 102) directly (e.g., wiredly) or wirelessly coupled with the electronic device 101.
The sensor module 176 may detect an operational state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) external to the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
The interface 177 may support one or more specified protocols to be used for the electronic device 101 to be coupled with the external electronic device (e.g., the electronic device 102) directly (e.g., wiredly) or wirelessly. According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
A connecting terminal 178 may include a connector via which the electronic device 101 may be physically connected with the external electronic device (e.g., the electronic device 102). According to an embodiment, the connecting terminal 178 may include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).
The haptic module 179 may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus which may be recognized by a user via his tactile sensation or kinesthetic sensation. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
The camera module 180 may capture a still image or moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
The power management module 188 may manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
The battery 189 may supply power to at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.
The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and the external electronic device (e.g., the electronic device 102, the electronic device 104, or the server 108) and performing communication via the established communication channel. The communication module 190 may include one or more communication processors that are operable independently from the processor 120 (e.g., the application processor (AP)) and supports a direct (e.g., wired) communication or a wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device via the first network 198 (e.g., a short-range communication network, such as Bluetooth™ wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network 199 (e.g., a long-range communication network, such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multi components (e.g., multi chips) separate from each other. The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network, such as the first network 198 or the second network 199, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module 196.
The wireless communication module 192 may support a 5G network, after a 4G network, and next-generation communication technology, e.g., new radio (NR) access technology. The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). The wireless communication module 192 may support a high-frequency band (e.g., the mmWave band) to achieve, e.g., a high data transmission rate. The wireless communication module 192 may support various technologies for securing performance on a high-frequency band, such as, e.g., beamforming, massive multiple-input and multiple-output (massive MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., the electronic device 104), or a network system (e.g., the second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate (e.g., 20 Gbps or more) for implementing eMBB, loss coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1 ms or less) for implementing URLLC.
The antenna module 197 may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device 101. According to an embodiment, the antenna module 197 may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., array antennas). In such a case, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network 198 or the second network 199, may be selected, for example, by the communication module 190 (e.g., the wireless communication module 192) from the plurality of antennas. The signal or the power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 197.
According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to an embodiment, the mmWave antenna module may include a printed circuit board, a RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.
At least some of the above-described components may be coupled mutually and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).
According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via the server 108 coupled with the second network 199. Each of the electronic devices 102 or 104 may be a device of a same type as, or a different type, from the electronic device 101. According to an embodiment, all or some of operations to be executed at the electronic device 101 may be executed at one or more of the external electronic devices 102, 104, or 108. For example, if the electronic device 101 should perform a function or a service automatically, or in response to a request from a user or another device, the electronic device 101, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device 101. The electronic device 101 may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device 101 may provide ultra low-latency services using, e.g., distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet-of-things (IoT) device. The server 108 may be an intelligent server using machine learning and/or a neural network. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology or IoT-related technology.
Referring to
In an embodiment, the display 210 (for example, the display module 160 of
In an embodiment, the display module 210 may be configured by at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED), LED, active matrix OLED (AMOLED), a flexible display, and a three-dimensional display. Further, some of the displays may be configured to be transparent or be a light-transmitting type so that the outside can be seen therethrough. The display may be implemented in a transparent display type including transparent OLED (TOLED).
In an embodiment, the memory 230 (for example, the memory 130 of
In an embodiment, the memory 230 may store sleep-related information (for example, user movement information and/or biometric data), sleep state information, sleep evaluation information, and/or predetermined condition information acquired through an external electronic device (for example, a smart watch, a smart band, or a smart ring) or the sensor module 240.
In an embodiment, at least one processor 220 may identify user sleep time information. The sleep time information is an index indicating how much time the user sleeps during one day and may be calculated on the basis of bedtime and wake-up time of the user. According to various embodiments, at least one processor 220 may identify the sleep time information on the basis of at least one of a user input, a screen on or screen off record of the electronic device, and/or user biometric data. For example, at least one processor 220 may receive an input of the bedtime and the wake-up time from the user or may estimate the bedtime and the wake-up time of the user on the basis of the screen on or screen off record detected by the display 210. In another example, at least one processor 220 may estimate the bedtime and the wake-up time of the user on the basis of the user biometric information acquired from the sensor module 240 or an external electronic device (for example, a smart watch, a smart band, or a smart ring) linked to the electronic device 200.
In an embodiment, at least one processor 220 may acquire sleep evaluation information corresponding to the sleep time information. The sleep evaluation information is an index that reflects evaluation for the (user) sleep and may be determined on the basis of one or more evaluation items. For example, at least one processor 220 may acquire the sleep evaluation information on the basis of at least one evaluation item among a sleep score calculated on the basis of the sleep state recorded during the sleep, sleep satisfaction input by the user, sleep efficiency indicating a ratio of the actual sleep time to the total sleep time, and/or a sleep rating determined on the basis of the sleep time information. The sleep score is an item for objectively evaluating the sleep quality in consideration of one or more evaluation reference elements and may be scoring of the sleep quality within a range from, for example, 0 to 100 on the basis of the one or more evaluation reference elements determined by the American sleep foundation. For example, the evaluation reference elements may reflect sleep states such as sleep time, sleep cycle, sleep level, and/or movement during sleep. At least one processor 220 may analyze a change in sleep levels or a sleep cycle on the basis of biometric data (for example, heart rate (HR) or heart rate variability (HRV)) detected during the sleep time of the user and a degree of motion during sleep and calculate a sleep score corresponding to the analysis result. For example, the biometric data detected by at least one processor 220 during the sleep time of the user may include electrocardiogram information and/or various biometric signals for detecting the sleep states of the user as well as the heart rate or the heart rate variability. The sleep levels may be divided into awakening, light non-REM sleep, deep non-REM sleep, and/or REM sleep, and the sleep cycle may be determined according to the change in the sleep level. The sleep satisfaction is an item that reflects a user's subjective evaluation on sleep and may be determined by a user input. The sleep efficiency is an item indicating the actual sleep time except for the time in which user movement exceeds a predetermined level in the total sleep time and may be defined as a range from 0 to 100%. The sleep rating may be an item evaluated on the basis of at least one of a bedtime, a wake-up time, or waking hours during sleep. According to various embodiments, at least one processor 220 may collect sleep evaluation items including at least one of the sleep score, the sleep satisfaction, the sleep efficiency, and/or the sleep rating and may store and/or manage the same in the memory 230 or a database which can be accessed by the electronic device 200.
In an embodiment, at least one processor 220 may acquire action information corresponding to the sleep time information. The action information is an index indicating a user's action which may influence sleep and may be determined in consideration of motion of the user or data collected through the electronic device 200. For example, at least one processor 220 may acquire the action information on the basis of at least one of a usage record of an application executed by the electronic device 200, a record related to motion of the user detected by the sensor module 240 or an external electronic device (for example, a smart watch), and/or context data estimated on the basis of a network connection state of the electronic device 200. The usage record of the application may be acquired on the basis of log data recorded in connection with an application executed by the user, and the motion-related record may be acquired on the basis of at least one of a recorded step count of the user, quantity of motion, heartbeat data, and/or whether the user takes a nap. The context data indicates data related to the action or environment of the user estimated through the electronic device 200 and may be acquired on the basis of at least one of a phone call log of the user, location information, and/or weather information. According to various embodiments, the action information may be stored and managed in a predetermined format to analyze the user's sleep habit. At least one processor 220 may convert the action information into a first format including at least one of an action type, an action name, a time difference between an action occurrence time point and sleep time, an action start time, and/or an action end time and store and/or manage the action information converted into the first format in the memory 230 or a database which can be accessed by the electronic device 200. For example, when acquiring action information indicating the use of a game application for one hour before the user goes to bed, at least one processor 220 may convert and manage the acquired action information according to the first format. In another example, at least one processor 220 may not consider an exercise record generated in a time zone irrelevant to the sleep time of the user (for example, the time difference between the action occurrence time point and the sleep time is larger than or equal to a predetermined time difference) as the action information that influences the sleep states of the user.
In an embodiment, at least one processor 220 may analyze a pattern of the action information on the basis of the acquired sleep evaluation information. When it is identified that the sleep evaluation information collected according to first sleep time information satisfies a predetermined reference, at least one processor 220 may classify the action information collected according to the sleep time information as a positive pattern. The predetermined reference may be determined on the basis of at least one evaluation item included in the sleep evaluation information. For example, when it is identified that the sleep score corresponding to the first sleep time information is larger than an average sleep score of the user's age, at least one processor 220 may classify action information collected according to the first sleep time information as a positive pattern. On the other hand, when it is identified that the sleep evaluation collected according to second sleep time information does not satisfy the predetermined reference, at least one processor 220 may classify action information corresponding to the second sleep time information as a negative pattern. For example, when it is identified that the sleep efficiency corresponding to the second sleep time information is lower than a predetermined reference (for example, 80%), at least one processor 220 may classify action information collected according to the second sleep time information as a negative pattern. At least one processor 220 may store the classification result in the memory 230 or a database which can be accessed by the electronic device 200 to manage the same. According to various embodiments, at least one processor 220 may transmit the collected action information to an external server (for example, the server 108 of
In an embodiment, at least one processor 220 may generate sleep guide information of the user on the basis of the pattern analysis result of the action information. For example, at least one processor 220 may generate the sleep guide information on the basis of at least one of the first sleep habit or the second sleep habit. The sleep guide information may be generated to include the content that helps for continuously maintaining the first sleep habit belonging to the positive pattern or the content that helps for improving the second sleep habit belonging to the negative pattern. According to various embodiments, at least one processor 220 may generate the sleep guide information in consideration of a profile of the user. The profile may include at least one of gender, age, and/or residence of the corresponding user. For example, when the user is a male in his thirties (30s), at least one processor 220 may generate sleep statistics for men in their 30s and a comment for improving the sleep quality as the sleep guide information.
In an embodiment, at least one processor 220 may output the generated sleep guide information. When a predetermined condition (for example, time or location) is satisfied, at least one processor 220 may output the sleep guide information through the display 210 and/or at least one of the output means (for example, the first sound output module 155 and the haptic module 179) included in the electronic device 200. The output condition of the sleep guide information may be preset by the user. For example, when the time configured as the sleep guide information output time by the user arrives, at least one processor 220 may perform control to output the sleep guide information on the display 210.
In an embodiment, the sensor module 240 (for example, the sensor module 176 of
In an embodiment, the sensor module 240 may further include at least one sensor (for example, a temperature sensor, a humidity sensor, an illumination sensor, a camera sensor, a gas sensor, and/or a fine dust sensor) for acquiring context data related to an environment of the user.
In an embodiment, the communication module 250 (for example, the communication module 190 of
Referring to
In an embodiment, the data collection module 310 is a configuration for collecting data required for analyzing the sleep state of the user and may include a sleep analyzer 311 and a pattern collector 314.
In an embodiment, the sleep analyzer 311 may include a sleep time getter 312 for collecting sleep time information of the user and a sleep evaluation collector 313 for collecting sleep evaluation information corresponding to the sleep time information. The sleep time getter 312 may identify a bedtime and a wake-up time of the user on the basis of at least one of a user input or a screen on/off record detected by the electronic device 200, biometric data of the user (for example, a heart rate (HR) or heart rate variability (HRV)) acquired by one or more sensors (for example, the sensor module 240 of
In an embodiment, the pattern collector 314 is a module for collecting action information of the user and may include a data collector 315 and a pattern generator 316. The data collector 315 may collect data related to activities or environments which may influence the sleep of the user. For example, the data collector 315 may acquire the action information on the basis of at least one of a usage record of an application, a record related to motion of the user, and/or context data. The application usage record may include at least one of a type of an application executed by the electronic device 200, a log record, a package name, and/or a use time. The motion-related record is data measured using the sensor module 240 included in the electronic device 200 or an external electronic device (for example, a smart watch) and may include at least one of a recorded step count of the user, quantity of motion, heartbeat data, or whether the user takes a nap. The context data indicates data related to the action or environment of the user estimated through the electronic device 200 and may be acquired on the basis of at least one of a phone call log of the user, location information, and/or weather information. The pattern generator 316 may convert the collected action information into a pattern object in a predetermined format and manage the same. For example, the pattern generator 316 may convert the action information into a pattern object in a predetermined format including at least one item among an action type, an action name, a time difference between the action occurrence time point and the sleep time, an action start time, and/or an action end time.
In an embodiment, the data analysis module 320 is a configuration for analyzing a pattern of the action information collected according to the sleep of the user and may include a pattern aggregator 321. The pattern aggregator 321 is a module for classifying and collecting patterns of the action information on the basis of the sleep evaluation information and may include a positive pattern aggregator 322 and a negative pattern aggregator 323. The positive pattern aggregator 322 may collect pattern objects of a day on which the sleep evaluation information exceeds the predetermined reference and thus is determined as positive. The negative pattern aggregator 323 may collect pattern objects of a day on which the sleep evaluation information does not satisfy the predetermined reference and thus is determined as negative. For example, when it is determined that the sleep satisfaction in the sleep evaluation information collected according to the first sleep time information is higher than a third level which is a reference level, the pattern aggregator 321 may classify a pattern object of action information corresponding to the first sleep time information as a positive pattern. The positive pattern aggregator 322 may collect and manage pattern objects classified as the positive pattern. In another example, when it is determined that the sleep rating in the sleep evaluation information collected according to the second sleep time information is ‘poor’, the pattern aggregator 321 may classify a pattern object of action information corresponding to the second sleep time information as a negative pattern. The negative pattern aggregator 323 may collect and manage pattern objects classified as the negative pattern.
In an embodiment, the data use module 330 is a configuration for providing user-customized sleep guide information by using the pattern analysis result of action information and may include a feedback generator 331 and a sleep estimation helper 335.
In an embodiment, the feedback generator 331 is a module which generates personalized sleep guide information of the user and may include a personal feedback generator 332, a weekly report generator 333, and/or a common feedback generator 334. The personal feedback generator 332 may generate the sleep guide information on the basis of the collected positive patterns or negative patterns. For example, the personal feedback generator 332 may determine, as a good sleep habit, a pattern having the highest frequency among pattern objects of action information collected as the positive pattern, and generate feedback for maintaining the good sleep habit as the sleep guide information. For example, when it is assumed that an action pattern related to ‘30-minute exercise before sleep’ is classified as the positive pattern, the personal feedback generator 332 may generate the content that helps for maintaining the habit of the ‘30-minute exercise before sleep’ as the sleep guide information. In another example, the personal feedback generator 332 may determine, as a bad sleep habit, a pattern having the highest frequency among pattern objects of action information collected as the negative pattern and generate feedback for improving the bad sleep habit as the sleep guide information. When an action pattern related to ‘the use of a video application before sleep’ is classified as the negative pattern, the personal feedback generator 332 may generate the content that proposes improvement of the habit of ‘the use of a video application before sleep’ as the sleep guide information. The weekly report generator 333 may generate sleep statistics collected for one week and the pattern analysis result in the form of a weekly report. For example, the weekly report generator 333 may generate statistical analysis data of the sleep time information and the sleep evaluation information collected for one week as the weekly report. Further, the weekly report generator 333 may insert information indicating which part of the sleep evaluation increases or decreases through comparison with the weekly report of the previous week and indicating which sleep habit should be maintained or improved into the weekly report. For a user to which no personalized feedback can be provided due to the lack of data required for analyzing the sleep pattern, the common feedback generator 334 may generate the sleep guide information on the basis of a profile of the corresponding user. The profile may include at least one of gender, age, and/or residence of the user. For example, the common feedback generator 334 may download sleep statistics data of the same gender and age as the user from an external server and generate the content related to the generally good sleep habit as the sleep guide information on the basis of the downloaded data.
In an embodiment, the sleep estimation helper 335 may estimate the sleep time in consideration of the pattern analysis result of the action information. The sleep estimation helper 335 may increase the accuracy of estimation of the sleep time by additionally reflecting the pattern analysis result of the action information in the existing algorithm for estimating the sleep time on the basis of the user input or the screen on/off record.
In
In
In
In
In
In
In
In an embodiment, the electronic device 200 may store sleep evaluation items collected as illustrated in
Referring to
The action type 601 indicates which type of the action corresponds to the action information and may be classified in connection with at least one of the application usage record, the motion-related record, and/or the context data. The electronic device 200 may store the action type 601 of the action information as object type data.
The action name 603 indicates a title of the action information and may include at least one of a package name of the executed application, a type of the motion-related record (for example, walking, running, cycling, stretching, nap, or other exercises), and/or a type of the context data (for example, going out, coming home, call, business, study, climbing, indoor exercise, outdoor exercise, listening to music, or other hobbies). The electronic device 200 may store the action name 603 of the action information as string type data.
The occurrence type 605 may indicate whether the action information is associated with the bedtime/wake-up time of the user or is generated during the sleep time. The electronic device 200 may store the occurrence type 605 of the action information as 4-byte integer type data.
The occurrence gap 607 may indicate a time difference between a time point at which an action of the action information occurs and the sleep time. The electronic device 200 may identify how much the action information influences sleep of the user on the basis of the occurrence gap 607 and may store the occurrence gap 607 of the action information as 8-byte integer (long) type data.
The start time 609 may indicate an action start time of the action information, and the end time 611 may indicate an action end time of the action information. The time offset 613 may indicate a time variation allowed for time data of the action information. The electronic device 200 may store the start time 609, the end time 611, and the time offset 613 as 8-byte integer (long) type data.
Referring to
Similarly, the electronic device 200 may determine a main pattern generated with the statistically highest probability among one or more action patterns classified as a negative pattern set as a negative sleep habit of the user. The electronic device 200 may generate the sleep guide information to include the content that helps for improving the determined negative sleep habit.
Referring to
According to an embodiment, in operation 820, the electronic device 200 may acquire sleep evaluation information and action information corresponding to the sleep time information. For example, the electronic device 200 may acquire the sleep evaluation information on the basis of at least one evaluation item. The sleep evaluation information is an index which reflects evaluation for sleep of the user and may include at least one evaluation item among a sleep score calculated on the basis of a sleep state recorded during sleep, sleep satisfaction input by the user, sleep efficiency indicating a ratio of the actual sleep time to the total sleep time, and/or a sleep rating determined on the basis of the sleep time information. The sleep score is an item for objectively evaluating the sleep quality in consideration of one or more evaluation reference elements and may be obtained by scoring the sleep quality on the basis of the one or more evaluation reference elements determined by the American sleep foundation For example, the evaluation reference elements may reflect a sleep state such as sleep time, a sleep cycle, a sleep level, and/or motion during sleep. At least one processor 220 may analyze a change in sleep levels or a sleep cycle on the basis of biometric data (for example, heart rate (HR) or heart rate variability (HRV)) detected during the sleep time of the user and a degree of motion during sleep and calculate a sleep score corresponding to the analysis result. The sleep level may be divided into awakening, light non-REM sleep, deep non-REM sleep, and/or REM sleep, and the sleep cycle may be determined according to the change in the sleep levels. The sleep satisfaction is an item which reflects a user's subjective evaluation for the sleep and may be determined by a user input. The sleep efficiency is an item indicating the actual sleep time except for the time in which a user's motion exceeds a predetermined level in the total sleep time and may be determined within a range from 0% to 100%. The sleep rating may be an item evaluated on the basis of at least one of a bedtime of the user, a wake-up time, and/or waking hours during sleep.
In operation 820, the electronic device 200 may acquire action information corresponding to the sleep time information in consideration of motion of the user collected through the electronic device 200 or context data. The action information is an index indicating a user's action that may influence sleep and may include at least one of a usage record of an application executed by the electronic device 200, a record related to a user's motion detected by the sensor module 240 or an external electronic device (for example, a smart watch), and/or context data estimated on the basis of a network connection state of the electronic device 200. The application usage record may be acquired on the basis of log data recorded in connection with the application executed by the user, and the motion-related record may be acquired on the basis of at least one of a recorded step count of the user, quantity of motion, heartbeat data, and/or whether the user takes a nap. The context data indicates data related to the action or environment of the user estimated through the electronic device 200 and may be acquired on the basis of at least one of a phone call log, location information, or weather information of the user. According to various embodiments, the action information may be stored and managed in a predetermined format to analyze a sleep habit of the user. The electronic device 200 may convert the action information into a first format including at least one of an action type, an action name, a time difference between an action occurrence time point and sleep time, an action start time, and/or an action end time and manage the action information converted into the first format in the memory 230 or a database which can be accessed by the electronic device 200. For example, when acquiring action information indicating that the user uses a game application for one hour before going to bed, the electronic device 200 may convert the acquired action information according to the first format and manage the same.
According to an embodiment, in operation 830, the electronic device 200 may analyze a pattern of the action information on the basis of the sleep evaluation information. A detailed description of the pattern analysis in operation 830 is made with reference to
Referring to
When it is identified that the sleep evaluation information satisfies the predetermined reference on the basis of the determination result (operation 832-Yes), the electronic device 200 may classify action information acquired according to the sleep time information as a positive pattern in operation 834. For example, when it is identified that the sleep score corresponding to the first sleep time information is larger than an average sleep score of the user's age, the electronic device 200 may classify action information collected according to the first sleep time information as a positive pattern.
When it is identified that the sleep evaluation information does not satisfy the predetermined reference on the basis of the determination result (operation 832 -No), the electronic device 200 may classify the action information acquired according to the sleep time information as a negative pattern in operation 836. For example, when it is identified that the sleep efficiency corresponding to the second sleep time information is lower than the predetermined reference (for example, 80%), the electronic device 200 may classify action information collected according to the second sleep time information as a negative pattern.
According to an embodiment, the electronic device 200 may determine a sleep habit of the user on the basis of the pattern classification result of the action information. For example, the electronic device 200 may determine that a positive pattern having the highest frequency among one or more action patterns classified as the positive pattern is a first sleep habit of the user. The electronic device 200 may determine that a negative pattern having the highest frequency among one or more action patterns classified as the negative pattern is a second sleep habit of the user.
Referring back to
According to an embodiment, in operation 850, the electronic device 200 may output the generated sleep guide information to a display (for example, the display module 160 of
Referring to
Referring to
Referring to
Referring to
Referring to
According to an embodiment, the electronic device 200 may generate a weekly sleep analysis report 1120 on the basis of an action information pattern analyzed for one week in
An electronic device (for example, the electronic device 200) according to an embodiment may include a display (for example, the display 210), at least one processor (for example, the processor 220) operatively connected to the display, and a memory (for example, the memory 230) operatively connected to the at least one processor, and the memory may be configured to store instructions causing the at least one processor to, when executed, identify sleep time information of a user, acquire sleep evaluation information and action information corresponding to the sleep time information, analyze a pattern of the action information, based on the sleep evaluation information, generate sleep guide information for the user, based on a result of the analysis, and output the generated sleep guide information to the display.
In an embodiment, the instructions may cause the at least one processor to identify the sleep time information, based on at least one of a user input, a screen on or screen off record detected by the display, and/or biometric data of the user acquired from an external electronic device.
In an embodiment, the instructions may cause the at least one processor to acquire the sleep evaluation information, based on at least one item among a sleep score calculated based on a sleep state recorded during sleep, sleep satisfaction input by the user, sleep efficiency indicating a ratio of an actual sleep time to a total sleep time, and/or a sleep rating determined based on the sleep time information.
In an embodiment, the instructions may cause the at least one processor to acquire the action information, based on at least one of a usage record of an application executed by the electronic device, a motion-related record detected using at least one sensor (for example, the sensor module 240), and context data estimated based on a network connection state of the electronic device.
In an embodiment, the action information may be converted into a first format including at least one of an action type, an action name, a time difference between an action occurrence time point and a sleep time, an action start time, and/or an action end time and stored in the memory.
In an embodiment, the instructions may cause the at least one processor to classify the action information into a positive pattern or a negative pattern, based on the sleep evaluation information and store a result of the classification in the memory or a database which can be accessed by the electronic device.
In an embodiment, the instructions may cause the at least one processor to determine that a pattern having a highest frequency among one or more positive patterns stored in the memory or the database is a first sleep habit of the user and determine that a pattern having a highest frequency among one or more negative patterns stored in the memory or the database is a second sleep habit of the user. In an embodiment, the instructions may cause the at least one processor to generate the sleep guide information, based on at least one of the first sleep habit or the second sleep habit.
In an embodiment, the instructions may cause the at least one processor to generate the sleep guide information, based on a user profile including at least one of gender, age, or residence of the user.
In an embodiment, the instructions may cause the at least one processor to output the generated sleep guide information to the display at a predetermined time point.
A method of operating an electronic device (for example, the electronic device 200) according to another embodiment may include an operation of identifying sleep time information of a user, an operation of acquiring sleep evaluation information and action information corresponding to the sleep time information, an operation of analyzing a pattern of the action information, based on the sleep evaluation information, an operation of generating sleep guide information for the user, based on a result of the analysis, and an operation of outputting the generated sleep guide information to the display.
In an embodiment, the operation of identifying the sleep time information of the user may include an operation of estimating the sleep time information, based on at least one of a user input, a screen on or screen off record detected by a display (for example, the display 210), and/or biometric data of the user acquired from an external electronic device (for example, the electronic device 102 or the electronic device 104).
In an embodiment, the operation of acquiring the sleep evaluation information and the action information corresponding to the sleep time information may include an operation of acquiring the sleep evaluation information, based on at least one item among a sleep score calculated based on a sleep state recorded during sleep, sleep satisfaction input by the user, sleep efficiency indicating a ratio of an actual sleep time to a total sleep time, and/or a sleep rating determined based on the sleep time information.
In an embodiment, the operation of acquiring the sleep evaluation information and the action information corresponding to the sleep time information may include an operation of acquiring the action information, based on at least one of a usage record of an application executed by the electronic device, a motion-related record detected using at least one sensor (for example, the sensor module 240), and context data estimated based on a network connection state of the electronic device.
In an embodiment, the method may further include an operation of converting the action information into a first format including at least one of an action type, an action name, a time difference between an action occurrence time point and a sleep time, an action start time, and/or an action end time and storing the action information in a memory (for example, the memory 230).
In an embodiment, the operation of analyzing the pattern of the action information, based on the sleep evaluation information may include an operation of classifying the action information into a positive pattern or a negative pattern, based on the sleep evaluation information and an operation of storing a result of the classification in the memory or a database which can be accessed by the electronic device.
In an embodiment, the operation of analyzing the pattern of the action information, based on the sleep evaluation information may include an operation of determining that a pattern having a highest frequency among one or more positive patterns stored in the memory or the database is a first sleep habit of the user and determining that a pattern having a highest frequency among one or more negative patterns stored in the memory or the database is a second sleep habit of the user.
In an embodiment, the method may further include an operation of generating the sleep guide information, based on at least one of the first sleep habit or the second sleep habit.
In an embodiment, the operation of generating the sleep guide information of the user may include an operation of generating the sleep guide information, based on a user profile including at least one of gender, age, and/or residence of the user.
In an embodiment, the operation of outputting the generated sleep guide information may include an operation of outputting the generated sleep guide information through the display or a speaker (for example, the sound output module 155) at a predetermined time point.
The electronic device according to various embodiments may be one of various types of electronic devices. The electronic devices may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the disclosure, the electronic devices are not limited to those described above.
It should be appreciated that various embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C,” may include any one of, or all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as “1st” and “2nd,” or “first” and “second” may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.
As used in connection with various embodiments of the disclosure, the term “module” may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” or “circuitry”. A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).
Various embodiments as set forth herein may be implemented as software (e.g., the program 140) including one or more instructions that are stored in a storage medium (e.g., internal memory 136 or external memory 138) that is readable by a machine (e.g., the electronic device 101). For example, a processor (e.g., the processor 120) of the machine (e.g., the electronic device 101) may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include a code generated by a complier or a code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the term “non-transitory” simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.
According to an embodiment, a method according to various embodiments of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.
According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to various embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2021-0030968 | Mar 2021 | KR | national |
This application is a continuation application, claiming priority under § 365(c), of International Application No. PCT/KR2022/001027, filed on Jan. 20, 2022, which is based on and claims the benefit of Korean patent application number 10-2021-0030968 filed on Mar. 9, 2021, in the Korean Intellectual Property Office, the disclosures of which are incorporated by reference herein in their entireties.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/KR2022/001027 | Jan 2022 | US |
| Child | 18244064 | US |
