Patent Application
20230356028
The disclosure relates to a method for displaying a workout image and an electronic device.
With the development of information communication technology and semiconductor technology, various electronic devices are developing into multimedia devices that provide various multimedia services. For example, a portable electronic device may provide various multimedia services such as a broadcasting service, a wireless Internet service, a camera service, and a music playback service.
The electronic device may provide the user with the user's health information (e.g., heart rate information, calorie information, time information) to satisfy the user's interest in health care. The electronic device may be operationally connected to other electronic devices (e.g., wearable devices) located in the vicinity, and may share data (e.g., the user's health information) with each other.
With the development of electronic communication, electronic devices can easily provide users with various workout contents (e.g., home training video contents). For example, the home training video contents may include a guide audio and subtitles so that the user can follow the trainer's movements while watching the video. The electronic device may display video contents related to workout through the display module, but it may be difficult to provide the user with his or her workout process and the amount of change in his biometric information according to the workout.
Embodiments of the disclosure may provide an electronic device that may be operationally connected to other nearby electronic devices while providing workout-related video content to the user. The electronic device according to an embodiment may acquire information related to the user from the other electronic device and provide the workout-related video contents and the acquired information to the user.
According to various example embodiments, an electronic device may comprise: a communication module comprising communication circuitry configured to communicate with at least one external electronic device; a memory for storing at least one app; and a processor operatively connected to the communication module and the memory. The processor may be configured to: activate a workout management app (e.g., home gym app) stored in the memory; in response to the execution of the at least one app, identify whether a workout-related content has been executed; display an object for execution of a training program through the workout management app based on the workout-related content being executed; in response to an input on the object, make an automatic connection with the at least one external electronic device through the communication module; configure, on the basis of at least one piece of workout-related information acquired from the at least one external electronic device, a training program screen into which the workout-related content and the workout-related information are integrated; and control the external electronic device to display the training program screen.
A method according to various example embodiments may comprise: activating a workout management app for managing a workout; identifying whether workout-related content has been executed based on the activated workout management app in response to the execution of at least one app stored in a memory; based on the workout-related content being executed, displaying an object for executing a training program through the workout management app; in response to an input on the object, making an automatic connection with at least one external electronic device; configuring a training program screen into which the workout-related content and workout-related information are integrated on the basis of at least one workout-related information acquired from the at least one external electronic device; and displaying the training program screen through the at least one external electronic device.
Various example embodiments of the present disclosure, in an electronic device, may detect the playback of workout-related content, display an object for interworking with another electronic device, and, in response to an input to the object, display workout-related content, user's workout and/or the user's biometric information together.
According to an example embodiment, the electronic device may integrate workout-related content, biometric data such as the user's heart rate information and/or calorie consumption, and/or a photographed image of the user and provide it to the user on one screen. Users who perform a home training may maximize and/or improve the effect of their workouts by monitoring their workout progress. In addition, various effects that can be directly or indirectly identified through this disclosure may be provided.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements. Further, the above and other aspects, features and advantages of certain embodiments of the present disclosure will be more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which:
The processor 120 may execute, for example, software (e.g., a program 140) to control at least one other component (e.g., a hardware or software component) of the electronic device 101 coupled with the processor 120, and may perform various data processing or computation. As at least part of the data processing or computation, the processor 120 may store a command or data received from another component (e.g., the sensor module 176 or the communication module 190) in volatile memory 132, process the command or the data stored in the volatile memory 132, and store resulting data in non-volatile memory 134. The processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 121. For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or to be specific to a specified function. The auxiliary processor 123 may be implemented as separate from, or as part of the main processor 121.
The auxiliary processor 123 may control at least some of functions or states related to at least one component (e.g., the display module 160, the sensor module 176, or the communication module 190) among the components of the electronic device 101, instead of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or together with the main processor 121 while the main processor 121 is in an active state (e.g., executing an application). The auxiliary processor 123 (e.g., an ISP or a CP) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., the neural processing unit) may include a hardware structure specified for artificial intelligence model processing. An artificial intelligence model may be generated by machine learning. Such learning may be performed, e.g., by the electronic device 101 where the artificial intelligence is performed or via a separate server (e.g., the server 108). Learning algorithms may include, but are not limited to, e.g., supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-network or a combination of two or more thereof but is not limited thereto. The artificial intelligence model may, additionally or alternatively, include a software structure other than the hardware structure.
The memory 130 may store various data used by at least one component (e.g., the processor 120 or the sensor module 176) of the electronic device 101. The various data may include, for example, software (e.g., the program 140) and input data or output data for a command related thereto. The memory 130 may include the volatile memory 132 or the non-volatile memory 134. The non-volatile memory 134 may include an internal memory 136 or external memory 138.
The program 140 may be stored in the memory 130 as software, and may include, for example, an operating system (OS) 142, middleware 144, or an application 146.
The input module 150 may receive a command or data to be used by another component (e.g., the processor 120) of the electronic device 101, from the outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
The audio output module 155 may output sound signals to the outside of the electronic device 101. The audio output module 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing record. The receiver may be used for receiving incoming calls. The receiver may be implemented as separate from, or as part of the speaker.
The display module 160 may visually provide information to the outside (e.g., a user) of the electronic device 101. The display module 160 may include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. The display module 160 may include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.
The audio module 170 may convert a sound into an electrical signal and vice versa. The audio module 170 may obtain the sound via the input module 150, or output the sound via the audio output module 155 or a headphone of an external electronic device (e.g., an electronic device 102) directly (e.g., wiredly) or wirelessly coupled with the electronic device 101.
The sensor module 176 may detect an operational state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) external to the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. The sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
The interface 177 may support one or more specified protocols to be used for the electronic device 101 to be coupled with the external electronic device (e.g., the electronic device 102) directly (e.g., wiredly) or wirelessly. The interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
A connection terminal 178 may include a connector via which the electronic device 101 may be physically connected with the external electronic device (e.g., the electronic device 102). The connection terminal 178 may include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).
The haptic module 179 may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus which may be recognized by a user via his tactile sensation or kinesthetic sensation. The haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
The camera module 180 may capture a still image or moving images. The camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
The power management module 188 may manage power supplied to the electronic device 101. The power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
The battery 189 may supply power to at least one component of the electronic device 101. The battery 189 may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.
The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and the external electronic device (e.g., the electronic device 102, the electronic device 104, or the server 108) and performing communication via the established communication channel. The communication module 190 may include one or more communication processors that are operable independently from the processor 120 (e.g., the AP) and supports a direct (e.g., wired) communication or a wireless communication. The communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device via the first network 198 (e.g., a short-range communication network, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, or a standard of the Infrared Data Association (IrDA)) or the second network 199 (e.g., a long-range communication network, such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multi components (e.g., multi chips) separate from each other. The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network, such as the first network 198 or the second network 199, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the SIM 196.
The wireless communication module 192 may support a 5G network, after a 4G network, and next-generation communication technology, e.g., new radio (NR) access technology. The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). The wireless communication module 192 may support a high-frequency band (e.g., the mmWave band) to achieve, e.g., a high data transmission rate. The wireless communication module 192 may support various technologies for securing performance on a high-frequency band, such as, e.g., beamforming, massive multiple-input and multiple-output (massive MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., the electronic device 104), or a network system (e.g., the second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate (e.g., 20 Gbps or more) for implementing eMBB, loss coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1 ms or less) for implementing URLLC.
The antenna module 197 may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device 101. The antenna module 197 may include an antenna including a radiating element including a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., array antennas). In such a case, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network 198 or the second network 199, may be selected, for example, by the communication module 190 (e.g., the wireless communication module 192) from the plurality of antennas. The signal or the power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. Another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 197.
According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to an embodiment, the mmWave antenna module may include a printed circuit board, a RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.
At least some of the above-described components may be coupled mutually and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).
Commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via the server 108 coupled with the second network 199. Each of the electronic devices 102 or 104 may be a device of a same type as, or a different type, from the electronic device 101. All or some of operations to be executed at the electronic device 101 may be executed at one or more of the external electronic devices 102, 104, or 108. For example, if the electronic device 101 should perform a function or a service automatically, or in response to a request from a user or another device, the electronic device 101, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device 101. The electronic device 101 may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device 101 may provide ultra low-latency services using, e.g., distributed computing or mobile edge computing. In an embodiment, the external electronic device 104 may include an internet-of-things (IoT) device. The server 108 may be an intelligent server using machine learning and/or a neural network. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology or IoT-related technology.
With the growing interest in health, the demand for home training is increasing. Home training may refer, for example, to a method in which the user performs a workout alone indoors. For example, home training may include a workout method in which workout-related content is played on a display device, and the user follows the workout while watching the played-up workout-related content.
With reference to
With reference to
According to an embodiment, the electronic device 101 may install a workout management app (e.g., a home training program, a home gym application) for providing an image related to home training to a user in a memory (e.g., the memory 130 of
According to various embodiments, the electronic device (e.g., the electronic device 101 of
With reference to
The processor 120 may include various processing circuitry and execute a program (e.g., the program 140 of
The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120, the display module 160, the camera module 180, and/or the communication module 190). The data may include, for example, input data or output data for software (e.g., the program 140 of
The display module 160 may include a display and visually provide the user with at least one content. For example, the processor 120 may generate a user interface 301 and display the generated user interface 301 through the display module 160. For example, when a home gym application is executed, the processor 120 may generate a user interface 301 corresponding to the home gym application and display it through the display module 160.
The camera module 180 may include a camera and record still images or moving images and may include at least one of at least one lens, an image sensor, an image signal processor, and/or a flash. According to an embodiment, the processor 120 may photograph a user's workout scene using the camera module 180 and display the photographed image through the display module 160. The processor 120 may provide a real-time recorded image to the user.
The communication module 190 may include various communication circuitry and establish a direct (e.g., wired) communication channel or wireless communication channel between the electronic device 101 and at least one external electronic device (e.g., the wearable device 310 and/or the display device 320) and may assist in performing communication through the established communication channel. According to an embodiment, the electronic device 101 may perform wireless communication with at least one external electronic device using the communication module 190 and share data with each other. The electronic device 101 may at least partially control the at least one external electronic device.
With reference to
The processor 311 of the wearable device 310 may include various processing circuitry and measure the heart rate of the user using the heart rate measurement module (e.g., including various processing circuitry and/or executable program instructions) 314 included in the sensor module 313. For example, the wearable device 310 may be mounted on the user's wrist, and the heart rate measurement module 314 may be disposed in response to a vascular position located on the user's wrist. The heart rate measurement module 314 may measure the user's heart rate based on blood flow through the user's blood vessels. The heart rate measurement module 314 may measure the user's heart rate in real time or at predetermined time intervals.
The processor 311 of the wearable device 310 may detect the user's movement using the motion sensing module (e.g., including various processing circuitry and/or executable program instructions) 315 included in the sensor module 313. For example, the motion sensing module 315 may include at least one sensor of a gyro sensor, an acceleration sensor, and/or a motion sensor and may detect the user's movement.
The processor 311 of the wearable device 310 may perform wireless communication with the electronic device 101 through the communication module 319 and may transmit the data measured or acquired using the sensor module 313 to the electronic device 101. According to an embodiment, the electronic device 101 may at least partially control the wearable device 310. For example, the electronic device 101 may control the wearable device 310 so that the wearable device 310 provides the electronic device 101 with the health information of the user measured by the wearable device 310 using the sensor module 313.
With reference to
The processor 321 of the display device 320 may include various processing circuitry and provide visual information to the user using the display module 323. The display device 310 may perform wireless communication with the electronic device 101 through the communication module 319 and may visually display at least one content received from the electronic device 101 through the display module 323. For example, the display device 320 may receive a user interface from the electronic device 101 and display the user interface through the display module 323 under the control of the electronic device 101.
According to various embodiments, the electronic device (e.g., the electronic device 101 of
According to an embodiment, when providing a home gym service 412 to the user, the electronic device 101 may display the user's health information and the user's workout image together while playing back workout-related content based on the video playback application 450 (e.g., a third-party application, a multiplayer program, and/or a multiplayer). The electronic device 101 may provide the user with workout-related content, health information about the user, and a workout image, and the user can perform home training while identifying his or her health information and his or her workout posture.
According to an embodiment, the electronic device 101 may include the video playback application 450 (e.g., a third-party application, a multiplayer program, and/or a multiplayer) for displaying workout-related content, a home gym application 410 for providing a home gym service 412 to the user, a health application 420 for acquiring the user's health information, and/or a mirroring application 430 for the same output of a user interface 411 displayed on the display module 160 of the electronic device 101 through the display device 320.
According to an embodiment, the electronic device 101 may execute the home gym application 410 for providing the home gym service 412 to the user and may activate the home gym application 410 in the background. According to an embodiment, the electronic device 101 may execute the health application 420 in response to the execution of the home gym application 410. When the home gym application 410 is activated, the processor 120 may identify whether a workout-related function has been executed in the video playback application 450 or whether workout-related content has been played. The home gym application 410 may determine the configuration information by the user. The configuration information may include information as shown in (Table 1) below.
For example, the Package_name may be provided in the form of a string and may indicate whether the workout-related content is executed in the background state or foreground state in the video playback application 450 (e.g., a third-party app). According to an embodiment, the home gym application 410 may determine whether to execute workout-related content based on the configuration information. According to an embodiment, the video playback application 450 may determine whether to play workout-related content through the health program service 451 and report whether the workout-related content is played to the home gym application 410. The home gym application 410 may determine whether to execute workout-related content based on the information reported from the video playback application 450. The home gym application 410 may be executed in the same way as the package state of the workout-related content. For example, heart rate/calorie/duration is provided in a boolean format, and the home gym application 410 may determine whether to provide the user's heart rate information, calorie information, and/or workout time information together with the workout-related content. With reference to Table 1, the home gym application 410 may not provide all of the heart rate information, the calorie information, and/or the workout time information when displaying workout-related content. For example, the preview may indicate whether to provide a user's workout image (e.g., a preview image) photographed using the camera module 180. The View_type may indicate information about the screen configuration when the workout image is provided to the user. For example, the View_type may display the workout-related content and the user's workout image in the same proportion and half-and-half on the screen, or the user's workout image may be laid out based on the workout-related content and be displayed over the workout-related content.
According to an embodiment, when a workout-related function is executed, the video playback application 450 may transmit workout-related information indicating that the workout-related function has been executed to the home gym application 410. For example, the video playback application 450 may broadcast that a workout-related function has been executed. The workout-related information may include code information such as Table 2.
According to an embodiment, when the home gym application 410 receives workout-related information from the video playback application 450, it may identify that the workout-related function has been executed based on the video playback application 450.
According to an embodiment, the video playback application 450 may generate workout-related metadata when workout-related content is played. Workout-related metadata may include code information such as Table 3.
According to an embodiment, the video playback application 450 may add metadata “com.samsung.android.app.homegym.FITNESS” to the METADATA_KEY_GENRE when playing workout-related content. The home gym application 410 may acquire metadata information from the video playback application 450 when workout-related content is played through the video playback application 450 and identify the metadata information included in the METADATA_KEY_GENRE.
According to various embodiments, the electronic device 101 may identify workout-related information and/or metadata through the video playback application 450 while the home gym application 410 is active, and the video playback application 450 may determine whether workout-related content is being played.
According to an embodiment, the electronic device 101 may also execute the health application 420 in response to the execution of the home gym application 410. The home gym application 410 may be interlocked with the health application 420, and through the health application 420, the user's health information (e.g., the heart rate information, the movement information, the calorie information) may be acquired from an external electronic device (e.g., the wearable device 310). According to an embodiment, the home gym application 410 and the health application 420 may perform inter-process communication (IPC) interworking with each other. For example, when interlocking with IPC, the home gym application 410 may operate as a client, and the health application 420 may operate as a host. The home gym application 410 (e.g., the client) may request the workout tracking service 421 from the health application 420 (e.g., the host), and the health application 420 may provide information related to the workout tracking service 421 to the home gym application 410. The home gym application 410 and the health application 420 may form an environment in which messages are exchanged with each other.
According to an embodiment, the home gym application 410 may request the health information of the user from the health application 420. In response to the request, the health application 420 may execute the workout tracking service 421. For example, the health application 420 may acquire the health information of the user using the wearable device 310 connected to the electronic device 101 and provide the acquired health information to the home gym application 410. The wearable device 310 may measure the health information of the user using the health application 461. The wearable device 310 may be mounted on the user's wrist, and a sensor module (e.g., the sensor module 313 of
According to an embodiment, when executing the workout tracking service 421, the health application 420 may photograph the user's workout scene using the camera module 180 of the electronic device 101. For example, the user may place the camera module 180 of the electronic device 101 to focus on himself or herself during home training and control the electronic device 101 so that the electronic device 101 photographs his or her workout scene. The health application 420 may acquire a user's workout scene photographed using the camera module 180 and may provide image information on which the user's workout scene is photographed to the home gym application 410. According to an embodiment, the home gym application 410 may directly access the camera module 180 while playing video related content through the video playback application 450 and may use the camera module 180 to acquire a user's workout scene.
According to an embodiment, the home gym application 410 may acquire the user's health information and the user's workout scene image information from the health application 420 and configure the user interface 411 based on the health information and the image information. For example, the home gym application 410 may determine whether to include the health information and the image information in the user interface 411, or if so, in which area to dispose it. For example, the configuration information described in above Table 1 may include configuration information such as whether to include the health information and the image information in the user interface 411, or if so, in which area to dispose it, and the home gym application 410 may configure the user interface 411 based on the configuration information.
According to an embodiment, the home gym application 410 may display the user interface 411 at the display unit 462 of the display device 320 that communicates with the electronic device 101 through the mirroring application 430. For example, the display device 320 may include a display unit 462 (e.g., the display module 323 of
According to various example embodiments, an electronic device may comprise: a communication module comprising communication circuitry configured to communicate with at least one external electronic device; a memory for storing at least one app; and a processor operatively connected to the communication module and the memory. The processor may be configured to: activate a workout management app (e.g., home gym app) stored in the memory; in response to the execution of the at least one app, identify whether a workout-related content has been executed based on the activated workout management app; display an object for execution of a training program through the workout management app based on the workout-related content being executed; in response to an input on the object, make an automatic connection with the at least one external electronic device through the communication module; configure, based on at least one workout-related information acquired from the at least one external electronic device, a training program screen into which the workout-related content and the workout-related information are integrated; and control the external electronic device to display the training program screen.
According to an example embodiment, the processor may be configured to at least partially activate the workout management app in the background state.
According to an example embodiment, the processor may be configured to: identify the declaration information according to the execution of the workout-related function based on the workout management app and identify that the workout-related content has been executed based on the identified declaration information.
According to an example embodiment, the processor may be configured to: identify the metadata according to playback of workout-related content based on the workout management app and identify that the workout-related content has been executed based on the identified metadata.
According to an embodiment, the at least one external electronic device may include: a wearable device including circuitry configured to acquire biometric information and a display device including a display configured to display a workout image of a user, wherein the workout-related information may include biometric information and a workout image of the user.
According to an example embodiment, the processor may be configured to acquire biometric information of a user measured using the wearable device from the wearable device.
According to an example embodiment, the biometric information of the user may include at least one of a heart rate, a heart rate variability (HRV), a calorie consumption, an oxygen saturation SpO2, a blood pressure (BP), a fatigue, a stress, a blood sugar, a body water, an electrocardiogram (ECG), an electrodermal activity (EDA), a bioelectrical impedance analysis (BIA), and a workout elapsed time.
The electronic device according to an example embodiment may further include: a camera module including a camera configured to photograph the user's workout image, and the processor may be configured to control the camera module to photograph the user's workout scene in a real time or according to a specified time interval and acquire the user's workout image using the camera module.
According to an example embodiment, the processor may be configured to: activate a health management app (e.g., a health app) configured to acquire at least one workout-related information, and based on the health management app, the processor may configured to at least partially control the wearable device included in the at least one external electronic device.
According to an example embodiment, the processor may be configured to: perform inter-process communication (IPC) interworking between the workout management app and the health management app, acquire the messenger information of another party, and transmit the message between the workout management app and the health management app based on the acquired messenger information.
According to an example embodiment, the processor may be configured to: activate a mirroring app for displaying the training program screen, and may at least partially control a display device included in the at least one external electronic device based on the mirroring app.
According to various embodiments, the electronic device (e.g., the electronic device 101 of
In operation 501, the processor of the electronic device 101 (e.g., the processor 120 of
In operation 503, the processor 120 may identify whether the executed content is content related to workout in response to the execution of at least one content. The electronic device 101 may store at least one application in a memory (e.g., the memory 130 of
In operation 503, the processor 120 may identify whether a workout-related function is being executed or whether workout-related content is being played using the video playback application 450. For example, the video playback application 450 may declare that the workout-related function has been executed when the workout-related function is executed, and the processor 120 may identify that the workout-related function has been executed based on the declaration. For example, the video playback application 450 may generate workout-related metadata when workout-related content is played and may report the generated workout-related metadata to the home gym application 410. The processor 120 may identify that the workout-related content has been executed based on the workout-related metadata reported from the video playback application 450 through the home gym application 410.
According to an embodiment, the processor 120 may determine whether the running content is workout-related content based on the declaration information of the workout-related function and the metadata of the workout-related content.
Once the execution of the workout-related content is identified in operation 503, the processor 120 in operation 505 may display an object (e.g., an icon, a ticker, and/or a pop-up message) for interworking with at least one external electronic device (e.g., the wearable device 310 of
In operation 507, the processor 120 may activate a workout tracking app (e.g., the health application 420 of
In operation 509, the processor 120 may acquire biometric information of the user from the wearable device 310. For example, the wearable device 310 may be worn in at least partial contact with the user's body and may measure and acquire the user's biometric information. For example, the biometric information of the user that the processor 120 may acquire from the wearable device 310 may include at least one of a heart rate (HR), a heart rate variability (HRV), a calorie consumption, an oxygen saturation ((SpO2), a blood pressure (BP), a fatigue, a stress, a blood sugar, a body hydration, an electrocardiogram (ECG), an electrodermal activity (EDA), and a bioelectrical impedance analysis (BIA). For example, the electrodermal activity (EDA) may include galvanic skin response (GSR) information. According to an embodiment, the wearable device 310 may include a wearable watch worn on the user's wrist. According to an embodiment, the processor 120 may request the user's biometric information from the wearable device 310 based on the workout tracking app, and in response to the request, the wearable device 310 may provide the user's biometric information to the electronic device 101. Operation 509 may be performed according to the user's configurations for the home gym service.
In operation 511, the processor 120 may photograph a user's workout scene and acquire a workout image using a camera module (e.g., camera module 180 of
In operation 513, the processor 120 may perform a mirroring function with the display device 320. For example, the processor 120 may execute a mirroring app (e.g., the mirroring app 430 of
According to an embodiment, operations 509 to 513 may be executed sequentially or substantially simultaneously, and the order of operation may be changed depending on how the user configures. The order of operations 509 to 513 is not limited.
In operation 515, the processor 120 may include a user interface (e.g., the user interface 411 of
According to an embodiment, the electronic device 101 may provide a home gym service to the user, and through the display device 320, in displaying workout-related content, the user's health information and/or the user's workout scene may be displayed together. For example, the electronic device 101 may acquire the user's health information from the wearable device 310 and may photograph the user's workout scene using the camera module 180. The electronic device 101 may configure a user interface corresponding to the home gym service based on the user's health information and the user's workout scene and may perform a mirroring function for the display device 320 so that the user interface is displayed through the display device 320. The electronic device 101 may perform a home gym service to provide a home training user with his or her health information (e.g., a heart rate, a calorie consumption) and his or her workout posture while watching workout-related content. The home gym service can provide users with the ability to improve their workout efficiency according to home training. Users can maximize and/or improve the effect of workout according to home training.
According to an embodiment, the electronic device 101 may include a home gym application (e.g., the home gym application 410 of
According to an embodiment, the electronic device 101 may execute the home gym application 410 in providing a home gym service to the user, and the home gym application 410 may be activated. For example, the home gym application 410 may remain running in the background.
In operation 601, the electronic device 101 may play back workout-related content using the video playback application 450. The electronic device 101 may identify whether the workout-related content is played based on the declaration information and metadata corresponding to the video playback application 450 through the running home gym application 410. For example, the video playback application 450 may generate workout-related metadata when workout-related content is played and may report the generated workout-related metadata to the home gym application 410. The home gym application 410 may identify that the workout-related content has been executed based on the reported workout-related metadata. According to an embodiment, the video playback application 450 may declare that the workout-related function has been executed when the workout-related function is executed, and the home gym application 410 may identify that the workout-related function has been executed based on the declaration information.
In operation 603, the home gym application 410 may identify the playback of workout-related content and start the home gym service. According to an embodiment, the state in which the home gym application 410 is activated in the background may be defined as the start of the home gym service. According to an embodiment, when the home gym service is executed, the electronic device 101 may perform wireless communication with the wearable device 310 and/or the display device 320 and may transmit and receive data to/from each other.
In operation 605, the home gym application 410 may request screen mirroring according to the execution of the mirroring function to the mirroring application 430, and in operation 607, the mirroring application 430 may request screen mirroring to the mirroring application 620 running in the display device 320. For example, screen mirroring may be defined as a function that displays identically the screen being displayed through the display module 160 of the electronic device 101 at the display device 320. According to an embodiment, in the case of interlocking each other, when the screen of the electronic device 101 is changed based on the mirroring function in the electronic device 101 and the display device 320, the screen of the display device 320 may also be changed in the same way as the screen of the electronic device 101. According to an embodiment, compared to the user interface displayed on the screen of the electronic device 101, the display device 320 may display at least a partially adjusted user interface based on the size of the screen, the ratio of the screen, the resolution, and/or the number of pixels.
In operation 609, the home gym application 410 may be interlocked with the health application 420, and in operation 611, a workout tracking service may be requested.
In operation 613, the health application 420 may request the user's biometric information from the health application 461 running on the wearable device 310. For example, the wearable device 310 may be mounted to at least partially contact the user's body and may measure the user's biometric information (e.g., a heart rate, a calorie consumption). In operation 615, the health application 461 of the wearable device 310 may provide the user's biometric information to the health application 420 of the electronic device 101.
In operation 617, the health application 420 may provide the home gym application 410 with the user's biometric information acquired from the wearable device 310.
In operation 619, the home gym application 410 may generate a user interface corresponding to the home gym service. For example, the home gym application 410 may generate a user interface to display workout-related content and the user's biometric information acquired from the wearable device 310 together. According to an embodiment, the home gym application 410 may use a camera module of the electronic device 101 (e.g., the camera module 180 of
According to an embodiment, the electronic device (e.g., the electronic device 101 of
With reference to
In operation 703, the home gym host service 720 may perform a workout tracking request to the workout tracking service 721. In operation 704, the workout tracking service 721 may transmit a workout tracking request signal to the health application 461 of the wearable device (e.g., the wearable device 310 of
In operation 707, the home gym host service 720 may provide the home gym client service 710 with the user's biometric information acquired from the health application 461 of the wearable device 310.
According to an embodiment, the home gym application 410 and the health application 420 may maintain an IPC interlocking state and may transmit and receive messages to/from each other.
According to an embodiment, the electronic device (e.g., the electronic device 101 of
In operation 739, the home gym host service 720 may acquire workout-related information (e.g., the biometric information of the user related to workout) for a user from the wearable device (e.g., the wearable device 310 of
According to an embodiment, the electronic device (e.g., the electronic device 101 of
With reference to
In operation 802, the home gym host service 720 may transmit a workout termination signal to the workout tracking service 721, and in operation 803, the workout tracking service 721 may transmit the workout termination signal to the health application 461 of the wearable device 310 (e.g., the wearable device 310 of
In operation 807, the home gym host service 720 may transmit information (e.g., playback video information, playback image information) about workout-related content to the database (DB) 810. In operation 808, the database 810 may integrate and store information on the user's biometric information and workout-related content provided from the health application 420. According to an embodiment, the processor 120 of the electronic device 101 may configure and display a user interface based on the database 810 stored in the memory 130 when the home gym service is terminated. When the home gym service is terminated, the user may identify the integrated results of home training by the home gym service. For example, the user may intuitively identify the amount of heart rate change due to home training, calorie consumption, and/or time information of performing home training.
With reference to
According to an embodiment, the processor of the electronic device 101 (e.g., the processor 120 of
According to an embodiment, the processor 120 may respond to the execution of at least one content to determine whether the executed content is content related to workout. The electronic device 101 may store at least one application in a memory (e.g., the memory 130 of
With reference to
According to an embodiment, an electronic device (e.g., the electronic device 101 of
According to an embodiment, the electronic device 101 may be operatively connected to at least one external electronic device (e.g., the wearable device 310 of
With reference to
According to an embodiment, the electronic device 101 may display the user's biometric information and the user's workout image together while playing workout-related content by the home gym service. While doing home training, users may intuitively identify their physical changes and workout posture.
According to an embodiment, the electronic device (e.g., the electronic device 101 of
With reference to
A method according to various example embodiments may comprise: activating a workout management app for managing a user's workout; identifying whether workout-related content has been executed based on the activated workout management app in response to the execution of at least one app stored in memory; based on the workout-related content being executed, displaying an object for executing a training program through the workout management app; in response to an input to the object, making an automatic connection with at least one external electronic device; configuring a training program screen into which the workout-related content and workout-related information are integrated based on at least one workout-related information acquired from the at least one external electronic device; and displaying the training program screen through the at least one external electronic device
According to an example embodiment, the activating the workout management app may include at least partially activating the workout management app in the background.
According to an example embodiment, the identifying whether the workout-related content has been executed may include: identifying the declaration information according to the execution of the workout-related function based on the workout management app, and identifying that the workout-related content has been executed based on the identified declaration information.
According to an example embodiment, the identifying whether the workout-related content has been executed may include: identifying metadata according to playback of workout-related content based on the workout management app and identifying that the workout-related content has been executed based on the identified metadata.
The method according to an example embodiment may further include: measuring the biometric information of the user using a wearable device for acquiring the biometric information of the user, and acquiring the measured biometric information of the user from the wearable device, wherein the biometric information of the user may include at least one of the heart rate, the calorie consumption, and the workout elapsed time for the user.
The method according to an example embodiment may further include: photographing a user's workout scene in real time or according to a specified time interval using a camera module for photographing a user's workout image and acquiring a user's workout image.
The method according to an example embodiment may further include: activating a health management app (e.g., a health app) for acquiring at least one workout-related information, and at least partially controlling a wearable device included in the at least one external electronic device based on the health management app.
The method according to an example embodiment may further include: performing inter-process communication (IPC) interworking between the workout management app and the health management app, acquiring messenger information of another party, and transmitting a message between the workout management app and the health management app based on the acquired messenger information.
The method according to an example embodiment may further include: activating a mirroring app for displaying the training program screen, and at least partially controlling a display device included in at least one external electronic device based on the mirroring app.
The electronic device according to various embodiments may be one of various types of electronic devices. The electronic devices may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a home appliance, or the like. According to an embodiment of the disclosure, the electronic devices are not limited to those described above.
It should be appreciated that various embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C,” may include any one of, or all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as “1st” and “2nd,” or “first” and “second” may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.
As used in connection with various embodiments of the disclosure, the term “module” may include a unit implemented in hardware, software, or firmware, or any combination thereof, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” or “circuitry”. A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).
Various embodiments as set forth herein may be implemented as software (e.g., the program 140) including one or more instructions that are stored in a storage medium (e.g., internal memory 136 or external memory 138) that is readable by a machine (e.g., the electronic device 101). For example, a processor (e.g., the processor 120) of the machine (e.g., the electronic device 101) may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include a code generated by a compiler or a code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the “non-transitory” storage medium is a tangible device, and may not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.
According to an embodiment, a method according to various embodiments of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.
According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to various embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.
While the disclosure has been illustrated and described with reference to various example embodiments, it will be understood that the various example embodiments are intended to be illustrative, not limiting. It will be further understood by those skilled in the art that various changes in form and detail may be made without departing from the true spirit and full scope of the disclosure, including the appended claims and their equivalents. It will also be understood that any of the embodiment(s) described herein may be used in conjunction with any other embodiment(s) described herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2021-0017860 | Feb 2021 | KR | national |
This application is a continuation of International Application No. PCT/KR2022/000772 designating the United States, filed on Jan. 14, 2022, in the Korean Intellectual Property Receiving Office and claiming priority to Korean Patent Application No. 10-2021-0017860, filed on Feb. 8, 2021, in the Korean Intellectual Property Office, the disclosures of each of which are incorporated by reference herein in their entireties.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/KR2022/000772 | Jan 2022 | US |
| Child | 18352661 | US |
