Various embodiments of the disclosure relate to a wearable device and a method for measuring biometric information, and to an electronic device and a method for detecting when the two hands of a user come into contact with each other when measuring biometric information.
The disclosure relates to a body component measurement device using bioelectrical impedance and, specifically, to a method and a device for detecting when the two hands of a user come into contact with each other.
The four principal components that make up a biological body include water, protein, body fat, and minerals. The ratios between these components in the body, in particular in human bodies, vary by gender and individual, but is approximately 55:20:20:5. These four components may be identified based on the total amount of water in the body. The protein and the total body water are main components for forming muscle and have a mutually proportional relationship, and thus the amount of protein and inorganic mass may be determined based on the amount of the total body water and the amount of body fat may be determined by subtracting the amount of the total body water, protein, and inorganic mass from the body weight. The most frequently used methods for measuring body fat may be bioelectrical impedance analysis (BIA) and underwater body density analysis. Other methods include computed tomography, subcutaneous fat thickness measurement, etc.
The bioelectrical impedance analysis is a method of measuring body fat based on the fact that the amount of the total body water and the body's electrical resistance are in inverse proportion.
The bioelectrical impedance analysis has advantages in that the measurement is simple, fast, and non-invasive. When a weak alternating current electrical signal is applied to a human body, the electricity flows along the total body water having high conductivity. The width of the path through which the electricity flows is determined according to the amount of moisture, and a measurement value according thereto is the bio-impedance. A method of calculating a body component from the bio-impedance includes applying a fine alternating current through the human body in the frequency band of 50 kHz. When the current flows, human body resistance is measured and used to calculate the total body water amount. The protein amount and the inorganic material amount are calculated from the total body water amount and body fat is calculated by using the protein amount, the inorganic material amount, and the body weight.
A conventional wearable device for measuring a body component may require an electrode to be contact with one wrist of one arm and another electrode to be contact with the other arm or a finger so as to accurately measure human body impedance. When the measurement is taken, the arms of the user should not be in contact with each other. However, accurate measurement of human body impedance may be difficult when both arms are in contact with each other due to user's negligence.
In addition, because the wearable device is used in everyday life rather in in restricted settings such as in hospitals, it may be difficult to demand the user perform specific postures.
An electronic device according to an embodiment may include a housing and a biometric sensor, wherein the biometric sensor is configured to sense whether a first part of a human body is in contact with a first electrode and a second electrode, detect whether a second part of the human body is in contact with a third electrode and a fourth electrode, acquire impedance phase information of the human body by using the first, second, third and fourth electrodes, determine whether the acquired impedance phase information is within a designated range, and provide a guide for a measurement method in case that the acquired phase information of the impedance deviates from the designated range.
An operation method of an electronic device according to an embodiment may include an operation of sensing, through a biometric sensor, whether a first part of a human body is in contact with a first electrode and a second electrode, an operation of detecting, through the biometric sensor, whether a second part of the human body is in contact with a third electrode and a fourth electrode, an operation of acquiring impedance phase information of the human body by using the first, second, third, and fourth electrodes, an operation of determining whether the acquired impedance phase information is within a designated range, and an operation of providing a guide for a measurement method in case that the acquired impedance phase information deviates from the designated range.
An electronic device according to an embodiment may include a housing including a first surface configured to come into contact with a first portion of a human body of a user when worn, a second surface configured to not come into contact with the first portion of the human body in case that the first surface comes into contact with the first portion, and a lateral surface configured to surround at least a portion of a space between the first surface and the second surface, a memory, a biometric circuit including a first electrode and a second electrode exposed through the first surface and a third electrode and a fourth electrode exposed through at least one of the second surface and the lateral surface, and at least one processor electrically connected to the biometric circuit and the memory, wherein the at least one processor is configured to measure a parasitic impedance value through the biometric sensor, store the measured parasitic impedance value in the memory, detect, through the biometric circuit, that the first portion of the human body comes into contact with the first electrode and the second electrode, detect, through the biometric circuit, that a second portion of the human body comes into contact with the third electrode and the fourth electrode, apply a current to the human body through the second electrode and the third electrode via the biometric circuit, measure, through the biometric circuit, a voltage across both ends of the first electrode and the fourth electrode in response to the application of the current, acquire impedance phase information of the human body based on the applied current, the measured voltage, and the parasitic impedance value, and provide notification related to biometric data measurement in case that the acquired impedance phase information deviated from a predetermined range.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments.
The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
One or more embodiments of the instant disclosure relate to a method for detecting when the two arms of the user are in contact to each other so as to inform the user that measurement is not performed properly and to guide the user to perform remeasurement.
The electronic device and the method according to one or more embodiments of the instant disclosure may provide users with biometric information more accurately and quickly by promptly detecting the situation where body component measurement is not performed properly and guiding the user to measure correctly.
The wearable device 100 in
According to an embodiment, the wearable device 100 may include a strap to be attached to the body of the user 101 in which the strap is wound around a wrist of the user 101. However, without limitation thereto, the wearable device 100 may having various other shapes, sizes, etc. so as to be attached to various other body parts of the user 101. For example, the wearable device 100 may be attached to portions of the hand such as the back of the hand, a finger, a fingernail, a fingertip, and the like, as well.
Referring to
According to an embodiment, the housing 110 may include a first surface facing a first direction, a second surface facing a second direction opposite to the first direction, and a lateral surface configured to surround at least a portion of the space between the first surface and the second surface. According to an embodiment, two or more of the first surface, the second surface, and the lateral surface of the housing 110 may be integrated together. According to an embodiment, the housing 110 may be configured by various combinations. For example, the housing 110 may be configured by a combination of a lateral bezel structure 111 and a rear plate 193 in
According to an embodiment, the electrode 201, 202, 203, or 204 may be exposed to the outside or exterior of the wearable device through at least a portion of the housing 110. For example, at least one of the first electrode 201 and the second electrode 202 may be exposed to the outside through at least a portion of the first surface of the housing. Furthermore, at least one of the third electrode 203 and the fourth electrode 204 may be exposed to the outside through at least a portion of the second surface and/or the lateral surface of the housing. The electrode 201, 202, 203, or 204 may be made of a conductive material through which electrical current may flow. The shape and size of the electrode may vary. In various different embodiments, at least one electrode included in the wearable device 100 may be disposed on the first surface and the second surface of the wearable device 100, or on a portion of the housing 110 other than the first surface and the second surface.
According to an embodiment, the display 120 may visually provide biometric data of the user to the user of the wearable device 100. According to an embodiment, the display 120 may convert an output screen through an input of the user with respect to a portion (e.g., bezel) of the housing 110. For example, the display 120 may convert a watch screen into a biometric data screen (e.g., displaying body components and heart rate) in response to a user input.
According to an embodiment, the strap 130 may be connected to at least a portion of the housing 110 and detachably couple the wearable device 100 to a portion (e.g., a wrist, an ankle, and the like) of the user body. According to an embodiment, the user of the wearable device 100 may adjust the strap 130 to increase a degree of adhesion.
Referring to
The memory may include, for example, a volatile memory or a non-volatile memory. The interface may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, and/or an audio interface. The interface, for example, may electrically or physically connect the electronic device 100 to an external electronic device, and may include a USB connector, an SD card/MMC connector, or an audio connector.
The battery 170 is a device for supplying power to at least one component of the electronic device 100, and may include, for example, a non-rechargeable primary battery, or a rechargeable secondary battery, or a fuel cell. At least a part of the battery 170 may be disposed on the substantially same plane as the printed circuit board 180. The battery 170 may be disposed and integrally formed in the electronic device 100 or may be disposed to be attachable to/detachable from the electronic device 100.
The antenna 150 may be disposed between the display 120 and the support member 160. The antenna 150 may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. The antenna 150, for example, may perform a near field communication with an external electronic device, wirelessly transmit and receive power required for charging, or transmit a magnetism-based signal including a near field communication signal or payment data. In another embodiment, an antenna structure may be formed of a part or a combination of the lateral bezel structure 111 and/or the support member 160.
The sealing member 190 may be disposed between the lateral bezel structure 111 and the rear plate 193. The sealing member 190 may be configured to block moisture and foreign substances from being introduced from the outside to the internal space of the wearable device, i.e., the space surrounded by the lateral bezel structure 111 and the rear plate 193.
The biometric sensor 140 and the wireless charging coil 142 may be located between the rear plate 193 and the electrode 146. In another embodiment, the biometric sensor 140 and the wireless charging coil 142 may also be located between the sealing member 190 and the electrode 146.
The electrode 146 may be exposed to the outside through the first surface of the housing 110. According to an embodiment, the electrode 146 may include two or more electrodes electrically separated from each other.
Referring to
According to an embodiment, the electrode 146 may be electrically connected to the biometric sensor 140 included in the electronic device 100 and used for acquiring body information or health information. For example, the electrode 146 may be electrically connected to a bioelectric impedance analysis (BIA) sensor included in the electronic device 100 and used for measuring body fat ratio. Furthermore, the electrode may be electrically connected to an electrocardiogram (ECG) sensor included in the electronic device and used for measuring electrocardiogram. The sensors connectible to the electrode 146 described above are merely exemplary and the instant disclosure is not limited thereto.
The structure of the above-described wearable device 100 is exemplary and the wearable device 100 may be implemented differently from
Referring to
According to an embodiment, the processor 310 may acquire biometric data (e.g., impedance phase information) of the user based on data values (e.g., data regarding a body component) acquired from the sensor part 370. According to an embodiment, the processor 310 may provide the acquired biometric data to the user through the display 320. According to an embodiment, in case that the acquired biometric data deviates from a predetermined range, the processor 310 may provide a guide for inducing remeasurement to the user through the display 320.
According to an embodiment, the memory 330 may store various data used by at least one component (e.g., the processor) of the electronic device 100. For example, the memory 330 may store user biometric data acquired by the sensor part 370.
According to an embodiment, the speaker 340 may output audio data stored in the memory 330, based on the user biometric data acquired by the sensor part 370. For example, in case that the acquired biometric data deviates from a predetermined range, the processor 310 may output a voice guide or sound for providing a notification related to remeasurement to the user through the speaker 340.
According to an embodiment, the motor 350 may convert an electrical signal into a mechanical stimulation (e.g., vibration or movement) that a user may perceive. For example, in case that the user's wearing is detected, but both hands of a user are in contact, or it is determined that the electrode has an error, the processor 310 may output vibration through the motor 350.
According to an embodiment, the LED 360 may emit visible light based on an electrical signal received from the biometric sensor. For example, in case that the user's wearing is detected, but both hands of the user are in contact, or it is determined that the electrode has an error, the processor 310 may provide a notification to a user through flashing of the LED.
According to an embodiment, the sensor part 370 may detect a state of the user and transmit a signal corresponding to the detected state to the processor 310. According to an embodiment, the sensor part 370 may include a biometric sensor (e.g., the biometric sensor 140 in
According to an embodiment, the sensor part 370 may include multiple electrodes. According to an embodiment, the multiple electrodes may include a first electrode, a second electrode, a third electrode, and a fourth electrode. According to an embodiment, the first electrode and the second electrode may come into contact with a first area 380 of the user body. According to an embodiment, the third electrode and the fourth electrode may come into contact with a second area 390 of the user body, which does not overlap the first area 380.
The sensor part 370 disclosed herein may be referred to as simply a sensor, a sensor circuit, a sensor module, or the like.
According to an embodiment, the BIA sensor (e.g., the biometric sensor 140 in
According to an embodiment, the first electrode 370a of the biometric sensor may come into contact with a portion 500a of a right hand (or a left hand) of the user 101, the second electrode 370b may come into contact with a portion 500b of the right hand of the user 101 that does not overlap with the portion 500a of the right hand (or the left hand) of the user.
According to an embodiment, the third electrode 370c of the biometric sensor may come into contact with a portion 500c of the left hand (or the right hand) of the user and the fourth electrode 370d may come into contact with a portion 500d of the left hand (or the right hand).
Referring to
According to an embodiment, a second electrode 630b (e.g., the second electrode 370b in
According to an embodiment the first electrode 630a and the third electrode 630c may be electrodes for supplying a current. According to an embodiment the second electrode 630b and the fourth electrode 630d may be electrodes for measuring a voltage. According to an embodiment, in case that a user body comes into contact with the first electrode and the third electrode, a human body closed loop may be formed. According to an embodiment, in case that the human body closed loop is formed, a value corresponding to the sum of impedances of the left arm and the right arm may be measured.
Referring to
According to an embodiment, the parasitic impedance value 601 may be derived from a parasitic component inside the wearable device. For example, the parasitic component may include at least one of unintentionally produced resistance, capacitance, inductance, and/or a component that interfere with an electrical signal in the biometric circuit 650.
According to an embodiment, the processor 310 may store the parasitic impedance value 601 measured through the biometric circuit 650 in the memory. According to an embodiment, the processor 310 may detect, through the biometric circuit 650, that a first portion of the human body of the user 101 comes into contact with the first electrode 630a and the second electrode 630b and a second portion of the human body of the user 101 comes into contact with the third electrode 630c and the fourth electrode 630d.
According to an embodiment, the processor 310 may apply a current to the human body through the second electrode 630b and the third electrode 630c via the biometric circuit 650. According to an embodiment, in case that a portion of the user (101) body comes into contact with the first electrode 630a and the third electrode 630c, a micro current may flow to the human body. According to an embodiment, in case that the micro current flows to the human body, a current loop 620 may be formed between the contacted portions. According to an embodiment, the current may flow through the current loop 620.
According to an embodiment, the processor 310 may measure the voltage across both ends of the first electrode 630a and the fourth electrode 630d through the biometric circuit 650 in response to the application of the current. According to an embodiment, a voltage loop 640 in which voltage is measured may be formed in the human body.
According to an embodiment, the processor 310 may acquire impedance phase information of the human body based on the applied current, the measured voltage, and the parasitic impedance value 601.
According to an embodiment, in case that the acquired impedance information deviates from a predetermined range, the processor 310 may be configured to provide a notification related to the biometric data measurement.
According to an embodiment, in operation 710, the wearable device (e.g., the wearable device 100 in
According to an embodiment, in operation 720, the wearable device 100 may detect, through the biometric sensor, that a second portion of the human body comes into contact with a third electrode and a fourth electrode.
According to an embodiment, in case of detecting a measurement mode, the wearable device 100 may detect that the first portion of the human body comes into contact with the first electrode and the second electrode and that the second portion of the human body comes into contact with the third electrode and the fourth electrode so as to measure biometric information. According to an embodiment, in case of detecting that the first portion of the human body comes into contact with the first electrode and the second electrode and that the second portion of the human body comes into contact with the third electrode and the fourth electrode, the wearable device 100 may automatically measure biometric information. According to an embodiment, the biometric information may include impedance phase information and/or impedance size information.
According to an embodiment, in operation 730, the wearable device 100 may acquire impedance phase information of the human body by using Equation 1, Equation 2, and Equation 3.
Z=R+jX [Equation 1]
In Equation 1, Z indicates a bio-impedance value. R indicates a resistance component and X indicates a reactance component. The impedance phase information is acquired by using the reactance component.
V=IR [Equation 2]
In Equation 2, V indicates a voltage value measured by a voltage detector. I indicates a current value, which flows through a human body from an alternating current source. R indicates a resistance component. The resistance component is acquired by using the voltage value and the current value.
In Equation 3, a phase angle may refer to a phase angle difference between a voltage and a current. XL indicates an inductive reactance, and XC means a capacitive reactance. The phase angle is acquired by using information of the inductive reactance and/or the capacitive reactance. For example, the value of the capacitive reactance may be acquired by using the value of a voltage at an electrode and the value of a reference capacitance inside a circuit. As shown in the above-described embodiment, the phase angle may be acquired by using information of the inductive reactance.
According to an embodiment, in operation 740, the wearable device 100 may determine whether the acquired impedance phase information acquired using Equation 2 and Equation 3 calculated by the processor falls within a predetermined range.
According to an embodiment, in case that the acquired impedance phase information falls within a predetermined range, the wearable device 100 may provide a UI indicating that measurement is normally performed to the user through a display.
According to an embodiment, in operation 750, in case that acquired phase information deviates the predetermined range, the wearable device 100 may provide a notification to the user. According to another embodiment, in case that acquired impedance size information deviates the predetermined range, the wearable device 100 may provide a notification to the user.
According to an embodiment, in case that the acquired phase information falls within a first range, the wearable device 100 may provide a notification to indicate measurement error. For example, the measurement error may include at least one of a case in which user's information is insufficiently input, a case in which a user's wrist is not into contact with an electrode, a case in which a user's finger is not in contact with an electrode, a case in which a user's wrist is dry enough to prevent a current from flowing, a case in which a user's finger is dry enough to prevent a current from flowing, a case in which a user's both hands are in contact, and a case in which a user's posture is not stable.
According to an embodiment, in case that the acquired phase information falls within a second range, the wearable device 100 may provide a notification to indicate an electrode error. According to an embodiment, the electrode error may include a case in which an electrode is short-circuiting or grounded.
According to an embodiment, the notification provided to the user may include at least one of a UI through a display, a voice guide or sound through a speaker, vibration through a motor, and flashing of an LED. For example, in case that the user's information is insufficiently input, a UI for guiding to input user's information may be provided together with vibration.
Referring to
According to an embodiment, in operation 803, the wearable device 100 may provide a guide for a correct measurement posture to the user 101. For example, the wearable device may inform the user of the location in which a finger touches an electrode and guide the user to take a posture where arms are as wide as possible so that the left and right hands of the user do not touch each other.
According to an embodiment, in operation 805, the wearable device 100 may start bio-impedance measurement of the user 101. According to an embodiment, in case of detecting a measurement mode, the wearable device 100 may detect whether the human body of the user 101 comes into contact with an electrode and start measurement. According to an embodiment, in case of detecting whether the human body of the user 101 comes into contact with an electrode, the wearable device 100 may automatically start measurement.
According to an embodiment, in operation 807, the wearable device 100 may acquire biometric data during a first time through a sensor part (e.g., the sensor part 370 in
According to an embodiment, in operation 809, the wearable device 100 may determine whether the resistance value of the bio-impedance of the user 101 falls within a predetermined range when determined based on first accuracy. For example, it may be determined whether the user's body resistance falls within the predetermined range by counting the times at which the human body resistance measured during a first time falls within a certain range (e.g., +/−50Ω) with reference to 700Ω.
According to an embodiment, it may be determined that the resistance value of the bio-impedance falls within the predetermined range when determined based on the first accuracy. For example, it may be determined that the user's body resistance falls within the predetermined range in case that the frequency at which the user's body resistance measured during the first time is within a certain range (e.g., +/−50Ω) with reference to 700Ω in 75% or more of the total samples. Accordingly, in operation 811, the wearable device may determine whether phase information of the bio-impedance falls within the predetermined range based on the first accuracy.
According to an embodiment, it may be determined that the resistance value of the bio-impedance deviates from the predetermined range when determined based on the first accuracy. For example, in case that resistance variation measured during the first time is larger than or equal to a designated reference, it may be determined to deviate from the predetermined range. Accordingly, in operation 813, the wearable device may induce remeasurement of the user by displaying or outputting a guide. For example, the guide for remeasurement may include at least one of a UI through a display, a voice guide or sound through a speaker, vibration through a motor, and flashing of an LED.
According to an embodiment, in operation 811, the wearable device may determine that the phase value of the bio-impedance falls within the predetermined range when determined based on the first accuracy. Accordingly, in operation 815, the wearable device may additionally proceed with bio-impedance measurement during a second time. For example, the wearable device may additionally proceed with bio-impedance measurement for 3 seconds. The duration of the second time may vary based on the first accuracy.
According to an embodiment, the wearable device may determine that the phase value of the bio-impedance deviates from a predetermined range when determined based on the first accuracy. Accordingly, in operation 817, the wearable device may induce remeasurement of the user through a guide.
According to an embodiment, in operation 819, the wearable device may determine whether phase information and resistance value of the bio-impedance fall within a predetermined range when determined based on the second accuracy.
According to an embodiment, it may be determined that the phase information and resistance value of the bio-impedance falls within a predetermined range when determined based on the second accuracy. For example, it may be determined that the user's body resistance falls within the predetermined range in case that the frequency at which the user's body resistance measured during the second time is within a certain range (e.g., +/−50Ω) with reference to 700Ω in 50% or more of the total samples. Accordingly, in operation 821, the wearable device may filter out values deviating from the predetermined range and calculate an average value from values within the predetermined range to be substituted into a body component algorithm.
According to an embodiment, the wearable device may determine that the resistance value and phase information of the bio-impedance deviate from the predetermined range when determined based on the second accuracy. Accordingly, in operation 823, the wearable device may induce remeasurement of the user.
According to an embodiment, the first accuracy and/or the second accuracy may be determined based on the biometric information acquired from the user. For example, the biometric information may include at least one of a magnitude of the user's bio-impedance, a resistance value of the user's bio-impedance, and a reactance value of the user's bio-impedance.
Referring to
Referring to
Referring to
According to an embodiment, in case of determining that an electrode has an error, the wearable device 900c may output a guide message to the user through a display. For example, the wearable device 900c may output a guide message (e.g., “There is an error and proper function is not possible”) indicating that the electrode has an error.
Referring to
Referring to
According to an embodiment, the wearable device 900 may output notification vibration to induce the user to remeasure through a haptic motor (not shown). For example, the wearable device 900 may provide, to the user, a guide message through a display and/or notification vibration through a haptic motor so as to cause the user to take a correct posture.
Referring to
According to an embodiment, in case that phase information falls within the predetermined range 1020, the processor (310 in
According to an embodiment, in case that phase information falls within the second range 1030, the processor (e.g., 310 in
According to an embodiment, a bio-impedance value may be derived by information on a current flowing to the human body through an alternating current source 1110 and information on a voltage measured by a voltage detector 1120. According to an embodiment, the phase information may be derived from a value including reactance other than a resistance value in the bio-impedance. According to an embodiment, in case that an alternating current flows through an alternating current source 1110, a human body closed loop 1100 through both arms of a user may be formed. According to an embodiment, in case that a normal human body closed loop is formed, a normal bio-impedance 1130 may be measured. For example, in case that a normal human body closed loop is formed, a phase angle may be within a range of −3° to −14°.
According to an embodiment, in case that a closed loop caused by contact of both hands of a user is formed in addition to the normal human body closed loop, a bio-impedance 1140 caused by the contact of both hands other than the normal human body closed loop 1130 may be measured. For example, in case of measuring a bio-impedance in the state when both hands of the user are in contact, the phase angle may be within a range below −14°.
According to an embodiment, in case that an electrode has an error, a bio-impedance 1150 caused by the error of the electrode other than the normal human body closed loop 1130 may be measured. For example, the phase angle acquired in case that the electrode is short-circuited or grounded may be a range above −3°.
The processor 1220 may execute, for example, software (e.g., a program 1240) to control at least one other component (e.g., a hardware or software component) of the electronic device 1201 coupled with the processor 1220, and may perform various data processing or computation. According to one embodiment, as at least part of the data processing or computation, the processor 1220 may store a command or data received from another component (e.g., the sensor module 1276 or the communication module 1290) in volatile memory 1232, process the command or the data stored in the volatile memory 1232, and store resulting data in non-volatile memory 1234. According to an embodiment, the processor 1220 may include a main processor 1221 (e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor 1223 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 1221. For example, when the electronic device 1201 includes the main processor 1221 and the auxiliary processor 1223, the auxiliary processor 1223 may be adapted to consume less power than the main processor 1221, or to be specific to a specified function. The auxiliary processor 1223 may be implemented as separate from, or as part of the main processor 1221.
The auxiliary processor 1223 may control at least some of functions or states related to at least one component (e.g., the display module 1260, the sensor module 1276, or the communication module 1290) among the components of the electronic device 1201, instead of the main processor 1221 while the main processor 1221 is in an inactive (e.g., sleep) state, or together with the main processor 1221 while the main processor 1221 is in an active state (e.g., executing an application). According to an embodiment, the auxiliary processor 1223 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 1280 or the communication module 1290) functionally related to the auxiliary processor 1223. According to an embodiment, the auxiliary processor 1223 (e.g., the neural processing unit) may include a hardware structure specified for artificial intelligence model processing. An artificial intelligence model may be generated by machine learning. Such learning may be performed, e.g., by the electronic device 1201 where the artificial intelligence is performed or via a separate server (e.g., the server 1208). Learning algorithms may include, but are not limited to, e.g., supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-network or a combination of two or more thereof but is not limited thereto. The artificial intelligence model may, additionally or alternatively, include a software structure other than the hardware structure.
The memory 1230 may store various data used by at least one component (e.g., the processor 1220 or the sensor module 1276) of the electronic device 1201. The various data may include, for example, software (e.g., the program 1240) and input data or output data for a command related thereto. The memory 1230 may include the volatile memory 1232 or the non-volatile memory 1234.
The program 1240 may be stored in the memory 1230 as software, and may include, for example, an operating system (OS) 1242, middleware 1244, or an application 1246.
The input module 1250 may receive a command or data to be used by another component (e.g., the processor 1220) of the electronic device 1201, from the outside (e.g., a user) of the electronic device 1201. The input module 1250 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
The sound output module 1255 may output sound signals to the outside of the electronic device 1201. The sound output module 1255 may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing record. The receiver may be used for receiving incoming calls. According to an embodiment, the receiver may be implemented as separate from, or as part of the speaker.
The display module 1260 may visually provide information to the outside (e.g., a user) of the electronic device 1201. The display module 1260 may include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to an embodiment, the display module 1260 may include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.
The audio module 1270 may convert a sound into an electrical signal and vice versa. According to an embodiment, the audio module 1270 may obtain the sound via the input module 1250, or output the sound via the sound output module #55 or a headphone of an external electronic device (e.g., an electronic device #02) directly (e.g., wiredly) or wirelessly coupled with the electronic device 1201.
The sensor module 1276 may detect an operational state (e.g., power or temperature) of the electronic device 1201 or an environmental state (e.g., a state of a user) external to the electronic device 1201, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 1276 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
The interface 1277 may support one or more specified protocols to be used for the electronic device 1201 to be coupled with the external electronic device (e.g., the electronic device 1202) directly (e.g., wiredly) or wirelessly. According to an embodiment, the interface 1277 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
A connecting terminal 1278 may include a connector via which the electronic device 1201 may be physically connected with the external electronic device (e.g., the electronic device 1202). According to an embodiment, the connecting terminal 1278 may include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).
The haptic module 1279 may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus which may be recognized by a user via his tactile sensation or kinesthetic sensation. According to an embodiment, the haptic module 1279 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
The camera module 1280 may capture a still image or moving images. According to an embodiment, the camera module 1280 may include one or more lenses, image sensors, image signal processors, or flashes.
The power management module 1288 may manage power supplied to the electronic device 1201. According to one embodiment, the power management module 1288 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
The battery 1289 may supply power to at least one component of the electronic device #01. According to an embodiment, the battery 1289 may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.
The communication module 1290 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 1201 and the external electronic device (e.g., the electronic device 1202, the electronic device 1204, or the server 1208) and performing communication via the established communication channel. The communication module 1290 may include one or more communication processors that are operable independently from the processor 1220 (e.g., the application processor (AP)) and supports a direct (e.g., wired) communication or a wireless communication. According to an embodiment, the communication module 1290 may include a wireless communication module 1292 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1294 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device via the first network 1298 (e.g., a short-range communication network, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network 1299 (e.g., a long-range communication network, such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multi components (e.g., multi chips) separate from each other. The wireless communication module 1292 may identify and authenticate the electronic device 1201 in a communication network, such as the first network 1298 or the second network 1299, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module 1296.
The wireless communication module 1292 may support a 5G network, after a 4G network, and next-generation communication technology, e.g., new radio (NR) access technology. The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). The wireless communication module 1292 may support a high-frequency band (e.g., the mmWave band) to achieve, e.g., a high data transmission rate. The wireless communication module 1292 may support various technologies for securing performance on a high-frequency band, such as, e.g., beamforming, massive multiple-input and multiple-output (massive MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 1292 may support various requirements specified in the electronic device 1201, an external electronic device (e.g., the electronic device 1204), or a network system (e.g., the second network 1299). According to an embodiment, the wireless communication module 1292 may support a peak data rate (e.g., 20 Gbps or more) for implementing eMBB, loss coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1 ms or less) for implementing URLLC.
The antenna module 1297 may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device 1201. According to an embodiment, the antenna module 1297 may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 1297 may include a plurality of antennas (e.g., array antennas). In such a case, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network 1298 or the second network 1299, may be selected, for example, by the communication module 1290 (e.g., the wireless communication module 1292) from the plurality of antennas. The signal or the power may then be transmitted or received between the communication module 1290 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 1297.
According to various embodiments, the antenna module 1297 may form a mmWave antenna module. According to an embodiment, the mmWave antenna module may include a printed circuit board, a RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.
At least some of the above-described components may be coupled mutually and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).
According to an embodiment, commands or data may be transmitted or received between the electronic device 1201 and the external electronic device 1204 via the server 1208 coupled with the second network 1299. Each of the electronic devices 1202 or 1204 may be a device of a same type as, or a different type, from the electronic device 1201. According to an embodiment, all or some of operations to be executed at the electronic device 1201 may be executed at one or more of the external electronic devices 1202, 1204, or 1208. For example, if the electronic device 1201 should perform a function or a service automatically, or in response to a request from a user or another device, the electronic device 1201, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device 1201. The electronic device 1201 may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device 1201 may provide ultra low-latency services using, e.g., distributed computing or mobile edge computing. In another embodiment, the external electronic device 1204 may include an internet-of-things (IoT) device. The server 1208 may be an intelligent server using machine learning and/or a neural network. According to an embodiment, the external electronic device 1204 or the server 1208 may be included in the second network 1299. The electronic device 1201 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology or IoT-related technology.
The electronic device according to various embodiments may be one of various types of electronic devices. The electronic devices may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the disclosure, the electronic devices are not limited to those described above.
It should be appreciated that various embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C,” may include any one of, or all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as “1st” and “2nd,” or “first” and “second” may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.
As used in connection with various embodiments of the disclosure, the term “module” may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” or “circuitry”. A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).
Various embodiments as set forth herein may be implemented as software (e.g., the program 1240) including one or more instructions that are stored in a storage medium (e.g., internal memory 1236 or external memory 1238) that is readable by a machine (e.g., the electronic device 1201). For example, a processor (e.g., the processor 1220) of the machine (e.g., the electronic device 1201) may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include a code generated by a compiler or a code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the term “non-transitory” simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.
According to an embodiment, a method according to various embodiments of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.
According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to various embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.
Certain of the above-described embodiments of the present disclosure can be implemented in hardware, firmware or via the execution of software or computer code that can be stored in a recording medium such as a CD ROM, a Digital Versatile Disc (DVD), a magnetic tape, a RAM, a floppy disk, a hard disk, or a magneto-optical disk or computer code downloaded over a network originally stored on a remote recording medium or a non-transitory machine readable medium and to be stored on a local recording medium, so that the methods described herein can be rendered via such software that is stored on the recording medium using a general purpose computer, or a special processor or in programmable or dedicated hardware, such as an ASIC or FPGA. As would be understood in the art, the computer, the processor, microprocessor controller or the programmable hardware include memory components, e.g., RAM, ROM, Flash, etc. that may store or receive software or computer code that when accessed and executed by the computer, processor or hardware implement the processing methods described herein.
While the present disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the present disclosure as defined by the appended claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
10-2020-0088362 | Jul 2020 | KR | national |
10-2021-0091081 | Jul 2021 | KR | national |
This application is a continuation of International Application No. PCT/KR2021/009122, which was filed on Jul. 15, 2021, and claims priority to Korean Patent Application Nos. 10-2020-0088362 and 10-2021-0091081, filed on Jul. 16, 2020 and Jul. 12, 2021, respectively, in the Korean Intellectual Property Office, the disclosure of which are incorporated by reference herein their entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/KR2021/009122 | Jul 2021 | US |
Child | 18093086 | US |