Patent Application
20220391085
The disclosure relates to a method and apparatus for displaying content on a display.
Electronic devices can include a foldable or rollable displays. Foldable and rollable displays can be advantageous, among other reasons, because they allow the benefit of a larger screen while maintaining the portability of the device.
However, when a flexible display is divided into two or more regions, as a result of bending one region of the display to have an angle with respect to the other region of the display (“folding”), a problem can occur because size of an object in the content to be displayed may have to be reduced to a size of a designated region of a display. As a result, a part of a region of the display may be wasted.
The content displayed on a display appears distorted when the line of sight to portions of the display is not orthogonal. While this may be corrected by performing an image transformation, based on the line of sight, it becomes particularly difficult when the display is folded. When the display is folded, angle of the line of sight will be different for different regions.
The foregoing information is presented to allow the user to better understand the embodiments presented herein. No determination has been made as to whether any of the foregoing information is prior art.
Certain embodiments of the disclosure provide a method and apparatus for displaying content on a display.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments of the disclosure.
According to an aspect of the disclosure, a method for displaying content on a display of an electronic device comprises determining, based on information about the content, a first region of the display on which a first portion of the content is to be displayed; obtaining an angle between the first region and a second region of the display, the second region being distinguished from the first region; generating, based on the angle and a location of a user, correction content corresponding to a second portion of the content; and displaying the first portion on the first region, and displaying the correction content on the second region.
According to certain aspect of the disclosure, an electronic device comprises a display; a memory storing at least one instruction; and at least one processor configured to execute the at least one instruction to perform a plurality of operations, wherein the plurality of operations comprises: determining, based on information about the content, a first region of the display on which a first portion of content is to be displayed,
obtaining an angle between the first region and a second region of the display, the second region being distinguished from the first region, generating, based on the angle and a location of a user, correction content corresponding to a second portion of the content, and displaying the first portion on the first region, and display the generated correction content on the second region.
The above and other aspects, features, and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
Hereinafter, embodiments of the disclosure will now be described more fully with reference to the accompanying drawings.
In the descriptions of embodiments, certain detailed explanations of the related art which are well known in the art to which the disclosure belongs and are not directly related to the disclosure are omitted. By omitting unnecessary explanations, the essence of the disclosure may not be obscured and may be explicitly conveyed.
For the same reasons, in the drawings, some elements may be exaggerated, omitted, or roughly illustrated. Also, the size of each element does not exactly correspond to an actual size of each element. In the drawings, the same or corresponding elements are denoted by the same reference numerals.
Throughout the disclosure, the expression “at least one of a, b or c” indicates only a, only b, only c, both a and b, both a and c, both b and c, all of a, b, and c, or variations thereof.
The advantages and features of the disclosure and methods of achieving them will become apparent with reference to embodiments of the disclosure described in detail below with reference to the accompanying drawings. The disclosure may, however, be embodied in many different forms and should not be construed as limited to embodiments set forth herein; rather these embodiments of the disclosure are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure only defined by the claims to one of ordinary skill in the art. Throughout the specification, like reference numerals denote like elements.
It will be understood that each block of flowchart illustrations, and combinations of blocks in the flowchart illustrations, may be implemented by computer program instructions. The computer program instructions may be provided to a processor of a general-purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, which are executed by the processor of the computer or other programmable data processing apparatus, generate means for performing functions specified in the flowchart block(s). The computer program instructions may also be stored in a computer-executable or computer-readable memory that may direct the computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-executable or computer-readable memory produce an article of manufacture including instruction means that perform the functions specified in the flowchart block(s). The computer program instructions may also be loaded onto the computer or other programmable data processing apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions that are executed on the computer or other programmable apparatus provide operations for implementing the functions specified in the flowchart block(s).
In addition, each block of the flowchart illustrations may represent a module, segment, or portion of code, which includes one or more executable instructions for performing specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks may occur out of the order. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Hereinafter, embodiments of the disclosure will now be described more fully with reference to the accompanying drawings.
The electronic device 1000 includes display 1100. Generally speaking, the display 1100 is planar and can be a flexible display that is capable of being folded into two regions, a first region and a second region. The first region will form an angle with the second region. A sensor 1300 detects the angle between the first region and the second region of the display 1100. As a result, content displayed on the first and second region will be viewed from different perspectives by the user. Even if the user is looking directly (the line of sight is orthogonal) at, e.g., the first region, the content that is displayed in the second region will appear distorted. According to certain embodiments, a camera 1200 determines the angle of the line of sight, at least with respect to one of the first region and second region of the display. The processor 1400 receives the angle of the first region with respect to the second region from the sensor, and the angle of the line of sight (with respect to one of the first region and second region). Based on the angles of the first region and the second region from the sensor, and the angle of the line of sight from the camera, the processor can modify content display on the first region and the second region, to correct for distortion based on the angle of the line of sight. According to an embodiment of the disclosure, the electronic device 1000 may include a display 1100, a camera 1200, a sensor 1300, a processor 1400, and a memory 1500. However, a configuration of the electronic device 1000 is not limited to the aforementioned descriptions, and thus, the electronic device 1000 may include more elements or fewer elements, depending on the embodiment.
The display 1100 may display content. The display 1100 may indicate a flexible display. The flexible display may refer to a bendable display and may include, but is not limited to, at least one of a curved display, a bendable display, a foldable display, or a rollable display. The camera 1200 may obtain user data. Based on the user data obtained by the camera 1200, a distance between a user and the electronic device 1000 and an angle between the user and the electronic device 1000 may be obtained (or the angle of the line of sight). For example, the camera 1200 may include an eye tracking camera, a depth camera (e.g., a time-of-flight (ToF) camera or a depth camera), and/or a RGB camera.
The sensor 1300 may obtain an angle between a first region and a second region of the display 1100. The sensor 1300 may include, but is not limited to, at least one of a bending sensor, a pressure sensor, a geomagnetic sensor, a tilt sensor, or a gyro sensor.
The sensor 1300 may obtain user data. Based on the user data obtained by the sensor 1300, a distance between the user and the electronic device 1000 and an angle between the user and the electronic device 1000 may be obtained. The sensor 1300 may include, but is not limited to, a dynamic vision sensor (DVS) and a low-power vision sensor.
The processor 1400 may execute at least one instruction in the memory 1500 to control all operations of the electronic device 1000. In certain embodiments, multiple processors 1400 can be used. Accordingly, the term “processor” as used herein shall be understood to mean one or more processors.
For example, based on information about the content, the processor 1400 may determine the first region of the display 1100 on which a first portion of the content is to be displayed.
The processor 1400 may split the content into the first portion and a second portion to control a length of one side of the content to be equal to a length of one side of the first region of the display 1100.
The processor 1400 may generate an image corresponding to the second portion of the content, based on the angle between the first region and the second region of the display 1100 and a location of the user. Also, the processor 1400 may generate an image corresponding to the second portion of the content, based on the angle between the first region and the second region of the display 1100 and an obtained location of the user.
The processor 1400 may determine a size and a ratio of the image so as to allow the first portion and the second portion of the content to be displayed on one virtual plane. Also, the processor 1400 may correct colors of the image.
According to an embodiment of the disclosure, the memory 1500 may include a region determination module 1600, a content split module 1700, a rendering module 1800, and a color correction module 1900.
According to an embodiment of the disclosure, elements (e.g., the region determination module 1600, the content split module 1700, the rendering module 1800, and/or the color correction module 1900) included in the memory 1500 may be included as software components or hardware components (or hardware modules (e.g., circuitries) additionally or alternatively in the processor 1400.
Based on at least one of information about a type of content, information about an application that provides content, information indicating whether content include text content, or information indicating whether content and a user interface (UI) to receive a user input overlay each other, the region determination module 1600 may store instructions for determining the first region of the display 1100 on which the first portion of the content is to be displayed.
The content split module 1700 may store instructions for splitting the content into a first portion and a second portion to control a length of one side of the content to be equal to a length of one side of the first region.
The rendering module 1800 may store instructions for generating an image corresponding to the second portion of the content, based on the angle between the first region and the second region of the display 1100 and a location of the user, and for determine a size and a ratio of the image so as to allow the first portion and the second portion of the content to be displayed on one virtual plane.
The color correction module 1900 may store instructions for correcting colors of the image.
Referring to
Referring to
However, it shall be understood that the disclosure is not limited thereto, and thus, may be applied to other electronic devices with two or more display regions.
Referring to
In operation S320, the electronic device 1000 may obtain an angle between the first region 2100 and the second region 2200 of the display 1100. According to an embodiment of the disclosure, the electronic device 1000 may obtain the angle between the first region 2100 and the second region 2200 of the display 1100, based on data obtained by using at least one of the bending sensor, the pressure sensor, or the gyro sensor.
According to an embodiment of the disclosure, the electronic device 1000 may obtain a location of a user, based on user data obtained by the camera 1200 or the sensor 1300. In this regard, the electronic device 1000 may obtain the location of the user by using face tracking technology or the like. The location of the user may include a distance between the electronic device 1000 and the user, and an angle between the electronic device 1000 and the user, e.g., a line of sight.
The camera 1200 or the sensor 1300 may periodically or aperiodically collect user data about the user. In this regard, an interval at which the user data is obtained may be predetermined or may be changed in response to a user input.
In operation S330, the electronic device 1000 may generate correction content corresponding to a second portion of the content, based on the angle between the first region 2100 and the second region 2200 of the display 1100 and the location of the user. According to an embodiment of the disclosure, the location of the user may be deemed a predetermined default location. The predetermined default location may include a predetermined default distance and a default predetermined angle between the user and the electronic device 1000. In this regard, the predetermined default distance and the predetermined default angle between the user and the electronic device 1000 may be changed in response to a user input, such as a user input changing a setting.
According to another embodiment of the disclosure, the electronic device 1000 may generate correction content corresponding to the second portion of the content, based on the angle between the first region 2100 and the second region 2200 of the display 1100 and an obtained location of the user. The descriptions thereof will be provided below with reference to
Whether the electronic device 1000 is to generate the correction content corresponding to the second portion of the content based on one of the predetermined location of the user or the obtained location of the user may be predetermined, or may be changed in response to a user input.
In operation S340, the electronic device 1000 may display the first portion of the content on the first region 2100 of the display 1100, and may display the correction content on the second region 2200 of the display 1100. As a result, the first portion and the second portion of the content may be displayed on one virtual plane. The descriptions thereof will be provided below with reference to
Referring to
Referring to
According to an embodiment of the disclosure, in order to maintain a designated ratio (e.g., 16:9) of the content 400, the electronic device 1000 may adjust a size of the content 400 to allow a length of one side of the content 400 to be equal to a length of one side of the first region 2100 of the display 1100, and then may display the content 400. For example, referring to
Referring to
According to an embodiment of the disclosure, the electronic device 1000 may split the content 400 into the first portion 410 and the second portion 420 to allow a length of one side of the content 400 to be equal to a length of one side of the first region 2100 of the display 1100. For example, referring to
According to an embodiment of the disclosure, the electronic device 1000 may determine a size and a ratio of the correction content 430 so as to display the first portion 410 and the second portion 420 of the content 400 on one virtual plane, based on a location of a user and an angle between the first region 2100 and the second region 2200.
In this regard, the description that the first portion 410 and the second portion 420 are displayed on one virtual plane may mean that the content 400 may be displayed as if the content 400 is seamlessly unfolded, regardless of whether the display 1100 is bent. For example, referring to
In certain embodiments, the processor 1400 can generate correction content for the second portion 420 by performing a graphical transformation of the second portion 420. For example, if the angle between the first region 2100 and the second region 2200 is θ (about the X-axis horizontal), in certain embodiments, the correction content 430 can be the second portion 420 projected onto a plane having a 180−θ degree angle about the same axis (x-axis) with the top of the second portion 420. In certain embodiments, the correction content 430 can be determined by calculating the perspective of a pinhole camera as though it was tilted by 180−θ degrees about the same axis using a perspective transformation.
According to an embodiment of the disclosure, when the correction content 430 and a UI to receive a user input overlay each other, the electronic device 1000 may correct and display colors of the correction content 430.
Referring to
According to an embodiment of the disclosure, in order to maintain a designated ratio of the content 500, the electronic device 1000 may adjust a size of the content 500 and display the content 500 so as to allow a length of one side of the content 500 to be equal to a length of one side of the first region 2100 of the display 1100. For example, referring to
Referring to
For example, referring to
Based on a rotation state of the electronic device 1000, the electronic device 1000 may determine whether to match a horizontal length of content with a horizontal length of the first region 2100 or to match a vertical length of the content with a vertical length of the first region 2100. In this regard, the rotation state of the electronic device 1000 may be identified, based on data obtained by using the tilt sensor or the gyro sensor.
For example, referring to
In certain embodiments, the processor 1400 can generate correction content for the second portion 520 by performing a graphical transformation of the second portion 520. For example, if the angle between the first region 2100 and the second region 2200 is θ (about the y-axis, horizontal), in certain embodiments, the correction content 530 can be the second portion 520 projected onto a plane having a 180−θ degree angle about the same axis (y-axis) with the left edge of the second portion 420. In certain embodiments, the correction content 530 can be determined by calculating the perspective of a pinhole camera as though it was tilted by 180−θ degrees about the same axis using a perspective transformation.
Referring to
According to an embodiment of the disclosure, in order to maintain a designated ratio of the content 600, the electronic device 1000 may adjust a size of the content 600 and display the content 600 so as to allow a length of one side of the content 600 to be equal to a length of one side of the first region 2100 of the display 1100. For example, referring to
Referring to
For example, referring to
Based on at least one of a predetermined setting, a user input, or a rotation state of the electronic device 1000, the electronic device 1000 may determine whether to match a horizontal length of content with a horizontal length of the first region 2100 or to match a vertical length of the content with a vertical length of the first region 2100.
For example, referring to
Referring to
Referring to
However, which region is determined to be the first region 2100 depending on each designated type of content may be predefined differently from the descriptions above, and may be changed in response to a user input. For example, it may be predefined such that, when content is a photo, the electronic device 1000 may determine a lower region of the display 1100 to be the first region 2100. Alternatively, for example, it may be predefined such that, when content is a game, the electronic device 1000 may determine a lower region of the display 1100 to be the first region 2100, but, in response to a user input, the electronic device 1000 may be changed to determine an upper region of the display 1100 to be the first region 2100.
Referring to
Referring to
However, which region is determined to be the first region 2100 depending on each type of a content providing application or each mode of the application may be predefined differently from the descriptions above, and may be changed in response to a user input.
Referring to
Referring to
Priorities may exist in references for determining the first region 2100 of the display 1100 on which a first portion of content is to be displayed. According to an embodiment of the disclosure, when the first region 2100 determined based on the references varies (i.e., when the references conflict), the electronic device 1000 may determine the first region 2100, based on the priorities.
For example, a case in which the electronic device 1000 executes a photo editing application may be assumed. The electronic device 1000 may determine an upper region of the display 1100 to be the first region 2100, based on the information about a type of the content. Also, the electronic device 1000 may determine a lower region of the display 1100 to be the first region 2100, based on the information about an application that provides content. As such, when the first regions 2100 determined based on respective references are different, the electronic device 1000 may determine the first region 2100, based on priorities. For example, when the information about an application that provides the content has a higher priority than the information about a type of the content, the electronic device 1000 may determine the lower region of the display 1100 to be the first region 2100, based on the information about an application that provides content. However, the priorities in the references for determining the first region 2100 may be predefined differently from the descriptions above, and may be changed in response to a user input.
Referring to
According to an embodiment of the disclosure, the electronic device 1000 may obtain an angle between the first region 2100 and the second region 2200 of the display 1100 and a location of a user 4000. For example, when the user 4000 is located in front of the electronic device 1000, the location of the user 4000 may include a distance between the second region 2200 of the display 1100 and the user 4000 and a vertical angle between the second region 2200 of the display 1100 and the user 4000. When the lower region of the display 1100 is determined to be the first region 2100, the distance between the second region 2200 and the user 4000 may correspond to a distance between an upper region of the display 1100 and the user 4000, and the vertical angle between the second region 2200 and the user 4000 may correspond to a vertical angle between the upper region of the display 1100 and the user 4000.
Referring to
Referring to
Referring to
According to an embodiment of the disclosure, the electronic device 1000 may obtain an angle between the first region 2100 and the second region 2200 of the display 1100 and a location of the user 4000. For example, when the user 4000 moves and is located in a place distant from the front of the electronic device 1000 in a horizontal direction, the location of the user 4000 may include a distance between the second region 2200 of the display 1100 and the user 4000 and vertical and horizontal angles between the second region 2200 of the display 1100 and the user 4000. When the lower region of the display 1100 is determined to be the first region 2100, the distance between the second region 2200 and the user 4000 may correspond to a distance between an upper region of the display 1100 and the user 4000, and the vertical and horizontal angles between the second region 2200 and the user 4000 may correspond to vertical and horizontal angles between the upper region of the display 1100 and the user 4000.
Referring to
Referring to
Referring to
According to an embodiment of the disclosure, the electronic device 1000 may obtain an angle between the first region 2100 and the second region 2200 of the display 1100 and a location of the user 4000. For example, when the user 4000 is located in front of the electronic device 1000, the location of the user 4000 may include a distance between the second region 2200 of the display 1100 and the user 4000 and a vertical angle between the second region 2200 of the display 1100 and the user 4000. When the upper region of the display 1100 is determined to be the first region 2100, the distance between the second region 2200 and the user 4000 may correspond to a distance between a lower region of the display 1100 and the user 4000, and the vertical angle between the second region 2200 and the user 4000 may correspond to a vertical angle between the lower region of the display 1100 and the user 4000.
Referring to
Referring to
Referring to
According to an embodiment of the disclosure, the electronic device 1000 may obtain an angle between the first region 2100 and the second region 2200 of the display 1100 and a location of the user 4000. For example, when the user 4000 moves and is located in a place distant from the front of the electronic device 1000 in a horizontal direction, the location of the user 4000 may include a distance between the second region 2200 of the display 1100 and the user 4000 and vertical and horizontal angles between the second region 2200 of the display 1100 and the user 4000. When the upper region of the display 1100 is determined to be the first region 2100, the distance between the second region 2200 and the user 4000 may correspond to a distance between a lower region of the display 1100 and the user 4000, and vertical and horizontal angles between the second region 2200 and the user 4000 may correspond to vertical and horizontal angles between the lower region of the display 1100 and the user 4000.
Referring to
Referring to
Referring to
According to an embodiment of the disclosure, the electronic device 1000 may determine a location of a second virtual camera 1450 corresponding to a second portion 1420 of the content. As described above with reference to
According to an embodiment of the disclosure, the electronic device 1000 may identify virtual lines connecting the second virtual camera 1450 and both bottom corners of the second portion 1420 of the content. For example, the electronic device 1000 may identify a virtual line 1452 connecting the second virtual camera 1450 and a bottom-left corner 1422 of the second portion 1420 of the content, and may identify a virtual line 1454 connecting the second virtual camera 1450 and a bottom-right corner 1424 of the second portion 1420 of the content.
Referring to
Referring to
According to an embodiment of the disclosure, the electronic device 1501 of
Referring to
According to an embodiment of the disclosure, the electronic device 1501 may communicate with the electronic device 1504 via the server 1508. According to an embodiment of the disclosure, the electronic device 1501 may include the processor 1520, the memory 1530, an input module 1550, a sound output module 1555, the display module 1560, an audio module 1570, the sensor module 1576, an interface 1577, a connection terminal 1578, a haptic module 1579, the camera module 1580, a power management module 1588, a battery 1589, a communication module 1590, a subscriber identity module 1596, or an antenna module 1597. In some embodiments of the disclosure, the electronic device 1501 may not include at least one element (e.g., the connection terminal 1578) from among the elements or may further include one or more different elements. In some embodiments of the disclosure, some elements (e.g., the sensor module 1576, the camera module 1580, and the antenna module 1597) from among the elements may be integrated into one element (e.g., the display module 1560).
The processor 1520 may execute software (e.g., a program 1540) to control at least one different element (e.g., a hardware element or a software element) of the electronic device 1501 connected to the processor 1520, and may perform certain data processing or a computation. According to an embodiment of the disclosure, as a portion of the data processing or the computation, the processor 1520 may store, in a volatile memory 1532, a command or data received from another element (e.g., the sensor module 1576 or the communication module 1590), may process the command or the data stored in the volatile memory 1532, and may store resultant data in a non-volatile memory 1534. According to an embodiment of the disclosure, the processor 1520 may include a main processor 1521 (e.g., a central processing unit or an application processor) or an auxiliary processor 1523 (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) which independently operates or interoperates with the main processor 1521. For example, when the electronic device 1501 includes the main processor 1521 and the auxiliary processor 1523, the auxiliary processor 1523 may use lower power than the main processor 1521 or may be set to be specialized for a designated function. The auxiliary processor 1523 may be separately implemented or may be implemented as a portion of the main processor 1521.
Instead of the main processor 1521 while the main processor 1521 is in an inactive state (e.g., a sleeping state) or with the main processor 1521 while the main processor 1521 is in an active state (e.g., execution of an application), the auxiliary processor 1523 may control at least some of functions or states related to at least one element (e.g., the display module 1560, the sensor module 1576, or the communication module 1590) from among the elements of the electronic device 1501.
According to an embodiment of the disclosure, the auxiliary processor 1523 (e.g., the image signal processor or the communication processor) may be implemented as a portion of another element (e.g., the camera module 1580 or the communication module 1590) which is technically related to the auxiliary processor 1523. According to an embodiment of the disclosure, the auxiliary processor 1523 (e.g., the NPU) may include a hardware structure specialized for processing an artificial intelligence (AI) model.
The AI model may be generated through machine learning. The training may be performed by the electronic device 1501 in which the AI model runs or may be performed by a separate server (e.g., the server 1508). Examples of a learning algorithm may include, but not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The AI model may include a plurality of artificial neural network layers. An artificial neural network may include any one or any combination of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and deep Q-networks, but is not limited thereto. The AI model may additionally or generally include a software structure, in addition to the hardware structure.
The memory 1530 may store certain data used by at least one element (e.g., the processor 1520 or the sensor module 1576) of the electronic device 1501. The data may include software (e.g., the program 1540), and input data or output data in response to a command related thereto. The memory 1530 may include the volatile memory 1532 or the non-volatile memory 1534. The non-volatile memory 1534 may include the built-in memory 1536 or the external memory 1538.
The program 1540 may be stored as software in the memory 1530, and may include an operating system 1542, middle-ware 1544, or an application 1546.
The input module 1550 may receive a command or data to be used by an element (e.g., the processor 1520) of the electronic device 1501 from an external source (e.g., a user) of the electronic device 1501. Examples of the input module 1550 may include a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
The sound output module 1555 may output a sound signal to the outside of the electronic device 1501. The sound output module 1555 may include a speaker or a receiver. The speaker may be used for a general use such as reproduction of multimedia content or playback of recording. The receiver may be used to receive an incoming call. According to an embodiment of the disclosure, the receiver may be separately implemented or may be implemented as a portion of the speaker.
The display module 1560 may visually provide information to an external source (e.g., a user) of the electronic device 1501. The display module 1560 may include a display, a hologram device, or a projector, and a control circuit for controlling a corresponding device. According to an embodiment of the disclosure, the display module 1560 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure a strength of power occurring due to the touch.
The audio module 1570 may convert sound into an electrical signal, or alternatively may convert an electrical signal into sound. According to an embodiment of the disclosure, the audio module 1570 may obtain sound via the input module 1550, or may output sound via an external electronic device (e.g., the electronic device 1502) that is directly or wirelessly connected to the electronic device 1501.
The sensor module 1576 may detect an operation state (e.g., power or a temperature) of the electronic device 1501 or an external environment state (e.g., a user's state), and may generate an electrical signal or a data value which corresponds to the detected state. According to an embodiment of the disclosure, the sensor module 1576 may include, but is not limited to, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
The interface 1577 may support one or more designated protocols that are usable by the electronic device 1501 to be directly or wirelessly connected to an external electronic device (e.g., the electronic device 1502). According to an embodiment of the disclosure, the interface 1577 may include a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
The connection terminal 1578 may include a connector via which the electronic device 1501 can be physically connected to an external electronic device (e.g., the electronic device 1502). According to an embodiment of the disclosure, the connection terminal 1578 may include an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
The haptic module 1579 may convert an electrical signal into a mechanical stimulus (e.g., a vibration or motion) or an electrical stimulus which is perceivable to a user through a tactile sense or motor sense. According to an embodiment of the disclosure, the haptic module 1579 may include a motor, a piezoelectric element, or an electric stimulation device.
The camera module 1580 may capture a still image and a moving picture image. According to an embodiment of the disclosure, the camera module 1580 may include one or more lenses, image sensors, image signal processors, or flashes.
The power management module 1588 may manage power to be supplied to the electronic device 1501. According to an embodiment of the disclosure, the power management module 1588 may be implemented as at least a portion of a power management integrated circuit (PMIC).
The battery 1589 may supply power to at least one element of the electronic device 1501. According to an embodiment of the disclosure, the battery 1589 may include a primary cell that cannot be recharged, a rechargeable secondary cell, or a fuel cell.
The communication module 1590 may support set-up of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 1501 and an external electronic device (e.g., the electronic device 1502, the electronic device 1504, or the server 1508), and communication via the set communication channel. The communication module 1590 may include one or more communication processors that operate independently from the processor 1520 (e.g., the application processor) and support direct (e.g., wired) communication or wireless communication. According to an embodiment of the disclosure, the communication module 1590 may include a wireless communication module 1592 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1594 (e.g., a local area network (LAN) communication module or a power line communication module). A corresponding communication module from among the communication modules may communicate with the external electronic device 1504 via the first network 1598 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (Wi-Fi) Direct, or infrared data association (IrDA)) or the second network 1599 (e.g., a long-range communication network such as a legacy cellular network, a 5th-generation (5G) network, a next-generation communication network, Internet, or a computer network (e.g., a LAN or a wide area network (WAN)). These certain communication modules may be integrated into one element (e.g., a single chip) or may be implemented as separate elements (e.g., a plurality of chips). The wireless communication module 1592 may verify or authenticate the electronic device 1501 in a communication network such as the first network 1598 or the second network 1599, by using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identity module 1596.
The wireless communication module 1592 may support the 5G network and a next-generation communication technology such as a new radio (NR) access technology after a 4th-generation (4G) network. The NR access technology may support high-speed transfer of large amount of data (enhanced mobile broadband (eMBB), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or ultra-reliable and low-latency communications (URLLC). The wireless communication module 1592 may support a high frequency band (e.g., a millimeter-wave (mmWave) band) so as to achieve a high data rate. To assure capabilities in the high frequency band, the wireless communication module 1592 may support certain technologies such as beamforming, massive multiple-input and multiple-output (massive MIMO), full-dimension MIMO (FD-MIMO), an array-antenna, analog beamforming, or a large-scale antenna. The wireless communication module 1592 may support certain requirements specified in the electronic device 1501, an external electronic device (e.g., the electronic device 1504), or a network system (e.g., the second network 1599). According to an embodiment of the disclosure, the wireless communication module 1592 may support a peak data rate (e.g., 20 Gbps or more) for realization of the eMBB, loss coverage (e.g., 164 dB or less) for realization of the mMTC, or U-plane latency (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or 1 ms or less for one round trip) for realization of the URLLC.
The antenna module 1597 may transmit or receive a signal or power to or from an external entity (e.g., an external electronic device). According to an embodiment of the disclosure, the antenna module 1597 may include an antenna including a conductor formed on a substrate (e.g., a printed circuit board (PCB)) or a radiator of a conductive pattern. According to an embodiment of the disclosure, the antenna module 1597 may include a plurality of antennas (e.g., the array-antenna). In this case, at least one antenna that is appropriate for a communication scheme to be used in a communication network such as the first network 1598 or the second network 1599 may be selected from the plurality of antennas by the communication module 1590. A signal or power may be transmitted or received between the communication module 1590 and an external electronic device via the selected at least one antenna. According to some embodiments of the disclosure, in addition to the radiator, another part (e.g., a radio frequency integrated circuit (RFIC)) may be added to be formed as a part of the antenna module 1597. According to certain embodiments of the disclosure, the antenna module 1597 may configure an mmWave antenna module. According to an embodiment of the disclosure, the mmWave antenna module may include a PCB, an RFIC arranged on a first surface (e.g., a bottom surface) of the PCB or adjacent to the first surface and enabled to support a designated high frequency band (e.g., an mmWave band), and a plurality of antennas (e.g., an array-antenna) arranged on a second surface (e.g., a top surface or a side surface) of the PCB or adjacent to the second surface and enabled to transmit or receive a signal of the designated high frequency band.
At least some of the elements may be connected to each other using a communication scheme (e.g., a BUS, general-purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) for peripheral devices, and may exchange a signal (e.g., a command or data) therebetween.
According to an embodiment of the disclosure, the command or the data may be transmitted or received between the electronic device 1501 and the external electronic device 1504 via the server 1508 connected to the second network 1599. Each of the external electronic devices 1502 and 1504 may be a same type device or different type device with respect to the electronic device 1501. According to an embodiment of the disclosure, all or some of operations performed in the electronic device 1501 may be performed by one or more electronic devices from among the external electronic devices 1502, 1504, and 1508. For example, when it is required for the electronic device 1501 to perform a certain capability or service automatically or in response to a request from a user or another device, the electronic device 1501 may request the one or more electronic devices to perform at least a portion of the capability or service, instead of performing the capability or the service in the electronic device 1501. When the one or more electronic devices receive the request, the one or more electronic devices may perform the requested portion of the capability or service or an additional capability or service associated with the request, and may transmit a result of the performing to the electronic device 1501. The electronic device 1501 may changelessly or additionally process the result, and thus, may provide the processed result as a portion of a response to the request. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 1501 may provide an ultra-low latency service by using the distributed computing or the MEC. In another embodiment of the disclosure, the external electronic device 1504 may include an Internet of things (IoT) device. The server 1508 may be an intelligent server using machine learning and/or a neural network. According to an embodiment of the disclosure, the electronic device 1504 or the server 1508 may be included in the second network 1599. The electronic device 1501 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on the 5G communication technology and IoT-related technology.
According to an embodiment of the disclosure, the display module 1560 of
Referring to
According to an embodiment of the disclosure, the display module 1560 may further include the touch circuit 1650. The touch circuit 1650 may include a touch sensor 1651 and a touch sensor IC 1653 for controlling the touch sensor 1651. The touch sensor IC 1653 may control the touch sensor 1651 to detect a touch input or a hovering input with respect to a particular position on the display 1610. For example, the touch sensor IC 1653 may detect the touch input or the hovering input by measuring a change (e.g., a voltage, the amount of light, a resistance, or quantity of electronic charge) in a signal with respect to the particular position on the display 1610. The touch sensor IC 1653 may provide the processor 1520 with information (e.g., a position, an area, a pressure, or a time) about the detected touch input or the detected hovering input. According to an embodiment of the disclosure, at least a portion (e.g., the touch sensor IC 1653) of the touch circuit 1650 may be included as a part of the DDI 1630 or the display 1610, or a part of another element (e.g., the auxiliary processor 1523) arranged outside the display module 1560.
According to an embodiment of the disclosure, the display module 1560 may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 1576, or a control circuit with respect to the at least one sensor of the sensor module 1576. In this regard, the at least one sensor or the control circuit with respect to the same may be embedded in a portion (e.g., the display 1610 or the DDI 1630) of the display module 1560 or a portion of the touch circuit 1650. For example, when the sensor module 1576 embedded in the display module 1560 includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) related to a touch input via a certain area of the display 1610. As another example, when the sensor module 1576 embedded in the display module 1560 includes a pressure sensor, the pressure sensor may obtain pressure information related to a touch input via a certain area or an entire area of the display 1610. According to an embodiment of the disclosure, the touch sensor 1651 or the sensor module 1576 may be arranged between pixels of a pixel layer of the display 1610 or may be arranged above or below the pixel layer.
According to an embodiment of the disclosure, an electronic device may provide a user with content with a larger screen, without a wasted display region, and thus, may provide the user with an experience in which the user can immerse himself/herself in the content.
According to an embodiment of the disclosure, the electronic device may determine a first region of a display on which a first portion of content is to be displayed, based on at least one of information about a type of content, information about an application that provides content, information indicating whether content include text content, or information indicating whether content and a user interface (UI) to receive a user input overlay each other.
According to an embodiment of the disclosure, the electronic device may obtain a location of a user, and may generate an image corresponding to a second portion of the content, based on the obtained location of the user and an angle between the first region and a second region of the display.
