Patent Grant
12126754
This application is the National Stage filing under 35 U.S.C. 371 of International Application No. PCT/KR2019/011127, filed on Aug. 30, 2019, the contents of which are all hereby incorporated by reference herein in their entirety.
The present disclosure relates to a mobile terminal, an electronic device having a case to which the mobile terminal is coupled, and a method of controlling the electronic device.
Terminals may be divided into mobile/portable terminals and stationary terminals according to their mobility. Furthermore, mobile terminals may be divided into handheld terminals and vehicle mounted terminals according to whether or not it can be directly carried by a user.
The functions of mobile terminals have been diversified. For example, the functions may include data and voice communication, photographing and video shooting through a camera, voice recording, playing a music file through a speaker system, and displaying an image or video on a display. Some terminals further include an electronic game play function or perform a multimedia player function. In particular, in recent years, mobile terminals may receive multicast signals that provide visual content such as broadcast, video or television programs.
As it becomes multifunctional, for example, such a terminal is allowed to capture still images or moving images, play music or video files, play games, receive broadcast and the like, so as to be implemented as an integrated multimedia player. Meanwhile, in recent years, there is a trend to further expand the usability of a mobile terminal together with an external device interworking with the mobile terminal.
These terminals are operated by adopting the Android Operating System, but there is a problem in that a technology for integrating multiple displays is not supported by the Android OS, and only two displays with the same resolution can be integrated into a screen by a terminal manufacturer.
In addition, when two screens are integrated, there is a problem in that a combined screen thereof is clipped due to a physical distance between two displays.
An aspect of the present disclosure is to provide a mobile terminal capable of extending a display area of a mobile terminal through a case having an additional display interworking with the mobile terminal, and an electronic device having a case to which the mobile terminal is coupled.
Furthermore, an embodiment is to provide an electronic device and a control method capable of controlling a display provided in a case through wired communication to allow compatibility with various models and eliminate the need for a separate chip for communication.
In addition, an embodiment is to provide an electronic device and a control method thereof capable of outputting one application through a plurality of screens using an extended display area interworking through wired communication.
Moreover, an embodiment provides an electronic device and a control method thereof capable of integrating two displays having different hardware specifications to display them on a single display.
Besides, an embodiment is to overcome a clipping phenomenon that occurs due to a physical distance between the two displays when the screens are integrated.
According to an embodiment, there is provided an electronic device including a mobile terminal and a case, wherein the mobile terminal of the electronic device includes a terminal body coupled to the case, a connection port provided on one side of the terminal body, a controller, and a first display, the case includes a first body accommodating the terminal body, a connector protruding toward an inner side of the first body to be inserted into the connection port, a second display displaying a game executed in the mobile terminal, and a wiring portion configured to electrically connect the first body and the second body, the controller controls the first display and the second display to define an integrated display comprising the first display and the second display, and divides a first image displayed on the first display to display the first image on the integrated display, and the divided first image includes a first sub-image and a second sub-image, and the first sub-image and the second sub-image comprises an overlapping area, and the overlapping area is part of the first sub-image.
Furthermore, in the electronic device according to an embodiment, causing the controller to divide the first image may be causing the controller to set a predetermined dividing line on the first image, to set part of the first sub-image area as the overlapping area based on the dividing line, and to divide the first image such that the overlapping area is included in both the first sub-image and the second sub-image.
Furthermore, in the electronic device according to an embodiment, the controller may further set part of the first sub-image area as the overlapping area in a first direction based on the dividing line, and divide the first image such that the overlapping area is included in both the first sub-image and the second sub-image.
Furthermore, in the electronic device according to an embodiment, the first image may be an image corresponding to an application executed on the first display, and when the application supports the integrated display, the controller may further display an integration dot in a predetermined area of the first display, and define the integrated display according to a first touch corresponding to the integration dot.
Furthermore, in the electronic device according to an embodiment, the controller may further add a width of the first display and a width of the second display to calculate a width of the integrated display, and to calculate a smaller one between the width of the first display and the width of the second display as a height of the integrated display so as to calculate a size of the integrated display.
Furthermore, in the electronic device according to an embodiment, the controller may further control the integrated display to display the first sub-image and the second sub-image in response to a layout of the application, and the layout may be changed according to the calculated size of the integrated display.
Furthermore, in the electronic device according to an embodiment, causing the controller to control the first display and the second display so as to define the integrated display may be causing the controller to change the size of the first display according to the calculated size of the integrated display and to change the size of the second display such that the size of the first display is the same as that of the second display.
Furthermore, in the electronic device according to an embodiment, causing the controller to change the size of the second display such that the size of the first display is the same as that of the second display may be causing the controller to change a flag of the second display to be the same as that of the first display.
Furthermore, in the electronic device according to an embodiment, the controller may further display the first image on the integrated display, and then end the defined integrated display according to a second touch corresponding to the integration dot.
Furthermore, in the electronic device according to an embodiment, the first touch and the second touch may be either one of a swipe or a touch and drag in a direction toward the second display.
According to another embodiment of the present disclosure, there is provided a method of controlling an electronic device including a mobile terminal and a case, the mobile terminal including a terminal body coupled to the case, a connection port provided on one side of the terminal body, a controller, and a first display, the case including a first body accommodating the terminal body, a connector protruding toward an inside of the first body to be inserted into the connection port, a second display displaying a game executed in the mobile terminal, and a wiring portion configured to electrically connect the first body and the second body, wherein the method includes controlling, by the controller, the first display and the second display to define an integrated display comprising the first display and the second display; and dividing a first image displayed on the first display to display the first image on the integrated display, and the divided first image includes a first sub-image and a second sub-image, and the first sub-image and the second sub-image include an overlapping area, and the overlapping area is part of the first sub-image.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the dividing, by the controller, a first image displayed on the first display to display the first image on the integrated display may include setting, by the controller, a predetermined dividing line on the first image and setting part of the first sub-image area as the overlapping area based on the dividing line; and dividing, by the controller, the first image such that the overlapping area is included in both the first sub-image and the second sub-image.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the setting, by the controller, a predetermined dividing line on the first image and setting part of the first sub-image area as the overlapping area based on the dividing line may be setting, by the controller, part of the first sub-image area as the overlapping area in a first direction based on the dividing line.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the first image may be an image corresponding to an application executed on the first display, wherein the control method of the electronic device further includes displaying, by the controller, an integration dot on a predetermined area of the first display when the application supports the integrated display; and defining, by the controller, the integrated display according to a first touch corresponding to the integration dot.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the method may further include adding a width of the first display and a width of the second display to calculate a width of the integrated display, and to calculate a smaller one between the width of the first display and the width of the second display as a height of the integrated display so as to calculate a size of the integrated display.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the method may further include controlling the integrated display such that the first sub-image and the second sub-image are displayed in response to a layout of the application, wherein the layout is changed according to the calculated size of the integrated display.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the controlling, by the controller, the first display and the second display to define the integrated display may include changing, by the controller, a size of the first display according to the calculated size of the integrated display; and changing a size of the second display such that the size of the first display is the same as that of the second display.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the changing, by the controller, a size of the second display such that the size of the first display may be the same as that of the second display is changing, by the controller, a flag of the second display to be the same as that of the first display.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the method may further include displaying the first image on the integrated display, and then ending the defined integrated display according to a second touch corresponding to the integration dot.
Furthermore, in the control method of the electronic device according to another embodiment of the present disclosure, the first touch and the second touch may be either one of a swipe or a touch and drag in a direction toward the second display.
As described above, according to a mobile terminal and an electronic device having the mobile terminal according to the present disclosure, there is an effect that two displays having different hardware specifications can be integrated and displayed on a single display.
In addition, according to a mobile terminal and an electronic device having the mobile terminal according to the present disclosure, there is an effect of overcoming a clipping phenomenon that occurs due to a physical distance between the two displays when screens thereof are integrated.
Hereinafter,
Referring to the drawings, a mobile terminal 100 is coupled to a case 200, and the mobile terminal 100 and the case 200 are coupled to constitute one electronic device 300.
In this case, the mobile terminal may be implemented using a variety of different types of terminals. Examples of such terminals include cellular phones, smart phones, laptop computers, digital broadcast terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigators, slate PCs, tablet PCs, ultra-books, wearable devices (for example, smart watches, smart glasses, head mounted displays (HMDs)), and the like. Details of the mobile terminal will be described later with reference to
The case 200 may be a pouch that protects outer surfaces of the mobile terminal 100 or covers or accommodates at least one surface of the mobile terminal 100 as an accessory of the mobile terminal 100. The case 200 may be configured to expand a function of the mobile terminal 100 in combination with the mobile terminal 100.
Meanwhile, in the present disclosure, information output from the mobile terminal may be processed in association with a structure or a function of the case 200. For example, referring to
The case may include first and second bodies 220 that are rotatably connected to each other, and the display 250 may be disposed on any one of the first and second bodies 210, 220.
For example, the first body 210 may be disposed to accommodate at least a portion of the mobile terminal body. As a rear side of the mobile terminal is accommodated in the first body 210, and the first display 151 disposed on a front side of the mobile terminal is exposed outside.
In addition, there may be provided at least one hole on one side of the first body 210, so that at least a part of components of the mobile terminal exposed outside the case performs a function when the mobile terminal 100 is coupled to the first body 210.
Here, the mobile terminal 100 may be detachably coupled to the first body 210. In addition, the mobile terminal may be configured to detect whether the mobile terminal is coupled to the first body 210. For the detection, the first body 210 may include a magnet 245 on one side thereof facing the mobile terminal 100, and the mobile terminal may include a hall sensor 143 at the rear side thereof which is configured to sense a magnetic field corresponding to the magnet 245 when the mobile terminal is coupled to the first body. When the magnetic field is sensed by the hall sensor, the mobile terminal may recognize that it is coupled to the case, and then perform predetermined control.
For example, when a magnetic field is sensed by the hall sensor 143, a controller 180 of the mobile terminal 100 may supply an operating current to the second display 250 provided on the second body 220 or perform a process to prepare a state in which a signal can be transmitted to the second display 250. That is, the predetermined control may refer to an operation related to the preparation process.
Here, the ‘preparation process’ denotes a standby state in which the controller of the mobile terminal 100 can immediately perform a next process when an operating current is supplied to the second display 250. Therefore, even if the magnetic field is sensed by the hall sensor 143, a current is not immediately supplied to the second display 250.
Meanwhile, when it is detected that a connector provided on one side of the first body 210, for example, at a lower end of the first body 210 and a connection port provided at a lower end of the mobile terminal accommodated in the first body 210 are mutually coupled, the controller 180 of the mobile terminal may supply an operating current to the second display 250 provided on the second body 220.
Specifically, an operating current may be supplied from a power supply unit of the mobile terminal 100 to a circuit board on the second display 250 through a flexible printed circuit board (FPCB) connected by the connector and a wiring portion (e.g., a coaxial cable) provided in a connection portion 230 of the case 200.
To this end, the controller 180 of the mobile terminal may be configured to recognize resistances Ra, Rd in the first body 210 through a specific contact pin of the connector provided in the first body 210, detect a coupling of the connector and the connection port, and accordingly supply an operating current. This will be described in more detail below.
The second display 250 provided on the second body 220 may be configured to operate based on power supplied from the mobile terminal 100.
The second display 250 may be disposed on the second body 220 to extend a display area of the first display 151 or may be operated independently of the first display 151. For example, contents related to information displayed on the first display 151 may be mirrored to be displayed on the second display 250.
In addition, execution screens of different applications may be displayed on the first display 151 and the second display 250, respectively. As another example, an execution screen of one application may be divided and displayed on the first display 151 and the second display 250. Also, screens corresponding to different execution steps or different tasks of one application may be displayed on the first display 151 and the second display 250.
Furthermore, the mobile terminal 100 is configured to control screen information displayed on the second display 250, and for this purpose, a communication link for wired communication (e.g., a USB 2.0 communication link) may be established between the mobile terminal 100 and the second display 250.
Meanwhile, both the first display 151 and the second display 250 are exposed outside in open state, and the open state may be defined with reference to
Referring to
The closed state is the state in (a) of
In the closed state, a body of the mobile terminal 100 accommodated in the first body 210 may not be exposed outside. In addition, in the closed state, a sub-display 250a to display notification information corresponding to a specific event occurring in the mobile terminal 100 may be exposed from one side of a front surface of the second body 220 including the second display 250.
In the closed state, the second body 220 is rotated relative to the first body 210 to be changed to the open state.
The open state is a state in which the first display is not covered by the second display 250, and between the first display 151 and the second display 250 forms a specific angle other than 0 degrees.
Specifically, the open state may be one of a ‘first state’ in which the first display 151 and the second display 250 form about 60 degrees (a), a ‘second state’ in which the first display 151 and the second display 250 form about 120 degrees (b), a ‘third state’ in which the first display 151 and the second display 250 form about 180 degrees (c), and a ‘fourth state’ in which the first display 151 and the second display 250 form about 270 degrees (d), as illustrated in (b) of
In the open state, the first and second bodies 210, 220 may be fixed at a specific angle to become any one of the first to fourth states, and a fixing member to fix the bodies at a specific angle may be provided in the second body 220.
The controller 180 of the mobile terminal may control the mobile terminal to perform different operation modes in any one of the first to fourth states. For example, in the first state, the mobile terminal may operate in a ‘privacy protection mode’, and in the second state, the mobile terminal may operate in a ‘laptop mode’. In addition, in the third state, the mobile terminal may operate in a ‘display extension mode’, and in the fourth state, may operate in a ‘multi-display mode’.
A state in which the first display 151 and the second display 250 are exposed outside is defined as the ‘open state’. In the ‘open state’, the first display 151 is not covered by the second display 250. Accordingly, a state in which the first display 151 is covered by the second display 250 is defined as the ‘closed state’. The open state and the closed state may be distinguished by a sensing value of an illuminance sensor provided on a front surface of the first display 151.
Meanwhile, as illustrated in (c) of
In the flip state, components provided on the rear surface of the mobile terminal 100 coupled to the first body 210, for example, the rear camera 121b, the optical output module 154, and the flash 124, the user input unit 123a may be detected by recognizing a state covered by the rear surface of the second body 220.
In addition, the first state to the fourth state, and the flipped state may be detected by a separate sensor provided in the connection portion 230 that couples the first and second bodies 210, 220 to be relatively rotatable or separate sensors provided on rear surfaces of the first and second bodies 210, 220.
The electronic device 300 of the present disclosure may perform an operation of controlling the first display 151 and the second display 250 in cooperation with the open state and closed state. As an example, when the first display 151 and the second display 250 are operated in inactive state in the closed state and are changed from the closed state to the open state, at least one of the first display 151 and the second display 250 may be activated.
As an example, when changed to the open state, both the first display 151 and the second display 250 may be changed to active state. Here, different home screen pages may be displayed on the first display 151 and the second display 250, respectively, or identical home screen pages may be displayed on the first display 151 and the second display 250. In addition, various information may be displayed on the first display 151 and the second display 250 according to circumstances.
As another example, when changed to the open state, the first display 151 is switched to active state, and the second display 250 may be maintained in the inactive state.
The second display 250 may include a touch sensor configured to sense a touch applied to the second display 250. Also, the second display 250 may be configured to sense a touch even in the inactive state.
In relation to the touch sensed by the touch sensor, the second display 250 may be operated in active state when a predetermined type of touch is applied to the second display 250 in the open state. Alternatively, the second display 250 may be operated in active state based on a touch applied to the first display 151 in the open state.
Meanwhile, when a touch is applied to the second display 250, the second display 250 may transmit a touch signal corresponding to the touch to the mobile terminal 100. Then, when the touch according to the received touch signal corresponds to a predetermined type of touch, the mobile terminal 100 may transmit a signal corresponding to a control command to activate the second display 250 to the second display 250 side.
Then, the second display 250 and the controller of the second display 250 may be activated based on the signal received from the mobile terminal 100.
The transmission and reception of the signal may be performed by a wired communication method combining the connector provided on one side of the first body 210 and the connection port provided on the mobile terminal 100.
Meanwhile, a structure of the case to implement the operation of the electronic device described above will be described in more detail below.
Referring to
The second body 220 on which the second display 250 is disposed is rotatably coupled to the first body by the connection portion 230. That is, the connection portion 230 is disposed between the first and second bodies 210, 220 to couple the first and second bodies 210, 220 so that the first and second bodies 210, 220 are relatively rotatable.
The sub-display 250a to display predetermined information, for example, time information or event notification, may be provided on a front side of the second body 220. In this case, a simple event notification can be immediately checked through the sub-display 250a in the closed state without switching the electronic device 300 to the open state.
Referring to
The second cover 222 may be rotatably coupled to the connection portion 230, and a groove may be disposed at a position corresponding to the receiving groove 221a of the first cover 221 on the second cover 222, and the connection portion 230 may be disposed in the groove 222a. In this case, the second display 250 may be mounted on the second cover 222.
In addition, a signal transmitted from the controller of the mobile terminal is transmitted to the second display 250 side through a wiring portion 242, for example, a coaxial cable, provided on an inner side of the connection portion 230 and connected to a flexible printed circuit board 247 provided on a rear side of the first body 210. Hereinafter, the flexible printed circuit board provided on the rear side of the first body 210 and combined with the wiring portion 242 of the connection portion 230 will be referred to as a ‘first flexible printed circuit board’ 247. In addition, a flexible printed circuit board provided on a rear side of the second body 220 and combined with the wiring portion 242 of the connection portion 230 is referred to as a ‘second flexible printed circuit board’ 248.
The connection portion 230 may include a first hinge 231 and a second hinge 232 spaced apart along a side surface of the first body 210. The first hinge 231 and the second hinge 232 may each include a hinge body 233 and a hinge shaft 234.
A hinge groove (not shown) is disposed in the hinge body 233, and the hinge shaft 234 is inserted into the hinge groove so that the first and second bodies 210, 220 can rotate relative to each other. The hinge shaft 234 may be provided in plural, and coupling portions 235 coupled to the first and second bodies 210, 220, respectively, may be disposed on one side of the hinge shaft 234.
In addition, the wiring portion 242, for example, a coaxial cable, to be connected to a first flexible printed circuit board 247 and a second flexible printed circuit board 248 is provided on the inner side of the connection portion 230.
A connector 243a protruded toward the accommodating space 211 accommodating the mobile terminal and inserted into the connection port provided on one side of the mobile terminal body may be disposed on one side of the first body 210. To this end, at least one hole H through which at least a portion of a connector module including the connector 243a penetrates may be disposed on one side of the first body 210, for example, a side surface of a lower end.
Although not all illustrated, the connector 243a may be disposed to be rotatable 180 degrees toward the outside of the case, or may be disposed to be drawn in or out of the case by external force. In this case, even if there exists the connector 243, the mobile terminal body can be easily accommodated in the first body 210.
Alternatively, in one example, the first body 210 may be detachable in a vertical direction or at least an upper portion of the first body 210 may be made of a flexible material so that the mobile terminal body can be easily accommodated in the first body 210.
The connector module in which the connector 243a is installed may be mounted on one side of the first body 210, for example, at a center of a lower end. The connector 243a may be installed at one end of the connector module, and a charging port having a female pogo pin to be coupled to an external male pin may be installed at another end.
The connector 243a may be connected to a circuit board 244 to control the second display 250 through the first flexible printed circuit board 247, the second flexible printed circuit board 248, and the wiring portion 242. In addition, the connector 243a may be connected to the circuit board 244 through coupling with the connection port of the mobile terminal body. Here, the connection port provided in the mobile terminal body may denote, for example, a USB port.
A side of the second display 250 performs wired communication with the mobile terminal 100 through the first and second flexible circuit boards 247, 248, the wiring portion 242, and the circuit board 244 coupled through the connector 243. Furthermore, the mobile terminal 100 performs wired communication with the second display 250 through a connection port connected to the connector 243. In this regard, the connection port of the mobile terminal 100 may be referred to as a ‘first wired communication unit’, and the connector 243 of the case may be referred to as a ‘second wired communication unit’.
A first wired communication unit 161 and a second wired communication unit 243 may perform USB communication. The first wired communication unit 161 may perform USB I/O communication to transmit a signal to the case side through the second wired communication unit 243.
In addition, the second wired communication unit 243 may perform USB I/O communication to transmit a signal to the mobile terminal through the first wired communication unit 161. Here, the USB I/O communication may refer to USB 2.0 or USB 3.0 communication.
A USB (Universal Serial Bus), which is a common connector, is defined as an interface standard that enables connection of various peripheral devices. In the USB (Universal Serial Bus), a host necessarily exists, and communication is performed by a control through the host.
Referring to
A plurality of contact pins (e.g., male pins) may be provided inside the connector, and each of the plurality of contact pins may be set to perform a specific function when connected to pins of the connection port of the mobile terminal (e.g., female pins). This will be described in more detail below.
Meanwhile, according to
In this way, the first body 210 does not have a separate circuit board for wireless communication or the like other than the first flexible printed circuit board 247, so that the first body 210 becomes thinner, and the mobile terminal also does not need to have a separate circuit board for wireless communication. Accordingly, a compatibility of the mobile terminal mountable in the case is further improved, and an overall thickness of the electronic device can be fabricated thinner.
According to the drawing, the first and second bodies 210, 220 are coupled to the circuit board 244 via the wiring portion 242 coupled to the first and the second flexible printed circuit boards 247, 248, and they are electrically connected to each other. The circuit board 244 may be connected to the second display 250 to transmit a signal received from the mobile terminal 100 to the second display 250.
That is, the circuit board 244 may transmit data transmitted and received from the mobile terminal through the first wired communication unit 161 and the second wired communication unit 243 to the second display 250.
The wiring portion 242 electrically connects the first and second bodies 210, 220 through the connection portion 230. For this connection, a connection passage through which the wiring portion 242 passes may be disposed in the connection portion 230.
As an example of this, the first hinge 231 and the second hinge 232 have an accommodating space accommodating at least a part of the wiring portion 242. For example, the wiring portion 242 connected to the first flexible printed circuit board 247 that is coupled with the second wired communication unit 243 may be accommodated in the second hinge 232. In addition, the first hinge 231 and the second hinge 232 may be defined in a mutually symmetrical structure or shape.
The first and second wired communication units 161, 243 may be disposed at a lower side of the case 200 and the mobile terminal 100. In this case, the first flexible printed circuit board 247 connected to the wiring portion 242 may also be formed to be connected to one of the first hinge 231 and the second hinge 232 from the lower side.
In addition, the second hinge 232 may include an extending portion 236 extending from the hinge body 233, and the extending portion 236 may include cables 246 extended to the first body 210 and the second body 220, respectively. The accommodating space is disposed in the extending portion 236, and the cables 246 are accommodated in the accommodating space. The first flexible printed circuit board and second flexible printed circuit boards 247, 248 are disposed at both ends of the cables 246, and the first and second flexible printed circuit boards 247, 248 are electrically connected to the circuit board 244. According to the structure, a signal controlling the second display 250 is transmitted from the mobile terminal to the first body 210 and the second body 220 through the first wired communication unit 161 and the second wired communication unit 243.
Meanwhile, referring to the drawings, at the lower end of the first body 210 of the case, there may be disposed the connector 243a connected to the connection portion of the mobile terminal so that the second display 250 and the circuit board 244 receive power from the mobile terminal. The connector 243a supplies power of the mobile terminal to the circuit board 244 through the first flexible printed circuit board 247, the wiring portion 242, and the second flexible printed circuit board 248, and the circuit board 244 provides the power to the second display 250.
According to the structure, power supplied to the second display 250 and a signal transmitted to the second display 250 may be transmitted through a wired path in the mobile terminal.
According to the above-described structure, the electronic device performs an operation of controlling the first display 151 and the second display 250 to interwork with each other using wired communication and a wired power supply path. Hereinafter, the structure and the function of the mobile terminal will be described first, and then the control operation will be described.
Referring to
The mobile terminal 100 may include components, such as a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a controller 180, a power supply unit 190 and the like. The components shown in
In more detail, the wireless communication unit 110 of those components may typically include one or more modules which permit wireless communications between the mobile terminal 100 and a wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and an external server. In addition, the wireless communication unit 110 may include one or more modules that connect the mobile terminal 100 to one or more networks.
The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, a location information module 115 and the like.
The input unit 120 may include a camera 121 for inputting an image signal, a microphone 122 or an audio input module for inputting an audio signal, or a user input unit 123 (for example, a touch key, a push key (or a mechanical key), etc.) for causing a user to input information. Audio data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.
The sensing unit 140 may include at least one sensor which senses at least one of internal information of the mobile terminal, a surrounding environment of the mobile terminal and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared (IR) sensor, a finger scan sensor, a ultrasonic sensor, an optical sensor (for example, refer to the camera 121), a microphone 122, a power supply unit gauge (battery gauge), an environment sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, a thermal sensor, a gas sensor, etc.), and a chemical sensor (for example, an electronic nose, a health care sensor, a biometric sensor, etc.). On the other hand, the mobile terminal disclosed herein may utilize information in such a manner of combining information sensed by at least two sensors of those sensors.
The output unit 150 may be configured to output an audio signal, a video signal or a tactile signal. The output unit 150 may include a display 151, an audio output module 152, a haptic module 153, an optical output module 154 and the like. The display 151 may have an inter-layered structure or an integrated structure with a touch sensor in order to facilitate a touch screen. The touch screen may provide an output interface between the mobile terminal 100 and a user, as well as functioning as the user input unit 123 which provides an input interface between the mobile terminal 100 and the user.
The interface unit 160 may serve as an interface with various types of external devices connected with the mobile terminal 100. The interface unit 160, for example, may include wired or wireless headset ports, external power supply ports, wired or wireless data ports, memory card ports, ports for connecting a device having an identification module, audio input/output (1/O) ports, video I/O ports, earphone ports, or the like. The mobile terminal 100 may execute an appropriate control associated with a connected external device, in response to the external device being connected to the interface unit 160.
In addition, the memory 170 stores data that support various functions of the mobile terminal 100. The memory 170 is typically implemented to store data to support various functions or features of the mobile terminal 100. For instance, the memory 170 may be configured to store application programs executed in the mobile terminal 100, data or instructions for operations of the mobile terminal 100, and the like. At least some of those application programs may be downloaded from an external server via wireless communication. Some others of those application programs may be installed within the mobile terminal 100 at the time of being shipped for basic functions of the mobile terminal 100 (for example, receiving a call, placing a call, receiving a message, sending a message, etc.). On the other hand, the application programs may be stored in the memory 170, installed in the mobile terminal 100, and executed by the controller 180 to perform an operation (or a function) of the mobile terminal 100.
The controller 180 may typically control an overall operation of the mobile terminal 100 in addition to the operations associated with the application programs. The controller 180 may provide or process information or functions appropriate for a user in a manner of processing signals, data, information and the like, which are input or output by the aforementioned components, or activating the application programs stored in the memory 170.
Furthermore, the controller 180 may control at least part of the components illustrated in
The power supply unit 190 may receive external power or internal power and supply appropriate power required for operating respective elements and components included in the mobile terminal 100 under the control of the controller 180. The power supply unit 190 includes a power supply unit, and the power supply unit may be a built-in power supply unit or a replaceable power supply unit.
At least part of those elements and components may be combined to implement operation and control of the mobile terminal or a control method of the mobile terminal according to various exemplary embodiments described herein. Furthermore, the operation and control or the control method of the mobile terminal may be implemented in the mobile terminal in such a manner of activating at least one application program stored in the memory 170.
Hereinafter, each aforementioned component will be described in more detail with reference to
First, the wireless communication unit 110 will be described. The broadcast receiving module 111 of the wireless communication unit 110 may receive a broadcast signal and/or broadcast associated information from an external broadcast managing entity via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. At least two broadcast receiving modules 111 may be provided in the mobile terminal 100 to simultaneously receive at least two broadcast channels or switch the broadcast channels.
The mobile communication module 112 may transmit/receive wireless signals to/from at least one of network entities, for example, a base station, an external terminal, a server, and the like, on a mobile communication network, which is constructed according to technical standards or transmission methods for mobile communications (for example, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc.)
Here, the wireless signals may include audio call signal, video (telephony) call signal, or various formats of data according to transmission/reception of text/multimedia messages.
The wireless Internet module 113 refers to a module for supporting wireless Internet access, and may be built-in or externally installed on the mobile terminal 100. The wireless Internet module 113 may transmit and/or receive wireless signals via communication networks according to wireless Internet technologies.
Examples of such wireless Internet access may include Wireless LAN (WLAN), Wireless-Fidelity (Wi-Fi), Wireless Fidelity Direct (Wi-Fi Direct), Digital Living Network Alliance (DLNA), Wireless Broadband (WiBro), World Interoperability for Microwave Access (WiMAX), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), and the like. The wireless Internet module 113 may transmit/receive data according to at least one wireless Internet technology within a range including even Internet technologies which are not aforementioned.
From the perspective that the wireless Internet accesses according to Wipro, HSDPA, GSM, CDMA, WCDMA, LTE, LTE-A and the like are executed via a mobile communication network, the wireless Internet module 113 which performs the wireless Internet access via the mobile communication network may be understood as a type of the mobile communication module 112.
The short-range communication module 114 denotes a module for short-range communications. Suitable technologies for implementing the short-range communications may include BLUETOOTH™, Radio Frequency IDentification (RFID), Infrared Data Association (IrDA), Ultra-WideBand (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and the like. The short-range communication module 114 may support wireless communications between the mobile terminal 100 and a wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal and a network where another mobile terminal 100 (or an external server) is located, via wireless personal area networks. The short-range communication module 114 denotes a module for short-range communications.
Here, the another mobile terminal 100 may be a wearable device, for example, a smart watch, smart glasses or a head mounted display (HMD), which is able to exchange data with the mobile terminal 100 (or to link data with the mobile terminal 100). The short-range communication module 114 may sense (recognize) a wearable device, which is able to communicate with the mobile terminal), near the mobile terminal 100. In addition, when the sensed wearable device is a device which is authenticated to communicate with the mobile terminal 100 according to the present disclosure, the controller 180 may transmit at least part of data processed in the mobile terminal 100 to the wearable device via the short-range communication module 114. Hence, a user of the wearable device may use the data processed in the mobile terminal 100 on the wearable device. For example, when a call is received in the mobile terminal 100, the user may answer the call using the wearable device. Also, when a message is received in the mobile terminal 100, the user can check the received message using the wearable device.
The location information module 115 is generally configured to detect, calculate, derive or otherwise identify a position of the mobile terminal. As an example, the location information module 115 includes a Global Position System (GPS) module, a WiFi module, or both. For example, when the mobile terminal uses the GPS module, a position of the mobile terminal may be acquired using a signal sent from a GPS satellite. As another example, when the mobile terminal uses the Wi-Fi module, a position of the mobile terminal may be acquired based on information associated with a wireless access point (AP) which transmits or receives a wireless signal to or from the Wi-Fi module. According to the need, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal. As a module used to acquire the location (or current location) of the mobile terminal, the location information module 115 may not be necessarily limited to a module for directly calculating or acquiring the location of the mobile terminal.
Then, the input unit 120 is configured to provide an video information (or signal), audio information (or signal), data or an input of information entered by a user, and the mobile terminal 100 may include one or a plurality of cameras 121 to enter video information. The camera 121 processes an image frame, such as still picture or video, acquired by an image sensor in a video phone call or image capturing mode. The processed image frames may be displayed on the display 151. On the other hand, the plurality of cameras 121 disposed in the mobile terminal 100 may be arranged in a matrix configuration. By use of the cameras 121 having the matrix configuration, a plurality of image information having various angles or focal points may be input into the mobile terminal 100. As another example, the cameras 121 may be located in a stereoscopic arrangement to acquire left and right images for implementing a stereoscopic image.
The microphone 122 may process an external audio signal into electric audio data. The processed audio data may be utilized in various manners according to a function being executed in the mobile terminal 100 (or an application program being executed). On the other hand, the microphone 122 may include assorted noise removing algorithms to remove noise generated in the course of receiving the external audio signal.
The user input unit 123 may receive information input by a user. When information is input through the user input unit 123, the controller 180 may control an operation of the mobile terminal 100 to correspond to the input information. The user input unit 123 may include one or more of a mechanical input element (for example, a key, a button located on a front and/or rear surface or a side surface of the mobile terminal 100, a dome switch, a jog wheel, a jog switch, and the like), or a touch-sensitive input, among others. As one example, the touch-sensitive input may be a virtual key or a soft key, which is displayed on a touch screen through software processing, or a touch key which is located on the mobile terminal at a location that is other than the touch screen. On the other hand, the virtual key or the visual key may be displayed on the touch screen in various shapes, for example, graphic, text, icon, video, or a combination thereof.
On the other hand, the sensing unit 140 may sense at least one of internal information of the mobile terminal, surrounding environment information of the mobile terminal and user information, and generate a sensing signal corresponding to it. The controller 180 may control an operation of the mobile terminal 100 or execute data processing, a function or an operation associated with an application program installed in the mobile terminal based on the sensing signal. Hereinafter, description will be given in more detail of representative sensors of various sensors which may be included in the sensing unit 140.
First, a proximity sensor 141 refers to a sensor to sense presence or absence of an object approaching to a surface to be sensed, or an object disposed near a surface to be sensed, by using an electromagnetic field or infrared rays without a mechanical contact. The proximity sensor 141 may be arranged at an inner area of the mobile terminal covered by the touch screen, or near the touch screen.
The proximity sensor 141 may include an optical transmission type photoelectric sensor, a direct reflective type photoelectric sensor, a mirror reflective type photoelectric sensor, a high-frequency oscillation proximity sensor, a capacitance type proximity sensor, a magnetic type proximity sensor, an infrared rays proximity sensor, and so on. When the touch screen is implemented as a capacitance type, the proximity sensor 141 may sense proximity of a pointer to the touch screen by changes of an electromagnetic field, which is responsive to an approach of an object with conductivity. In this case, the touch screen (touch sensor) may also be categorized as a proximity sensor.
On the other hand, for the sake of brief explanation, a behavior in which the pointer is positioned to be proximate onto the touch screen without contact will be referred to as “proximity touch,” whereas a behavior in which the pointer substantially comes into contact with the touch screen will be referred to as “contact touch.” For the position corresponding to the proximity touch of the pointer on the touch screen, such position will correspond to a position where the pointer faces perpendicular to the touch screen upon the proximity touch of the pointer. The proximity sensor 141 may sense proximity touch, and proximity touch patterns (e.g., distance, direction, speed, time, position, moving status, etc.). On the other hand, the controller 180 may process data (or information) corresponding to the proximity touches and the proximity touch patterns sensed by the proximity sensor 141, and output visual information corresponding to the process data on the touch screen. In addition the controller 180 may control the mobile terminal 100 to execute different operations or process different data (or information) according to whether a touch with respect to the same point on the touch screen is either a proximity touch or a contact touch.
A touch sensor may sense a touch (or touch input) applied onto the touch screen (or the display 151) using at least one of various types of touch methods, such as a resistive type, a capacitive type, an infrared type, a magnetic field type, and the like.
As one example, the touch sensor may be configured to convert changes of pressure applied to a specific part of the display 151 or a capacitance occurring from a specific part of the display 151, into electric input signals. The touch sensor may be configured to detect a position, an area where a touch object applying a touch onto the touch screen is touched on the touch sensor, a pressure at the time of touch, a capacitance at the time of touch, and the like. Here, the touch object body may be a finger, a touch pen or stylus pen, a pointer, or the like as an object through which a touch is applied to the touch sensor.
When a touch input is sensed by a touch sensor, corresponding signals may be transmitted to a touch controller. The touch controller may process the received signals, and then transmit corresponding data to the controller 180. Accordingly, the controller 180 may sense which area of the display 151 has been touched. Here, the touch controller may be a component separate from the controller 180 or the controller 180 itself.
On the other hand, the controller 180 may execute a different control or the same control according to a type of an object which touches the touch screen (or a touch key provided in addition to the touch screen). Whether to execute the different control or the same control according to the object which gives a touch input may be decided based on a current operating state of the mobile terminal 100 or a currently executed application program.
Meanwhile, the touch sensor and the proximity sensor may be executed individually or in combination, to sense various types of touches, such as a short (or tap) touch, a long touch, a multi-touch, a drag touch, a flick touch, a pinch-in touch, a pinch-out touch, a swipe touch, a hovering touch, and the like.
An ultrasonic sensor may be configured to recognize position information relating to a sensing object by using ultrasonic waves. Meanwhile, the controller 180 may calculate the location of a wave generating source through information sensed from the optical sensor and the plurality of ultrasonic sensors. Since light is much faster than ultrasonic waves, a time for which the light reaches the optical sensor may be much shorter than a time for which the ultrasonic wave reaches the ultrasonic sensor. The position of the wave generation source may be calculated using the fact. In more detail, the position of the wave generation source may be calculated by using a time difference from the time that the ultrasonic wave reaches based on the light as a reference signal.
The camera 121 constructing the input unit 120 may be a type of camera sensor. The camera sensor may include at least one of a photo sensor (or image sensor) and a laser sensor.
The camera 121 and the laser sensor may be combined to detect a touch of the sensing object with respect to a 3D stereoscopic image. The photo sensor may be laminated on the display device. The photo sensor may be configured to scan a movement of the sensing object in proximity to the touch screen. In more detail, the photo sensor may include photo diodes and transistors at rows and columns to scan content placed on the photo sensor by using an electrical signal which changes according to the quantity of applied light. Namely, the photo sensor may calculate the coordinates of the sensing object according to variation of light to thus obtain position information of the sensing object.
The display 151 displays (outputs) information processed by the mobile terminal 100. For example, the display 151 may display execution screen information of an application program driven in the mobile terminal 100 or user interface (UI) and graphic user interface (GUI) information in response to the execution screen information.
Furthermore, the display 151 may also be implemented as a stereoscopic display for displaying stereoscopic images.
The stereoscopic display may employ a stereoscopic display scheme such as stereoscopic scheme (a glass scheme), an auto-stereoscopic scheme (glassless scheme), a projection scheme (holographic scheme), or the like.
The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode, a record mode, a voice recognition mode, a broadcast reception mode, and the like. Also, the audio output module 152 may also provide audible output signals associated with a particular function (e.g., a call signal reception sound, a message reception sound, etc.) carried out by the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer or the like.
A haptic module 153 may generate various tactile effects the that user may feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. Strength, pattern and the like of the vibration generated by the haptic module 153 may be controllable by a user selection or setting of the controller. For example, the haptic module 153 may output different vibrations in a combining manner or a sequential manner.
Besides vibration, the haptic module 153 may generate various other tactile effects, including an effect by stimulation such as a pin arrangement vertically moving with respect to a contact skin, a spray force or suction force of air through a jet orifice or a suction opening, a touch on the skin, a contact of an electrode, electrostatic force, etc., an effect by reproducing the sense of cold and warmth using an element that can absorb or generate heat, and the like.
The haptic module 153 may be configured to transmit tactile effects through a user's direct contact, or a user's muscular sense using a finger or a hand. Two or more haptic modules 153 may be provided according to the particular configuration of the mobile terminal 100.
An optical output module 154 may output a signal for indicating an event generation using light of a light source. Examples of events generated in the mobile terminal 100 may include a message reception, a call signal reception, a missed call, an alarm, a schedule notice, an email reception, an information reception through an application, and the like.
A signal output by the optical output module 154 may be implemented in such a manner that the mobile terminal emits monochromatic light or light with a plurality of colors. The signal output may be terminated as the mobile terminal senses that a user has checked the generated event, for example.
The interface unit 160 serves as an interface for external devices to be connected with the mobile terminal 100. For example, the interface unit 160 can receive data transmitted from an external device, receive power to transfer to elements and components within the mobile terminal 100, or transmit internal data of the mobile terminal 100 to such external device. The interface unit 160 may include wired or wireless headset ports, external power supply ports, wired or wireless data ports, memory card ports, ports for connecting a device having an identification module, audio input/output (1/O) ports, video I/O ports, earphone ports, or the like.
The identification module may be a chip that stores various information for authenticating authority of using the mobile terminal 100 and may include a user identity module (UIM), a subscriber identity module (SIM), a universal subscriber identity module (USIM), and the like. A device having the identification module (hereinafter, an “identification device”) may be fabricated in the form of a smart card. Accordingly, the identifying device may be connected with the terminal 100 via the interface unit 160.
Furthermore, when the mobile terminal 100 is connected with an external cradle, the interface unit 160 may serve as a passage to allow power from the cradle to be supplied to the mobile terminal 100 therethrough or may serve as a passage to allow various command signals input by the user from the cradle to be transferred to the mobile terminal therethrough. Such various command signals or power inputted from the cradle may operate as signals for recognizing that the mobile terminal 100 has accurately been mounted to the cradle.
The memory 170 can store programs to support operations of the controller 180 and store input/output data (for example, phonebook, messages, still images, videos, etc.). The memory 170 may store data related to various patterns of vibrations and audio which are output in response to touch inputs on the touch screen.
The memory 170 may include at least one type of storage medium including a Flash memory, a hard disk, a multimedia card micro type, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read-Only Memory (ROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Programmable Read-Only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. Also, the mobile terminal 100 may be operated in relation to a web storage device that performs the storage function of the memory 170 over the Internet.
As aforementioned, the controller 180 may typically control the general operations of the mobile terminal 100. For example, the controller 180 may set or release a locked state for restricting a user from inputting a control command with respect to applications when a state of the mobile terminal meets a preset condition.
Furthermore, the controller 180 may also perform controlling and processing associated with voice calls, data communications, video calls, and the like, or perform pattern recognition processing to recognize a handwriting input or a picture drawing input performed on the touch screen as characters or images, respectively. In addition, the controller 180 may control one or combination of those components in order to implement various exemplary embodiment disclosed herein on the mobile terminal 100.
The power supply unit 190 may receive external or internal power to provide power required by various components under the control of the controller 180. The power supply unit 190 may include a power supply unit, which is typically rechargeable built-in power supply unit or may be detachably coupled to the terminal body for charging or the like.
Furthermore, the power supply unit 190 may include a connection port. The connection port may be configured as one example of the interface unit 160 to which an external (re)charger for supplying power to recharge the power supply unit is electrically connected.
As another example, the power supply unit 190 may be configured to recharge the power supply unit in a wireless manner without use of the connection port. Here, the power supply unit 190 may receive power, transferred from an external wireless power transmitter, using at least one of an inductive coupling method which is based on magnetic induction or a magnetic resonance coupling method which is based on electromagnetic resonance.
Various embodiments described herein may be implemented in a computer-readable or its similar medium using, for example, software, hardware, or any combination thereof.
Referring now to
Here, the terminal body may be understood as a conception which indicates the mobile terminal 100 as at least one assembly.
The mobile terminal 100 may include a case (for example, a frame, a housing, a cover, etc.) constituting the appearance thereof. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components may be incorporated into a space disposed between the front case 101 and the rear case 102. At least one middle case may be additionally disposed between the front case 101 and the rear case 102
The display 151 may be disposed on a front surface of the terminal body to output information. As illustrated, a window 151a of the display 151 may be mounted to the front case 101 so as to define the front surface of the terminal body together with the front case 101.
In some cases, electronic components may also be mounted to the rear case 102. Examples of those electronic components mounted to the rear case 102 may include a detachable power supply unit, an identification module, a memory card and the like. Here, a back cover 103 for covering the electronic components mounted may be detachably coupled to the rear case 102. Therefore, when the back cover 103 is separated from the rear case 102, the electronic components mounted to the rear case 102 may be externally exposed.
As illustrated, when the back cover 103 is coupled to the rear case 102, a side surface of the rear case 102 may be partially exposed. In some cases, upon the coupling, the rear case 102 may also be completely shielded by the rear cover 103. Meanwhile, the rear cover 103 may be provided with an opening portion for exposing the camera 121b, the optical output module 154, the flash 124, the rear input unit 123a, and the like to the outside.
The cases 101, 102, 103 may be formed by injection-molding synthetic resin or may be formed of a metal, for example, stainless steel (STS), aluminum (Al), titanium (Ti), or the like.
Unlike the example which the plurality of cases form an inner space for accommodating such various components, the mobile terminal 100 may be configured such that one case forms the inner space. In this case, the mobile terminal 100 with a unibody in which synthetic resin or metal is extended from a lateral surface to a rear surface may be implemented.
On the other hand, the mobile terminal 100 may include a waterproofing unit (not shown) for preventing an introduction of water into the terminal body. For example, the waterproof portion may include a waterproof member provided between the window 151a and the front case 101, between the front case 101 and the rear case 102, or between the rear case 102 and the back cover 103, to hermetically seal an inner space when those cases are coupled to each other.
The mobile terminal 100 may include a display 151, first and second audio output modules 152a and 152b, a proximity sensor 141, an illumination sensor 152, an optical output module 154, first and second cameras 121a and 121b, first and second manipulation units 123a and 123b, a microphone 122, an interface unit 160 and the like.
Hereinafter, as illustrated in
However, the foregoing configuration may not be necessarily limited to the arrangement. The foregoing configuration may be excluded, substituted or disposed on another surface if necessary. For example, the manipulation unit may not be disposed on the front surface of the terminal body, and the second audio output module 152b may be disposed on the rear surface other than the side surface of the terminal body.
The display 151 displays (outputs) information processed by the mobile terminal 100. For example, the display 151 may display execution screen information of an application program driven in the mobile terminal 100 or user interface (UI) and graphic user interface (GUI) information in response to the execution screen information.
The display 151 may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display, a 3-dimensional (3D) display, and an e-ink display.
The display 151 may be implemented in two or more in number according to a configured aspect of the mobile terminal 100. For instance, a plurality of the displays 151 may be arranged on one surface to be spaced apart from or integrated with each other, or may be arranged on different surfaces.
The display 151 may include a touch sensor which senses a touch onto the display so as to receive a control command in a touching manner. When a touch is input to the display 151, the touch sensor may be configured to sense this touch and the controller 180 may generate a control command corresponding to the touch. The content which is input in the touching manner may be a text or numerical value, or a menu item which can be indicated or designated in various modes.
The touch sensor may be configured in a form of a film having a touch pattern, disposed between the window 151a and a display on a rear surface of the window 151a, or a metal wire which is patterned directly on the rear surface of the window 151a. Alternatively, the touch sensor may be integrally formed with the display. For example, the touch sensor may be disposed on a substrate of the display or within the display.
The display 151 may define a touch screen together with the touch sensor. Here, the touch screen may serve as the user input unit 123 (see
The first audio output module 152a may be implemented in the form of a receiver for transferring voice sounds to the user's ear or a loud speaker for outputting various alarm sounds or multimedia reproduction sounds.
The window 151a of the display 151 may include a sound hole for emitting sounds generated from the first audio output module 152a. Here, the present disclosure may not be limited to this. It may also be configured such that the sounds are released along an assembly gap between the structural bodies (for example, a gap between the window 151a and the front case 101). In this case, a hole independently disposed to output audio sounds may not be seen or is otherwise hidden in terms of appearance, thereby further simplifying the appearance and manufacturing of the mobile terminal 100.
The optical output module 154 may output light for indicating an event generation. Examples of the event may include a message reception, a call signal reception, a missed call, an alarm, a schedule notice, an email reception, information reception through an application, and the like. When a user's event check is sensed, the controller 180 may control the optical output module 154 to end the output of light.
The first camera 121a may process video frames such as still or moving images acquired by the image sensor in a video call mode or a capture mode. The processed video frames may be displayed on the display 151 or stored in the memory 170.
The manipulation units 123a and 123b are examples of the user input unit 123, which may be manipulated by a user to input a command for controlling the operation of the mobile terminal 100. The manipulation units 123a and 123b may employ any method if it is a tactile manner causing the user to perform manipulation with a tactile feeling such as touch, push, scroll or the like. In addition, the manipulation units 123a and 123b may also employ a method of causing the user to perform manipulation without a tactile feeling through a proximity touch, a hovering touch, or the like.
The manipulation unit 123a may be configured with a mechanical key, or a combination of a touch key and a push key. In addition, the manipulation unit 123a may be configured in a layered form with a fingerprint sensor.
The content input by the manipulation units 123a and 123b may be set in various ways. For example, the first and the second manipulation units may receive a command such as menu, home key, cancel, search, or the like, and may receive a command, such as controlling a volume level being output from the first or second audio output module 152a or 152b, switching into a touch recognition mode of the display 151, or the like.
On the other hand, as another example of the user input unit 123, a rear input unit (not shown) may be disposed on the rear surface of the terminal body. The rear input units are manipulated to enter a communication for controlling the operation of the mobile terminal 100, and the content being entered may be set in various ways. For example, the rear input unit may be used by the user to input a command, such as power on/off, start, end, scroll or the like, controlling a volume level being output from the first or second audio output module 152a or 152b, switching into a touch recognition mode of the display 151, or the like. The rear input unit may be implemented into a form causing a touch input, a push input or a combination thereof.
The rear input unit may be disposed to overlap with the display 151 of the front surface in a thickness direction of the terminal body. As one example, the rear input unit may be disposed on an upper end portion of the rear surface of the terminal body such that a user can easily manipulate it using a forefinger when the user grabs the terminal body with one hand. However, the present disclosure may not be limited to this, and the position of the rear input unit may be changeable.
When the rear input unit is disposed on the rear surface of the terminal body, a new user interface may be implemented using the rear input unit. Also, the aforementioned touch screen or the rear input unit may substitute for at least part of functions of the first manipulation unit 123a located on the front surface of the terminal body. Accordingly, when the first manipulation unit 123a is not disposed on the front surface of the terminal body, the display 151 may be implemented to have a larger screen.
On the other hand, the mobile terminal 100 may include a fingerprint recognition sensor for recognizing a user's fingerprint, and the controller 180 may use fingerprint information sensed through the finger recognition sensor as an authentication means. The finger recognition sensor may be integrated into the display 151 or the user input unit 123.
The microphone 122 may be configured to enter the user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of positions to receive stereo sounds.
The interface unit 160 may serve as a path causing the mobile terminal 100 to exchange data with external devices. For example, the interface unit 160 may be at least one of a connection terminal for connecting to another device (for example, an earphone, an external speaker, or the like), a port for near field communication (for example, an Infrared Data Association (IrDA) port, a Bluetooth port, a wireless LAN port, and the like), or a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented in the form of a socket for accommodating an external card, such as Subscriber Identification Module (SIM), User Identity Module (UIM), or a memory card for information storage.
The second camera 121b may be further mounted to the rear surface of the terminal body. The second camera 121b may have an image capturing direction, which is substantially opposite to the direction of the first camera unit 121a.
The second camera 121b may include a plurality of lenses arranged along at least one line. The plurality of lenses may also be arranged in a matrix configuration. The cameras may be referred to as an ‘array camera.’ When the second camera 121b is implemented as the array camera, images may be captured in various manners using the plurality of lenses and images with better qualities may be obtained.
A flash 124 may be disposed adjacent to the second camera 121b. When an image of a subject is captured with the camera 121b, the flash 124 may illuminate the subject.
The second audio output module 152b may further be disposed on the terminal body. The second audio output module 152b may implement stereophonic sound functions in conjunction with the first audio output module 152a, and may be also used for implementing a speaker phone mode for call communication.
At least one antenna for wireless communication may be disposed on the terminal body. The antenna may be installed in the terminal body or disposed on the case. For example, an antenna which configures a part of the broadcast receiving module 111 (see
A power supply unit 190 (see
The power supply unit 191 may receive power via a power source cable connected to the interface unit 160. Furthermore, the power supply unit 191 may be (re)chargeable in a wireless manner using a wireless charger. The wireless charging may be implemented by magnetic induction or electromagnetic resonance.
On the other hand, the drawing illustrates that the rear cover 103 is coupled to the rear case 102 for shielding the power supply unit 191, so as to prevent separation of the power supply unit 191 and protect the power supply unit 191 from an external impact or foreign materials. When the power supply unit 191 is detachable from the terminal body, the rear case 103 may be detachably coupled to the rear case 102.
An accessory for protecting an appearance or assisting or extending the functions of the mobile terminal 100 can also be provided on the mobile terminal 100. As one example of an accessory, a cover or pouch for covering or accommodating at least one surface of the mobile terminal 100 may be provided. The cover or pouch may link with the display 151 to extend the function of the mobile terminal 100. Another example of the accessory may be a touch pen for assisting or extending a touch input onto a touch screen.
Meanwhile, the electronic device according to the present disclosure is configured in such a manner that the connection port of the interface unit 160 provided on one side (e.g., lower end of side surface) of the mobile terminal, that is, the first wired communication unit 161 and the connector provided on one side of the first body 210 of the case 200, i.e., the second wired communication unit 243 are combined together to supply power and to perform wired communication for transmission and reception of various signals.
Here, it has been described that the wired communication is performed using a USB I/O interface standard. However, it is not limited thereto, and it should be noted that other interface standards for wired communication may be applied.
Hereinafter, a method for performing wired communication between the first wired communication unit 161 and the second wired communication unit 243 will be described in more detail with reference to the accompanying drawings.
The mobile terminal 100 according to the present disclosure may be coupled to the first body 210, and when the mobile terminal 100 is coupled to the first body 210, the connector 243 provided in the first body 210 is inserted into the connection port provided in the mobile terminal 100, and wired communication may be performed through the first and second wired communication units 161, 243.
At this time, the first body 210 on the case side becomes a host device of the mobile terminal, and may perform wired communication, for example, USB communication, with the mobile terminal 100.
The first wired communication unit 161 provided in the mobile terminal 100 may be included in the interface unit 160 described with reference to
The first wired communication unit 161 may be provided on a side surface of the lower end of the mobile terminal 100. In addition, the second wired communication unit 243 may be provided to correspond to a position in contact with the first wired communication unit 161 when the mobile terminal 100 is accommodated in the first body 210 of the case. That is, the second wired communication unit 243 may be provided on a side surface of the lower end of the first body 210.
In the present disclosure, when the mobile terminal 100 is accommodated in the first body 210, and the connector pin of the second wired communication unit 243 provided in the first body 210 is inserted into the port of the first wired communication unit 161 of the mobile terminal, wired communication, for example, USB I/O communication, may be performed through the first wired communication unit 161 and the second wired communication unit 243.
Accordingly, the mobile terminal 100 may supply an operating current to the second display 250 through the USB I/O interface, and transmit a control signal or an image signal. Also, in the second display 250, a touch signal may be transmitted to the mobile terminal 100 through the USB I/O interface to process the touch signal corresponding to the touch input applied to the second display 250.
Meanwhile, supply of the above-described operating current and transmission of the control signal and the image signal may be performed through different wired communication paths. To this end, the first and second wired communication units 161, 243 may include a plurality of connector pins, and may be set to use different contact pins according to the type of the transmitted signal.
Since the second wired communication unit 243 is inserted into the first wired communication unit 161 and coupled to the case, a plurality of contact pins molded in the second wired communication unit 243 is exposed to the outside. In the present disclosure, a structure in which the plurality of contact pins includes, for example, 12 pins has been described as an example.
Meanwhile, although not illustrated, the first and second wired communication units 161, 243 may have a waterproof member (not shown) molded together with the plurality of contact pins to prevent fluid from outside or to prevent fluid from moving inside. In addition, the waterproof member may be replaced with an O-ring having an elastic force.
The second wired communication unit 243 provided in the first body 210 is configured to transmit and receive wired data from the mobile terminal to the second display 250 through the wiring portion 242 included in the connection portion 230. In addition, the second wired communication unit 243 may communicate with the first wired communication unit 161 to perform unidirectional communication (data flow from the mobile terminal 100 to the second display 250) or bidirectional communication (bidirectional data flow between the mobile terminal 100 and the second display 250).
The first and second wired communication units 161, 243 according to the present disclosure may include a contact-type connector method. For example, the contact-type connector method may include a USB-C type connector or a lightning cable method.
In addition, the first and second wired communication units 161, 243 may be configured to transmit and receive various types of data in a wired communication method. For example, it may be one of graphic data, audio data, video data, touch event data, data related to control, and a combination thereof.
Meanwhile, the second display 250 provided in the second body 220 may be configured to operate based on power supplied from the power supply unit 191 of the mobile terminal 100.
Here, the power may be transmitted to the second display 250 and the circuit board 244 provided on the second body 220, through the connector 243 connected to the connection port of the mobile terminal 100, the wiring portion 242 coupled to the first flexible printed circuit board 247 and provided in the connection portion 230, and the second flexible printed circuit board 248 as described above.
The power supply unit 191 of the mobile terminal 100 is configured to supply an operating current (or power) to a power supply unit 291 of the second display 250 through an electric connection path of the first wired communication unit 161 connected to the connection port, the first flexible printed circuit board 247, the wiring portion 242 provided in the connection portion 230, and the second flexible printed circuit board 248 provided in the second body 220. Here, the operating current is supplied to the second display 250 through a specific contact pin provided in the first wired communication unit 161, for example, a ‘CC1’ pin of a USB C-type.
Meanwhile, the mobile terminal 100 may be detachably coupled to the first body 210. In addition, the mobile terminal may be configured to detect whether the mobile terminal is coupled to the first body 210. For the detection, the first body 210 may include a magnet 245 on one side thereof facing the mobile terminal 100, and the mobile terminal may include a hall sensor 143 at the rear side thereof which is configured to sense a magnetic field corresponding to the magnet 245 when the mobile terminal is coupled to the first body. When the magnetic field is sensed by the hall sensor, the mobile terminal may recognize that it is coupled to the case, and then perform predetermined control.
Here, the predetermined control does not denote supplying an operating current as described above.
When the first and second wired communication units 161, 243 are connected to enable mutual communication, the mobile terminal 100 may recognize a plurality of resistances Ra, Rd disposed in the first body 210 by specific contact pins (e.g., CC1, CC2) among a plurality of contact pins included in the first wired communication unit 161 provided in the first body 210. When the plurality of resistances are recognized as described above, an operating current is supplied to the second display 250 by supplying the power, for example, Vconn to CC1.
When an operating current is supplied to the second display 250, a system of the second display 250 is booted and initialized, and becomes an operable standby state.
Here, the second display 250 is either in active state or in inactive state, and even when the second display 250 is inactive, a touch sensor (or a touch panel 252) provided in the second display 250 is operated in an active state to sense a touch applied to the second display 250.
On the other hand, when the second display 250 is activated, the controller of the mobile terminal 100 transmits an image signal corresponding to screen information to be displayed on the display 251 provided on the second display 250 to the second wired communication unit 243 side through the first wired communication unit 161. Here, a wired communication path of the image signal is different from the wired communication path for supplying power.
For example, the power may be supplied to the second display 250 through a wired communication path through the CC1 pin provided in the second wired communication unit 243, and the image signal may be transmitted to the second display 250 through a wired communication path through the USB SS1 and SS2 pins.
Data may be received from the first wired communication unit 161 to the second display 250 through the second wired communication unit 243 and the circuit board 244. Here, a digital image signal may convert the data into a form that can be displayed on the second display 250 through a data converter 282. For example, the second display 250 may be configured as an LCD panel. And here, the digital image signal of a DP format received from the mobile terminal 100 may be converted into a data format (MIPI format) that can be received on the LCD panel through the data converter 282 to be transferred and displayed on the display 251.
Meanwhile, data transmitted and received through the first wired communication unit 161 and the second wired communication unit 243 may be transmitted and received using different contact pins in the USB I/O interface according to a type of the data.
Specifically, for example, the image signal may be transmitted and received from the mobile terminal 100 to the second display 250 through a USB SSPHY pin, and may be converted into a format that can be displayed on the second display 250 (e.g., MIPI format) through the data converter 282. In addition, for example, a control signal related to the operation of the second display 250 may be transmitted and received to the second display 250 through an external display port (EDP) AUX pin.
Signals that need to be transmitted between the mobile terminal 100 and the display 250, such as communication control signals, touch signals, and brightness control signals, can be transmitted and received through a first and a second signal processor 181, 281 using a second USB human interface device (HID) communication.
Here, in the mobile terminal 100 in an initial state, the first signal processor 181 transmits and receives signals through the first USB communication by using A6 and A7 pins on an A side, and B6 and B7 pins on a B side of the connector. Meanwhile, the first and second wired communication units 161, 234 are connected to enable mutual communication and when a plurality of resistances Ra, Rd is recognized through the CC1 pin, they are switched by switches and the A side pins and B side pins used in the initial state are separated to transmit and receive signals by using the second USB communication only using B6 and B7 pins on the B side.
As described above, when switches are switched to process signals by using the second USB communication, the first and second signal processors 181, 281 may perform 12 c conversion by USB human interface device (HID) communication to perform an operation corresponding to a touch applied to the second display 250, for example, transmission of a touch signal corresponding to the touch. Also, the first and second signal processors 181, 281 may support hot plug detect (HPD) communication between the controller 280 and the data converter 282 through the second USB communication.
Meanwhile, initialization of the second display 250 may be controlled by the controller 280 included in the second display 250.
As aforementioned, the mobile terminal according to the present disclosure may control information displayed on the display 250 provided in the case 200. That is, the operation of the second display 250 may be controlled by the mobile terminal 100. To this end, the case 200 to which the mobile terminal is coupled may be identified when the connection port of the mobile terminal and the connector provided in the case 200 are connected and a plurality of resistances are recognized. Therefore, since there is no need to provide a separate chip for communication between the mobile terminal and the case 200 in the present disclosure, the case 200 is compatible with various models of mobile terminals, cost can be saved, and a thickness of the case 200 can be thinner.
Hereinafter, a control method between the mobile terminal and the display provided in the case will be described in more detail with reference to the accompanying drawings, based on the above descriptions.
As described above, in an electronic device 300 according to the present disclosure, when the mobile terminal 100 is coupled to the case 200, the mobile terminal 100 can sense a resistance corresponding to the second display 250 (510).
Specifically, when the connection port of the mobile terminal 100 is connected to the connector provided on one side of the case 200, the mobile terminal 100 may recognize a plurality of resistances provided with the connector to determine whether to supply an operating current to the second display 250.
When the plurality of resistances is recognized, an operating current is supplied from the mobile terminal 100 to the second display 250 through the connector, and the second display 250 can maintain an operation in the inactive state (520).
Specifically, when the plurality of resistances is recognized, the mobile terminal 100 operates in a host mode to supply the operating current to the connector in a downstream manner. That is, the connection port of the mobile terminal 100 is switched to be a downstream facing port (DFP) to supply an operating current to the contact pin. For example, an operating current is supplied in a form of Vconn power through the CC1 pin among the contact pins of the connector.
In this case, the second display 250 on the case 200 side operates in a device mode to receive the operating current in an upstream manner. That is, the connector of the case 200 is operated as an upstream facing port (UFP).
As described above, the operating current supplied through the CC1 pin of the connector is supplied to the circuit board 244 or the likes of the second display 250 through the wiring portion 242 coupled to the first and second flexible printed circuit boards 247, 248 as described above. In addition, an operating current is also supplied to the power supply unit 291 of the second display 250.
Meanwhile, as described above, the electronic device 300 may be either in an open state and a closed state, and when a transition from the closed state to the open state is detected, the first display 151 provided in the mobile terminal may maintain the operation in the active state (530). At this time, the transition from the closed state to the open state may be detected by recognizing a sensing value of the illuminance sensor provided on the front side of the mobile terminal 100, for example.
Alternatively, even when the connection port of the mobile terminal 100 is connected to the connector provided on one side of the case 200, and an input is applied to the first display 151 or the user input unit 123 in a state where the electronic device 300 is in the open state, the first display 151 may maintain the operation in the active state.
As described above, when a predetermined touch input is applied to the first display 151 while the second display 250 is maintained in the inactive state, the mobile terminal detects such a touch (540) and determines a touch signal corresponding to the detected touch (550).
When the touch signal is for switching the second display 250 into active state as a result of the determination, the controller of the mobile terminal may output a control signal for switching the second display 250 into the active state (560).
As another example, when a transition of the electronic device 300 from the closed state to the open state is detected and accordingly the first display 151 provided in the mobile terminal is operated in active state, the second display 250 may be operated in a state switched from inactive state to active state after a predetermined time (e.g., 0.5 second to 1 second) has elapsed. That is, a screen of the second display 250 may be turned on. after a predetermined time has elapsed after a screen of the first display 151 was turned on.
In this case, the above-described steps 540 and 550 are omitted, a step of detecting whether the electronic device 300 is switched from the closed state to the open state may be added before performing the step of operating the first display 151 in active state (530).
Meanwhile, as another example, although not illustrated, when a preset touch input is applied to the second display 250 while the second display 250 is operating in inactive state, a control signal to switch the second display 250 to active state may be transmitted from the mobile terminal 100.
In this case, signal processing corresponding to the touch signal sensed by the second display 250 may be performed by the first and second signal processors 181, 281 as described above.
Specifically, the mobile terminal 100 performs wired communication in an initial state by using the first USB communication, then when the mobile terminal 100 is connected to the connector of the case 200 and recognizes the plurality of resistances Ra, Rd corresponding to the second display 250, the mobile terminal 100 controls the operation corresponding to the touch by using the second USB communication connected only with the B side contact pins (e.g., B6 and B7).
Even when the second display 250 is deactivated, the touch sensor (or touch panel 252) provided in the second display 250 is operated in active state to sense a touch applied to the second display 250.
The sensed touch may be I2C converted through the first and second signal processors 181, 281. In addition, the sensed touch is transferred from the second display 250 to the mobile terminal 100 via the circuit board 244 provided on the second body of the case, the wiring portion 242 coupled with the first and second flexible printed circuit boards 247, 248, and the connector, that is, the second wired communication unit 243.
Then, the mobile terminal 100 determines the touch signal transmitted from the second display 250 as described above, and determines whether the touch signal corresponds to a preset touch input. Here, the preset touch input may refer to, for example, applying a plurality of tabs on the second display 250 in inactive state.
When the touch signal is determined to correspond to the preset touch input, the mobile terminal 100 may perform the process of step 560 described above. That is, a control signal to switch the second display 250 to active state is output by the controller of the mobile terminal 100 and may be transmitted to the second display 250.
Thereafter, the mobile terminal 100 may transmit an image signal corresponding to a screen to be displayed on the second display 250 via USB communication (570).
To this end, the first and second wired communication units 161, 243 transmit, for example, the DP type image signal through a USB SS PHY pin. Specifically, the DP type image signal passes through the wiring portion 242 coupled with the first and second flexible printed circuit boards 247, 248 after passing through the first wired communication unit 161 and the second wired communication unit 243 interconnected to each other, is converted to MIPI format by the data converter 282 of the second display 250, and is transferred to the second display 250.
Next, the second display 250 may display a screen corresponding to the received signal, that is, an image signal converted to MIPI format (580). Here, a type of the screen displayed on the second display 250 is not particularly limited. For example, it may be a home screen page different from a home screen page displayed on the first display 151 or an execution screen of a preset application.
Hereinafter, a flow process of an operation according to the present disclosure as described above will be described in detail with reference to
Firstly,
When the connection port of the mobile terminal is connected to the connector of the case to sense a plurality of resistances corresponding to the second display 250, an operating current is supplied to the second display 250 and the circuit board 244 of the case through the first wired communication unit 161, the second wired communication unit 243, and the wiring portion 242.
First screen information may be displayed on the activated first display 151. Here, a type of the first screen information is not limited. For example, the first screen information may be a first home screen page 601 as illustrated in
With respect to the first home screen page 601 being displayed on the first display 151 in active state, a main home stack 610 for the first display 151 may be allocated in a memory 600 of the mobile terminal 100, as illustrated in (a) of
Here, the stacking may be one of structures that stacks (PoP) data. A structure of stacking data may be of a stack type and a queue type. The stack has a data structure of first-in last-out, and the queue has a data structure of first-in first-out.
In the present disclosure, stacks for the first display 151 and the second display 250 are separately allocated and removed depending on whether they are activated.
In the open state, the second display 250 in inactive state may be switched to active state when a predetermined time has elapsed after the first display 151 is operated in active state as illustrated in (a) of
First, referring to (a) of
In addition, the image signal corresponding to the screen to be displayed on the second display 250 is also transmitted to the circuit board 244 coupled with the second display 250 via the first and second wired communication units 161, 243, and the wiring portion 242, together with the control signal or sequentially after the transmission of the control signal. Here, the image signal is transmitted in DP format, converted into MIPI format that can be displayed on the second display 250 by the data converter 282, and provided to the second display 250.
Meanwhile, a condition of the open state for operating the first display 151 in active state and a condition of the open state for operating the second display 250 in active state may be different. For example, the open state in which the second display 250 is operated in active state may be limited to a state in which an angle between the first and second bodies 210, 220 is greater than that in the case of the first display 151.
For example, the first display 151 may be switched to active state when the electronic device 300 is detected to be in open state, and the second display 250 may be switched to active state when rear surfaces of the first and second bodies 210, 220 are relatively rotated to be closer to each other after the first display 151 is switched to active state.
Here, in the open state, the angle between the first display 151 and the second display 250 to switch the second display 250 to active state may be preset or changed by a user.
In addition, a setting of whether to switch the second display 250 to active state sequentially after the first display 151 is switched to active state may be on/off based on user input.
Next, referring to (b) of
At this time, since the control signal is a signal related to the touch, the control signal is transmitted to the mobile terminal 100 through the first and second signal processors 181, 281 using USB HID communication.
Meanwhile, referring to
To this end, a control signal corresponding to the touch signal of the preset touch input and to switch the second display 250 into inactive state is transmitted from the mobile terminal to the display 250 using USB communication. Accordingly, the second display 250 is switched back to the inactive state, and the transmission of the image signal from the mobile terminal is stopped.
Meanwhile, as another example, when a preset touch input (e.g., double tap) is applied to the second display while an operating current is supplied to the second display 250, a touch signal corresponding to the preset touch input is transmitted to the mobile terminal 100 via the circuit board 244 connected to the touch panel, the wiring portion 242 coupled with the first and second flexible printed circuit boards 247, 248, and the first and second signal processors 181, 281 using USB HID communication.
Then, the controller 180 of the mobile terminal 100 transmits a control signal to activate the second display 250 to the circuit board coupled with the second screen 251 and the second display 250 via the connector connected with the connection port of the mobile terminal, based on the transmitted touch signal. At this time, since the control signal is a signal related to the touch, the control signal is transmitted to the mobile terminal 100 through the first and second signal processors 181, 281 using USB HID communication.
Here, the signal related to the touch is initially transmitted and received through USB 2.0 communication (hereinafter, referred to as ‘first USB communication’), then transmitted and received through the switched USB HID communication (hereinafter, referred to as ‘second USB communication’) when the mobile terminal 100 is operated in the host mode (i.e., when resistances Ra, Rd are sensed).
In addition, the control signal is transmitted to the second display 250 through the first wired communication unit 161, the second wired communication unit 243, and the wiring unit 240 in AUX format. The control signal in the AUX format is transmitted to the second display 250 via the second data converter 282.
As described above, when the second display 250 is switched to active state, second screen information, for example, a second home screen page may be displayed on the second display 250.
To this end, the image signal corresponding to the screen to be displayed on the second display 250 is transmitted to the circuit board 244 coupled with the second display 250 via the first and second wired communication units 161, 243, and the wiring portion 242. Here, the image signal is transmitted in DP format, converted into MIPI format that can be displayed on the second display 250 by the data converter 282, and provided to the second display 250.
Meanwhile, a control signal to switch the second display 250 to active state and the image signal corresponding to the screen to be displayed on the second display 250 are transmitted through different contact pins in the first and second wired communication units 161, 243.
With respect to the first home screen page 601 being displayed on the active first display 151, referring to (b) of
At this time, tasks related to the DP type image signal transmitted to the circuit board 244 coupled with the second display 250 via the first wired communication unit 161, the second wired communication unit 243, and the wiring portion 242 is stacked on the sub home stack 620.
The main home stack 610 and the sub home stack 620 are independently controlled, and when a task corresponding to a specific application is executed on the second display 250, a sub-app stack 630 is additionally allocated to the memory and the task corresponding to the specific application is stacked as illustrated in (c) of
The controller 180 of the mobile terminal may transmit the DP type image signal corresponding to the task stacked on the sub-app stack 630 to the second display 250 via the circuit board 244 coupled with the second display 250 via the first wired communication unit 161, the second wired communication unit 243, and the wiring portion 242.
Here, the image signal in the DP format is converted into MIPI format by the second data converter 282 so that it can be displayed on the second display 250, and then transmitted to the second display 250. Accordingly, screen information corresponding to the task stacked on the sub-app stack 630 is displayed on the second display 250.
As described above, in the electronic device 300 according to the present disclosure, a control signal transmitted to the circuit board connected to the second display 250 and an image signal corresponding to screen information to be displayed on the second display 250 are transmitted through different contact pins.
Meanwhile, as illustrated in
Meanwhile, although not illustrated, when the connection port of the mobile terminal and the connector of the case are disconnected so that the wired communication path of the first and second wired communication units 161, 243 is released while the second display 250 is activated, supply of operation current is cut off, and the second display 250 is switched to inactive state.
Here, when the connection port of the mobile terminal and the connector of the case are connected again, the second display 250 is switched back to active state, and the screen information displayed on the second display 250 before the connection is cut off may be output again.
In the above, for convenience of explanation, it has been described that the sizes of the first display 151 and the second display 250 are the same, but the embodiment is not limited thereto.
In the electronic device 300 according to the present disclosure, an application (e.g., a photo application, etc.) installed in the mobile terminal may be executed. In this case, an application screen (e.g., a photo to be displayed) may be displayed by integrating the first display 151 and the second display 250 as a single display.
Hereinafter, with reference to
As described above, a predetermined application is executed in response to a touch of the first display 151 and/or the second display 250. Referring to
In step S10, the controller 180 determines whether the application is an application supporting display extension. When the application is an application supporting display extension, the controller 180 may display an integration dot D on the application screen.
Specifically, referring to
In this case, a second picture p2, which is a photo different from the first photo, may be displayed on the second display 250, but the embodiment is not limited thereto, and a screen different from the first photo, such as an application executed before the picture viewer application is executed, may be displayed.
The user may touch the integration dot D to enter an integrated display mode. Such a touch may be a swipe or a touch and drag in a direction of the second display 250, but the embodiment is not limited thereto.
In step S20, the controller 180 calculates a size of the integrated display 310 to define the integrated display 310 (see
For example, when the screen resolutions of the first display 151 and the second display 250 are different from each other, the size of the integrated display 310 is calculated based on a display having a lower resolution between the two displays.
Hereinafter, it is assumed that a resolution of the first display 151 is lower than that of the second display 250.
Specifically, the controller 180 adds a width of the first display 151 to a width of the second display 250 to calculate a width of the integrated display 310.
The controller 180 may calculate the width of the integrated display 310 using Equation 1 below.
Width=Display 1 width+Display 2 width [Equation 1]
Here, “Display 1 width” is a width of the first display 151 included in specifications unique to the first display 151, and “Display 2 width” is a width of the second display 250 included in specific specifications unique to the second display 250.
Furthermore, the controller 180 calculates a smaller one between the width of the first display 151 and the width of the second display 250 as a height of the integrated display 310.
The controller 180 may calculate the height of the integrated display 310 using Equation 2 below.
height=min(Display 1 width, Display 2 width) [Equation 2]
In step S30, the controller 180 may send a size of the integrated display 310 to the application being executed. The application changes a display layout (hereinafter, referred to as a layout) of the application to correspond to the size of the integrated display 310.
The application includes a plurality of layouts corresponding to a plurality of resolutions, and the application may determine a layout according to a resolution corresponding to the size of the integrated display 310, but the embodiment is not limited thereto.
In step S40, the controller 180 changes a size of the first display 151 according to the calculated size of the integrated display 310.
In step S50, the controller 180 changes a size of the second display 250 based on the size of the first display 151. That is, a hardware setting value of the second display 250 is changed to be the same as that of the first display 151.
Specifically, the controller 180 changes a flag of the second display 250 to be the same as that of the first display 151. The flag denotes a setting value unique to the display such as resolution, but the embodiment is not limited thereto.
In step S60, the controller 180 overlaps the first photo to display the overlapped first photo according to the size of the integrated display 310.
In the present specification, overlapping denotes causing the controller 180 to divide the application screen, set part of the separately displayed screen as an overlapping area, and display the overlapping area on both the first display 151 and the second display 250. Hereinafter, overlapping will be described in detail.
Referring to
Specifically, the controller 180 may divide the first photo p1 into two sub-photos based on a predetermined dividing line DL. The controller 180 may set an area of the first photo p1 corresponding to a reference number of pixels (e.g., 5 pixels) from the dividing line DL in a first direction (e.g., left in
The controller 180 may divide the first photo p1 into a first sub-photo p11 and a second sub-photo p12 such that the overlapping area Ov is included in a first sub-photo p11 and a second sub-photo p11.
That is, the controller 180 sets part of the first sub-photo p11 as the overlapping area Ov. The controller 180 generates the first sub-photo p11 and the second sub-photo p12 such that the overlapping area Ov is included in both the first sub-photo p11 and the second sub-photo p12.
Accordingly, a text or photo clipping phenomenon occurring due to the connection portion 230 may be minimized by the overlapping area Ov.
In the above, for convenience of explanation, it has been described that the controller 180 sets the overlapping area Ov by using part of the first sub-photo p11, but the embodiment is not limited thereto. That is, the controller 180 may set an area of the first photo p1 corresponding to the reference number of pixels from the dividing line DL in a second direction (e.g., right in
That is, the controller 180 sets part of the second sub-photo p12 as the overlapping area Ov. The controller 180 generates the first sub-photo p11 and the second sub-photo p12 such that the overlapping area Ov is included in both the first sub-photo p11 and the second sub-photo p12.
In addition, although it has been described that the dividing line DL accurately bisects the first photo p1 so that the sizes of the first sub-photo p11 and the second sub-photo p12 are the same, the embodiment is not limited thereto, and the controller 180 may set the dividing line DL such that the sizes of the first sub-photo p11 and the second sub-photo p12 are different from each other.
The controller 180 controls the first display 151 such that the first photo p1 is displayed on the integrated display 310 and the integration dot D is displayed on the first display 151.
The user may touch the integration dot D to end the integrated display mode. Such a touch may be a swipe or a touch and drag in a direction of the second display 250, but the embodiment is not limited thereto.
Furthermore, although it has been described that the resolutions of the first display 151 and the second display 250 are the same, the embodiment is not limited thereto, and the resolutions of the first display 151 and the second display 250 may be different from each other.
In addition, although it has been described that the electronic device 300 includes two displays 151, 250, the embodiment is not limited thereto, and the electronic device 300 may include three or more displays.
Hereinafter, a method of causing the controller 180 to generate the integrated display 310 in a landscape mode and a portrait mode according to an embodiment will be described in detail with reference to
As described with reference to
Furthermore, the landscape and portrait modes may be switched to each other according to the rotation of the electronic device 300, but the embodiment is not limited thereto.
There is a difference between
Hereinafter, in
Referring to
That is, the controller 180 may perform transverse overlapping on the web browser screen, and then display the overlapping area Ov on each of the first sub-screen w11 and the second sub-screen w12.
Referring to
The controller 180 may perform longitudinal overlapping on the web browser screen, and then display the overlapping area Ov on each of the first sub-screen w11 and the second sub-screen w12.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/KR2019/011127 | 8/30/2019 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2021/040098 | 3/4/2021 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20050093868 | Hinckley | May 2005 | A1 |
| 20110134489 | Suzuki | Jun 2011 | A1 |
| 20140359435 | Zheng | Dec 2014 | A1 |
| 20190018637 | Cheon | Jan 2019 | A1 |
| 20190324500 | Gocho | Oct 2019 | A1 |
| 20200264826 | Kwon | Aug 2020 | A1 |
| 20200409517 | Nakanishi | Dec 2020 | A1 |
| 20220156516 | Jin | May 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 2011-118779 | Jun 2011 | JP |
| 5784191 | Sep 2015 | JP |
| 10-2010-0039759 | Apr 2010 | KR |
| 10-2013-0046846 | May 2013 | KR |
| 10-2015-0087980 | Jul 2015 | KR |
| 10-2016-0023471 | Mar 2016 | KR |
| 10-2017-0081489 | Jul 2017 | KR |
| Number | Date | Country | |
|---|---|---|---|
| 20220321692 A1 | Oct 2022 | US |
