Patent Application
20140002389
Pursuant to 35 U.S.C. §119(a), this application claims the benefit of earlier filing date and right of priority to Korean Patent Applications No. 10-2012-0070773, filed on 29 Jun., 2012, No. 10-2012-0076796, filed on 13 Jul., 2012, the contents of which are incorporated by reference herein in their entirety.
The present invention relates to an electronic device and a method of controlling the same.
With remarkable development of hardware and software technologies related to various electronic devices including mobile terminals, the mobile terminals can provide or store a variety of functions and information. These various functions and information are provided in the form of an application in general.
As services provided by the mobile terminals are diversified, researches on convenient use of a user interface of a mobile terminal are carried out. Particularly, various services make a user interface structure complicated, and thus methods by which a desired item of a user can be directly selected are needed.
As mobile terminals evolve into smart devices, technical standards by which users easily share and execute a link service between devices are established.
DLNA is a standard by which a user can easily perform linkage between devices in a home network and is applied to a smart TV, a smart-phone, a tablet PC, a notebook PC, an audio system etc. as an essential element.
Accordingly, it is necessary to provide a seamless service capable of using user experience among various smart screens according to development of smart devices and content infrastructures.
An object of the present invention is to provide an electronic device and a method of controlling the same to easily identify a capture request device, a capture image and a device that stores the capture image when screens of an electronic device and an external electronic device are simultaneously captured in an environment in which the electronic device and the external electronic device share the screens.
An object of the present invention is to provided a mobile terminal and a method of controlling the same to easily link a capture image of a screen of an external device to an item executed in the mobile terminal according to a simple operation of the mobile terminal in an environment in which the mobile terminal and the external device share the screens thereof.
According to an aspect of the present invention, an electronic device includes: a memory; a display unit; a communication unit configured to communicate with one or more external electronic devices; and a controller configured to share screens with the external electronic devices through the communication unit, to capture a screen displayed on the display unit when a screen capture signal instructing the screen displayed on the display unit to be captured is received, and to store the capture image in the memory and at least one of the external electronic devices.
Thee controller may display related images respectively corresponding to the screens of the external electronic devices, and the capture image may include the related images.
The related images may respectively include images respectively mirroring the screens of the external electronic devices.
The controller may receive the screen capture signal from one of the external electronic devices through the communication unit.
When animation of moving the capture image to a predetermined area of the display unit is displayed, the controller may control the capture image to be stored in the electronic device or a device corresponding to the area to which the capture image is moved from among the external electronic devices.
The predetermined area may include at least one of a first area in which at least one of the mirror images is displayed, a second area in which at least one of a graphical object corresponding to the electronic device and graphical objects corresponding to the external electronic devices is displayed, and a third area other than the first and second areas on the screen.
The animation may include a motion of scaling down the capture image to an icon having a predetermined size and moving the icon to the predetermined area.
When the screen capture signal is received while a video is played on the display unit, the controller may scale down the capture image to an icon having a predetermined size and display the icon on a screen of an external device that transmits the screen capture signal.
The predetermined area may be a graphical object corresponding to the electronic device or at least one of the external electronic devices, and the controller may display a graphical object that animates the capture image for a predetermined time.
When an input predetermined for the graphical object is received, a preview image with respect to the capture image may be displayed on the display unit.
When a plurality of capture images is present, the capture images may be displayed on the display unit.
When an input predetermined for the graphical object is received, the controller may display a menu window for sharing the capture image on the display unit.
The display unit may include a touch screen and, when a drag input for moving the graphical object to one of the mirror images is applied to the touch screen, the controller may control the capture image to be shared with an external electronic device corresponding to the dragged mirror image.
According to another aspect of the present invention, an electronic device displaying a related image corresponding to a screen of an external electronic device on a display unit includes: a communication unit configured to communicate with the external electronic device; and a controller configured to capture a screen displayed on the display unit when a screen capture signal is received from the external electronic device while the electronic device and the external electronic device share screens thereof through the communication unit, and to transmit the capture image to the external electronic device corresponding to the related image when animation of moving the capture image to the related image is displayed.
According to an other aspect of the present invention, an electronic device displaying a related image corresponding to a screen of at least one external electronic device on a display unit includes: a communication unit configured to communicate with the at least one external electronic device; and a controller configured to capture a screen displayed on the display unit when a screen capture signal is received from the at least one external electronic device while the electronic device and the external electronic device share screens thereof through the communication unit, and to transmit the capture image to an external electronic device corresponding to a predetermined graphical object when animation of moving the capture image to the graphical object displayed, wherein the graphical object is a graphical object corresponding to the at least one external electronic device or a graphical object corresponding to the electronic device.
According to an other aspect of the present invention, a method of controlling an electronic device includes: sharing screens with one or more external electronic devices through a communication unit; receiving a screen capture signal instructing a screen displayed on a display unit to be captured; and capturing the screen and storing the capture image in a memory and at least one of the external electronic devices.
According to an other aspect of the present invention, a method of controlling an electronic device includes: sharing screens with one or more external electronic devices; displaying related images respectively corresponding to the screens of the external electronic devices on a display unit; receiving a screen capture signal from one of the external electronic devices, capturing a screen displayed on the display unit; and storing the capture image in the electronic device and at least one of the external electronic devices.
According to another aspect of the present invention, a mobile terminal includes: a display unit for displaying a first item execution screen; a communication unit for communicating with an external electronic device that displays a second item execution screen; and a controller configured to associate a capture image of the second item execution screen with execution of the first item when a predetermined input is received while the mobile terminal is connected to the external electronic device through the communication unit.
The first item may include a messenger application, and the predetermined input may include an input for capturing a screen during execution of the messenger application.
The controller may receive a message input according to execution of the messenger application and automatically attach the capture image to the message input.
If the second item is content to which DRM (Digital Rights Management) is applied, the capture image may be source information about the second item.
The source information about the second item may include the title of the second item and capture time information.
The mobile terminal may further include a memory, and the controller may store the capture image in the memory when the capture image is associated with execution of the first item.
The second item may include at least one of a web browser, application and multimedia content.
According to another aspect of the present invention, a mobile terminal includes: a communication unit for communicating with an external electronic device; a display unit for displaying a messenger application execution screen when a messenger application is executed; and a controller configured to capture a screen of the external electronic device and automatically attach the capture image to a message input when a predetermined input is received while the mobile terminal is connected to the external electronic device through the communication unit.
According to another aspect of the present invention, a method of controlling a mobile terminal includes: displaying a first item execution screen on a display unit; receiving a predetermined input while the mobile terminal is connected to an external electronic device that displays a second item execution screen through a communication unit; and associating capture data corresponding to the second item execution screen with execution of the first item.
According to another aspect of the present invention, a mobile terminal includes: a memory; a communication unit; a display unit; and a controller configured to receive a message including content execution information from an external device through the communication unit, to execute corresponding content base on the content execution information when the content is stored in the memory, and to display a web page for searching for the content on the display unit when the content is not stored in the memory.
According to another aspect of the present invention, a system includes: a first external device that executes content and captures a content execution screen; a second external device that shares screens with the first external device through a network and receives capture data corresponding to the content execution screen from the first external device; and a mobile terminal that receives a message including content execution information from the second external device, executes the content based on the content execution information when the content is stored in a memory and accesses a web page for searching for the content when the content is not stored in the memory.
Details of other embodiments are illustrated in the following detailed description and drawings.
The accompanying drawings, which are included to provide a further understanding of described embodiments of the present invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the present invention and together with the description serve to explain aspects and features of the present invention.
The present invention will now be described more fully with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. The invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein; rather, there embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art.
Hereinafter, a mobile terminal relating to the present invention will be described below in more detail with reference to the accompanying drawings. In the following description, suffixes “module” and “unit” are given to components of the mobile terminal in consideration of only facilitation of description and do not have meanings or functions discriminated from each other.
The mobile terminal described in the specification can include a cellular phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), a portable multimedia player (PMP), a navigation system and so on.
Communication between the electronic device 100 and the external electronic devices 10 is not limited to a specific method. This invention may be applied to all existing wireless communication methods between electronic devices and all future communication methods.
For example, the electronic device 100 and the external electronic devices 10 can communicate with each other according to known communication methods, such as UPnP®, DLNA® and WiFi®. Furthermore, for example, the electronic device 100 and the external electronic devices 10 can communicate with each other via a short-range communication method.
As shown in
The electronic device 100 and the external electronic devices 10 may be fixed terminals or mobile terminals. For example, any of the electronic device 100 and the external electronic devices 10 can comprise a portable phone, a smart phone, a personal computer, a laptop computer, a terminal for digital broadcasting, a Personal Digital Assistants (PDA), a Portable Multimedia Player (PMP), a navigator, or a Mobile Internet Device (MID).
Referring to
Referring to
The wireless communication unit 110 includes one or more components that permit wireless communication between the mobile terminal 100 and a wireless communication system or a network within which the mobile terminal 100 is located. For example, the wireless communication unit 110 includes a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114 and a position-location module 115. For non-mobile terminals, the wireless communication unit 110 may be replaced with a wired communication unit. The wireless communication unit 110 and the wired communication unit may be commonly referred to as a communication unit.
The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast managing entity via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel.
The broadcast managing entity may refer to a system that transmits a broadcast signal and/or broadcast associated information. The broadcast managing entity may be a server that generates and transmits broadcast signals and/or broadcast associated information or a server for receiving previously generated broadcast signals and/or broadcast-related information and transmitting the broadcast signals and/or the broadcast associated information to the mobile terminal 100. The broadcast signals may include not only TV broadcast signals, radio broadcast signals, and data broadcast signals, but also signals in the form of a TV broadcast signal combined with a radio broadcast signal.
The broadcast associated information may be information about a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast associated information may even be provided over a mobile communication network. In the latter case, the broadcast associated information may be received via the mobile communication module 112. Examples of broadcast associated information include an electronic program guide (EPG) of digital multimedia broadcasting (DMB) and an electronic service guide (ESG) of digital video broadcast-handheld (DVB-H).
The broadcast receiving module 111 may receive broadcast signals transmitted from various types of broadcast systems. As a non-limiting example, the broadcast systems include digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcast-handheld (DVB-H), a data broadcasting system known as media forward link only (MediaFLO®) and integrated services digital broadcast-terrestrial (ISDB-T). The broadcast receiving module 111 may also receive multicast signals. The broadcast signals and/or the broadcast associated information received by the broadcast receiving module 111 may be stored in a suitable storage device, such as in the memory 160.
The mobile communication module 112 transmits/receives wireless signals to/from at least one of a base station, an external terminal or a server over a mobile communication network. The wireless signals may represent, for example, voice call signals, video telephony call signals or data in various forms according to the transmission/reception of text and/or multimedia messages.
The wireless Internet module 113 supports Internet access for the mobile terminal 100. This wireless Internet module 113 may be internally or externally coupled to the mobile terminal 100. Suitable technologies for wireless Internet include, but are not limited to, WLAN (Wireless LAN), Wi-Fi®, Wibro® (Wireless broadband), Wimax® (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access). The wireless Internet module 113 may be replaced with a wired Internet module in non-mobile terminals. The wireless Internet module 113 and the wired Internet module may be commonly referred to as an Internet module.
The short-range communication module 114 facilitates relatively short-range communications. Suitable technologies for short-range communication include, but are not limited to, radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB), as well as networking technologies such as Bluetooth® and ZigBee®.
The position-location module 115 identifies or otherwise obtains a location of the mobile terminal 100. The position-location module 115 may obtain position information by using a global navigation satellite system (GNSS). The GNSS is a term used to describe radio navigation satellite systems configured to send reference signals capable of determining their positions on the surface of the earth or near the surface of the earth while revolving around the earth. The GNSS includes: a global position system (GPS) operated by the U.S.A.; Galileo, operated by Europe; a global orbiting navigational satellite system (GLONASS) operated by Russia; COMPASS, operated by China; and a quasi-zenith satellite system (QZSS) operated by Japan.
As a typical example of the GNSS, the position-location module 115 is a GPS module. The position-location module 115 may calculate information related to distances between one point or object and at least three satellites and information related to the time when the distance information was measured and apply trigonometry to the obtained distance information to obtain three-dimensional position information on the point or object according to the latitude, longitude, and altitude at a predetermined time. Furthermore, a method of calculating position and time information using three satellites and correcting the calculated position and time information using another satellite may also used. The position-location module 115 continues to calculate a current position in real time and to calculate velocity information based on the position information.
With continued reference to
The image frames processed by the camera 121 may be stored in the memory 160 or transmitted to an external device through the wireless communication unit 110. Optionally, the mobile terminal 100 can include two or more cameras 121, if appropriate.
The microphone 122 receives an external audio signal while the mobile terminal 100 is in a particular mode, such as a phone call mode, a recording mode and/or a voice recognition mode. The received audio signal is processed and converted into digital data. In the call mode, the processed digital data is transformed into a format transmittable to a mobile communication base station via the mobile communication module 112 and then output. Furthermore, the mobile terminal 100, and in particular the A/V input unit 120, may include a noise removing algorithm to remove noise generated in the course of receiving the external audio signal.
The user input unit 130 generates input data in response to user manipulation of an associated input device or devices. Examples of such devices include a keypad, a dome switch, a touchpad (e.g., static pressure/capacitance), a jog wheel and a jog switch. A specific example of the user input unit 130 is a touch screen in which a touchpad is combined with a display, as will be described below.
The sensing unit 140 provides status measurements of various aspects of the mobile terminal 100. For example, the sensing unit 140 may detect an open/closed status of the mobile terminal 100, relative positioning of components (e.g., a display and a keypad) of the mobile terminal 100, a change of position of the mobile terminal 100 or a component of the mobile terminal 100, a presence or absence of user contact with the mobile terminal 100, an orientation of the mobile terminal 100 and/or acceleration/deceleration of the mobile terminal 100.
As an example, the mobile terminal 100 may be configured as a slide-type mobile terminal in which the sensing unit 140 may sense whether a sliding portion of the mobile terminal 100 is open or closed. The sensing unit 140 may also sense presence or absence of power provided by the power supply unit 190 or the presence or absence of a coupling or other connection between the interface unit 170 and an external device.
The output unit 150 generates output relevant to the senses of sight, hearing and touch. The output unit 150 may include a display unit 151, an audio output module 152, an alarm 153, and a haptic module 154.
The display unit 151 displays information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, the display unit 151 may display a user interface (UI) or a graphic user interface (GUI) associated with the call. If the mobile terminal 100 is in a video communication mode or a photograph mode, the display unit 151 may display a photographed and/or received picture, a UI or a GUI.
The display unit 151 may include a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, or a 3-dimensional display. The mobile terminal 100 may include one or more of such displays.
The display unit 151 may have a transparent or light-transmittive type configuration, hereinafter referred to as a transparent display. A transparent OLED (TOLED) is an example of a transparent display. A rear configuration of the display unit 151 may also have the light-transmittive type configuration. In this configuration, a user is able to see an object located behind the terminal body via the area occupied by the display unit 151 of the terminal body.
At least two display units 151 may be provided. For example, a plurality of display units 151 may be provided on a single face of the mobile terminal 100 spaced apart from each other or built in one body. Alternatively, each of a plurality of display units 151 may be provided on different faces of the mobile terminal 100.
If the display unit 151 and a sensor for detecting a touch action (hereafter referred to as a ‘touch sensor’) are constructed in a mutual-layered structure (hereafter referred to as a ‘touch screen’), the display unit 151 may be used as an input device and an output device. For example, the touch sensor may include a touch film, a touch sheet or a touchpad.
The touch sensor can be configured to convert a pressure applied to a specific portion of the display unit 151 or a variation of electrostatic capacity generated from a specific portion of the display unit 151 to an electric input signal. The touch sensor may detect a pressure of a touch as well as a touched position or magnitude of the touch.
If a touch input is made to the touch sensor, a signal(s) corresponding to the touch input is transferred to a touch controller (not shown). The touch controller processes the signal(s) and then transfers corresponding data to the controller 180. The controller 180 may determine, therefore, which portion of the display unit 151 is touched.
With continued reference to
The proximity sensor 141 can include a transmittive photoelectric sensor, a direct reflective photoelectric sensor, a mirror reflective photoelectric sensor, a radio frequency oscillation proximity sensor, an electrostatic capacity proximity sensor, a magnetic proximity sensor or an infrared proximity sensor. If the touch screen is an electrostatic type touch screen, the proximity sensor 141 may detect proximity of a pointer using a variation of an electric field according to the proximity of the pointer and the touch screen (touch sensor) may be classified as the proximity sensor 141.
An action in which a pointer approaches the touch screen without contacting the touch screen, yet is recognized as being located on the touch screen, is referred to as a ‘proximity touch’. An action in which the pointer actually touches the touch screen is referred to as a ‘contact touch’. The position on the touch screen proximity-touched by the pointer refers to the position of the pointer that vertically opposes the touch screen when the pointer performs the proximity touch.
The proximity sensor 141 may detect a proximity touch and/or a proximity touch pattern (e.g., proximity touch distance, proximity touch duration, proximity touch position, proximity touch shift state). Information corresponding to the detected proximity touch action and/or the detected proximity touch pattern may be displayed on the touch screen.
The controller 180 (
Referring again to
The alarm 153 outputs a signal for announcing an occurrence of a particular event associated with the mobile terminal 100. Typical events include a call signal reception, a message reception, a key signal input and a touch input. The alarm 153 outputs a signal for announcing the event occurrence via vibration as well as a video signal or an audio signal. The video signal is output via the display unit 151 and the audio signal is output via the audio output module 152. Hence, at least the display unit 151 or the audio output module 152 can be regarded as part of the alarm 153.
The haptic module 154 may generate various haptic effects that can be sensed by a user. Vibration is a representative tactile effect generated by the haptic module 154. Strength and pattern of the vibration generated from the haptic module 154 may be controllable. For example, vibrations differing from each other can be output by being synthesized together or can be output in sequence.
The haptic module 154 may generate various haptic effects in addition to vibration. For example, the haptic module 154 may generate an effect caused by a pin array vertically moving against skin being touched, an air injection force via an injection hole, an air suction force via a suction hole, an effect of skimming on a skin surface, an effect of contact with an electrode, an effect of electrostatic power and/or an effect of a hot/cold sense using an endothermic or exothermic device.
The haptic module 154 can be configured to provide the haptic effect via direct contact. The haptic module 154 can also be configured to enable a user to experience the haptic effect via muscular sense of a finger or an arm. Two or more haptic modules 154 can be provided according to a configuration of the mobile terminal 100.
The memory 160 is configured to store programs for operation of the controller 180. The memory 160 may temporarily store input/output data (e.g., phonebook, message, still picture, moving picture, etc.). The memory 160 may store data of vibration and sound in various patterns output when the touch screen receives a touch input.
The memory 160 may include, for example, a flash memory, a hard disk, a multimedia card micro type memory, a card type memory (e.g., SD memory, XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory(PROM), a magnetic memory, a magnetic disk or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 via the Internet.
The interface unit 170 couples the mobile terminal 100 with external devices. The interface unit 170 receives data from an external device. The interface unit 170 is supplied with power and may be configured to deliver the power to elements within the mobile terminal 100. The interface unit 170 may be configured to enable data to be transferred from the mobile terminal 100 to an external device. The interface unit 170 may be configured to include a wired/wireless headset port, an external charger port, a wire/wireless data port, a memory card port, a port for coupling to a device having an identity module, an audio input/output (I/O) port, a video input/output (I/O) port or an earphone port.
According to an embodiment of the present invention, the interface unit 170 can include an HDMI (High Definition Multimedia Interface) standard interface for video/audio input/output when the electronic device 100 and an external electronic device are physically connected to each other. Furthermore, the interface unit 170 can include a USB (Universal Serial Bus) standard interface as an interface for data input/output, instead of the HDMI standard interface.
In addition, according to an embodiment of the present invention, video and audio data of the electronic device 100 can be output through the external electronic device (mobile terminal 10c_1 or 10C-2 of
Furthermore, according to an embodiment of the present invention, an image of the external electronic device (mobile terminal 10c_1 or 10_2 of
The identity module is a chip or card that stores various types of information for authenticating a use authority of the mobile terminal 100 and can include a user identity module (UIM), a subscriber identity module (SIM) and/or a universal subscriber identity module (USIM). A device provided with the above identity module (hereafter referred to as an ‘identity device’) may be manufactured in the form of a smart card. The identity device is connectable to the mobile terminal 100 via a corresponding port.
The interface unit 170 may be configured as a passage for supplying power to the mobile terminal 100 from a cradle that is connected to the mobile terminal 100. The interface unit 170 may facilitate delivery of various command signals, which are input via the cradle by a user, to the mobile terminal 100. Various command signals input via the cradle or the power may work as a signal for recognizing that the mobile terminal 100 is correctly loaded in the cradle.
The controller 180 typically controls the overall operations of the mobile terminal 100. For example, the controller 180 performs control and processing associated with voice calls, data communications and video conferences. The controller 180 may include a multimedia module 181 that provides multimedia playback. The multimedia module 181 may be configured as part of the controller 180 or may be configured as a separate component. The controller 180 may also perform pattern recognizing processing for recognizing a handwriting input performed on the touch screen as a character and/or recognizing a picture drawing input performed on the touch screen as characters or images.
The power supply unit 190 provides power required by the various components for the mobile terminal 100. The power may be internal power, external power, or combinations thereof.
Embodiments of the present invention described in the following description may be implemented within a recording medium that can be read by a computer or a computer-like device using software, hardware or combinations thereof. For hardware implementations, arrangements and embodiments may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors or electrical units for performing other functions. Such embodiments may also be implemented by the controller 180.
For a software implementation, arrangements and embodiments described herein may be implemented with separate software modules, such as procedures and functions, each of which may perform one or more of the functions and operations described herein. Software codes may be implemented with a software application written in any suitable programming language and may be stored in the memory 160 and executed by the controller 180.
A method of controlling an electronic device according to an embodiment of the invention may be implemented in a plurality of electronic devices 100 and 10c.
Referring to
The electronic device 100 and the mobile terminal 10c may share the screens thereof while the electronic device 100 and the mobile terminal 10c execute a first item A (e.g. a web browser) and the mobile terminal 10c executes a second item B (e.g. video).
The electronic device 100 and the mobile terminal 10c may execute the same item in the N screen environment. For example, the electronic device 100 and the mobile terminal 10c can display different parts of the same video on their screens. Otherwise, the electronic device 100 may play a part of the video corresponding to a first play time and the mobile terminal 10c may play the video from next part of the video.
Referring to
For example, when the capture command is input to the electronic device 100, the screen of the electronic device 100 is captured, and the screen of the mobile terminal 10c may also be captured. The capture command may be applied to the electronic device 100 externally or internally.
Referring to
The mobile terminal 10c may display a capture image 12 of the screen of the electronic device 100, e.g. DTV 100, and a capture image 11 of the mobile terminal 10c on the display unit 151.
The controller 180 may display the first capture image 11 on a first area of the display unit 151 and display the second capture image 12 on a second area of the display unit 151. Display of the first area and the second area may be controlled such that the first and second areas share at least part thereof or a sharing area does not exist.
That is, the two capture images can be displayed on the screen of the mobile terminal 10c according to the dual capture operation.
The electronic device 100 according to an embodiment of the invention may share the screen thereof with at least one external electronic device 10 (S10).
Here, sharing a screen may include an operation of displaying content played on a screen of a first device through a screen of a second device connected to the first device over a network.
Furthermore, sharing a screen may include an operation of the first device to control display of the screen of the second device connected to the first device over the network. Here, the first device can control display of the screen of the second device by transmitting a control signal for controlling the screen of the second device to the second device through the network.
The electronic device 100 may receive a screen capture command (S20) and perform a screen capture operation (S30).
Referring to
Referring to
The screen capture command may include a control signal for controlling the electronic device 100 to directly capture the screen thereof at a predetermined time. In this case, the electronic device 100 may capture the screen thereof and control the first and second external electronic devices 10c_1 and 10c_2 to capture their screens by transmitting the screen capture command to the first and second external electronic devices 10c_1 and 10c_2.
Furthermore, the screen capture command input to the electronic device 100 may be a signal received from the first external electronic device 10c_1. In this case, the electronic device 100 may perform screen capture in response to the received screen capture command and transmit the screen capture command to the second external electronic device 10c_2. Accordingly, the screen of the second external electronic device 10c_2 can also be captured.
The electronic device 100, the first external electronic device 10c_1 and the second external electronic device 10c_2 may store captures images of the screens thereof in the respective devices.
When screen capture is performed in the electronic device 100, the electronic device 100 may control the memory 161 and at least one of the external electronic devices to store the capture image (S40).
The method of controlling an electronic device according to the present embodiment of the invention may be implemented in the electronic devices 100 and 10. The method of controlling an electronic device according to the present embodiment of the invention and operations of the electronic device 100 for implementing the method will now be described in detail on the basis of the electronic device 100 for convenience of description.
Referring to
The electronic device 100 may be a DTV receiver or a tablet PC and the at least one external electronic device may be a cellular phone.
Here, the wireless communication unit 110 of the electronic device 100 may share screens with external electronic devices 10c_1 and 10c_2 through predetermined data communication.
Accordingly, when the electronic device 100 and the external electronic devices 10c_1 and 10c-2 share the screens thereof through the predetermined data communication, related images M1 and M2 respectively corresponding to the screens of the external electronic devices 10c_1 and 10c_2 may be displayed on the display unit 151 of the electronic device 100 (S120).
Here, the related images M1 and M2 respectively corresponding to the screens of the external electronic devices 10c_1 and 10c_2 may include images obtained by mirroring the screens of the external electronic devices 10c_1 and 10c_2 and displayed on the screen of the electronic device 100.
It is assumed that the electronic device 100 is a DTV and the external electronic device 10c_1 is a mobile terminal. In an environment in which the DTV 100 and the mobile terminal 10c_1 share the screens thereof, while a mirror image of the screen of the mobile terminal 10c_1 may be displayed on the screen of the DTV 100, the image of the screen of the mobile terminal 10c_1, instead of the mirror image thereof, can be displayed on the screen of the DTV 100 according to embodiments of the present invention.
It is assumed that the related images M1 and M2 respectively corresponding to the screens of the external electronic devices 10c_1 and 1-c_2 are images (mirror images M1 and M2) mirrored and displayed on the screens of the external electronic devices 10c_1 and 10c_2 in the following description.
Accordingly, the electronic device 100 may display a current item execution screen S3 and the mirror images M1 and M2 corresponding to the screens of the external electronic devices 10c_1 and 10c_2 sharing the screens with the electronic device 100 on the display unit 151.
The electronic device 100 may receive a screen capture signal instructing the screen displayed on the display unit 151 to be captured (S130).
The screen capture signal may be a signal internally generated in the electronic device 100 or a signal received from one of the external electronic devices through the communication unit.
For example, if the electronic device 100 is a DTV, the screen capture signal may be input from a remote controller (not shown) for controlling the operation of the DTV 100.
Otherwise, the screen capture signal may be a control signal transmitted from the external electronic devices 10c_1 and 10c_2 sharing the screens with the DTV 100. In this case, the electronic device 100 may receive the screen capture signal from one of the external electronic devices 10c_1 and 10c_2 through the wireless communication unit 110.
The screen capture signal may be transmitted from the first external electronic device 10c_1. The first external electronic device 10c_1 may transmit the screen capture signal when a predetermined input is applied to the touch screen thereof. While it is assumed that the screen capture signal is transmitted from the first external electronic device 10c_1 in the following description, the present invention is not limited thereto and the screen capture signal can be internally generated in the electronic device 100.
The predetermined input may include a long-touch input to two arbitrary points on the touch screen of the first external electronic device 10c_1. Furthermore, the predetermined input may include an input according to a combination of a hard key provided to the body of the first external electronic device 10c_1 and a soft key executed through the touch screen.
The controller 180 of the electronic device 100 may capture the screen displayed on the display unit 151 in response to the screen capture signal (S140).
The screen displayed on the display unit 151 may include the current item execution screen S3 of the electronic device 100 and the mirror images M1 and M2 of the external electronic devices 10c_1 and 10c_2, as shown in
Accordingly, the capture image of the screen of the electronic device 100 can include the current item execution screen S3 and the mirror images M1 and M2 of the external electronic devices 10c_1 and 10c_2.
The controller 180 of the electronic device 100 may store the capture image in the electronic device 100 and at least one of the external electronic devices 10c_1 and 10c_2.
The controller 180 may store the capture image in the memory 160 of the electronic device 100. The controller 180 may transmit the capture image to at least one of the first and second external electronic devices 10c_1 and 10c_2.
Here, the controller 180 of the electronic device 100 may previously set a device in which the screen capture image will be stored, or the user may select the device in which the screen capture image will be stored while the screen capture image is displayed as a preview image.
A description will be given of a procedure of storing the capture image of the electronic device 100 in the electronic device 100 and/or at least one of the external electronic devices 10c_1 and 10c_2 according to embodiments of the present invention.
The electronic device and the method of controlling the same according to the above-described embodiments of the invention have the following advantages.
According to the present invention, in an environment in which the electronic device and an external electronic device share the screens thereof, if the screens of the electronic device and external electronic device are simultaneously captured, a capture request device, a capture image, and a device storing the capture image can be easily identified so as to improve user convenience in a multi-screen environment.
Furthermore, according to the present invention, a capture image of the screen of the external electronic device can be easily linked with an item executed on a mobile terminal according to a simple operation of the mobile terminal in an environment in which the mobile terminal and the external electronic device share the screens thereof.
The method of controlling an electronic device according to the first embodiment of the present invention may be implemented in the electronic devices 100 and 10. The method of controlling an electronic device according to the first embodiment of the present invention and operations of the electronic device 100 for implementing the method will now be described in detail on the basis of the electronic device 100 for convenience of description. The first embodiment of the invention may be based on the embodiments described above with reference to
Referring to
Referring to
In this state, the electronic device 100 may receive a screen capture command from a remote controller (not shown) for controlling the operation of the electronic device 100.
Otherwise, the electronic device 100 may be set such that it automatically performs a screen capture operation at a predetermined time. At the predetermined time, the electronic device 100 can automatically capture the screen without intervention of the external electronic devices 10c_1 and 10c_2 to generate a screen capture image 20.
Referring to
The controller 180 may control the screen capture image 20 to be stored in a device corresponding to the predetermined area to which the screen capture image 20 is moved.
Referring to
Here, the animation that shows moving of the capture image 20 to the predetermined area of the display unit 151 may include an animation effect that the capture image 20 gradually enters the predetermined area to finally disappear from the display unit 151.
The animation represents moving of the capture image 20 to a specific direction, and the display unit 151 of the electronic device 100 and the display unit of the first external electronic device 10c_1 and/or the display unit of the second external electronic device 10c_2 may share the capture image 20 according to the animation effect.
For example, referring to
The animation effect may correspond to a means for showing a procedure of transmitting the capture image (20 shown in
The animation effect may be implemented in a different manner. Referring to
As described above, as the animation effect is exerted on the capture image (20 shown in
As described above with reference to
Referring to
Referring to
Referring to
Referring to
Referring back to
The controller 180 may control the capture image to be stored in the external electronic devices corresponding to the mirror images (S221).
Referring to
That is, the controller 180 can produce an animation effect that the capture image 20 is absorbed into the first mirror image M1. Accordingly, the display position of the capture image 20 can be controlled such that the display area of the capture image 20 in the display unit 151 of the electronic device 100 is gradually reduced and the capture image 20 is finally located in the first mirror image M1, as shown in
Furthermore, the controller 180 may highlight the capture image 20 and, at the same time, generate an alarm sound for signaling movement of the capture image 20 to the first mirror image M1 through the audio output module (152 of
The controller 180 of the electronic device 100 may transmit a control signal for controlling the first external electronic device 10c_1 corresponding to the first mirror image M1 to generate a predetermined alarm sound to the first external electronic device 10c_1 as the capture image 20 is moved to the first mirror image M1.
The controller 180 of the electronic device 100 may transmit the capture image 20 to the first external electronic device 10c_1 corresponding to the first mirror image M1. The capture image 20 may be stored in the first external electronic device 10c_1.
Referring to
Referring back to
Accordingly, the controller 180 may store the capture image in a device corresponding to the graphical object (S231).
Here, the graphical object identifies each device through the display unit 151. When the electronic device 100 is a DTV, the graphical object may include a DTV icon. If the electronic device 100 is a cellular phone, the graphical object may include an icon having a cellular phone image.
Accordingly, when the capture image 20 is moved to a specific graphical object, the controller 180 can transmit the capture image 20 to a device corresponding to the specific graphical object.
Referring to
Referring to
Referring back to
In this case, the controller 180 may store the capture image 20 in the memory 160 of the electronic device (DTV) 100 (S241).
Referring to
Referring to
Referring to
Referring to
Then, animation of moving the capture image 20 to the graphical object G3, animation of moving the first mirror image M1 to the first graphical object G1 and animation of moving the second mirror image M2 to the second graphical object G2 may be displayed.
Accordingly, the capture image 20 may be stored in the electronic device 100 corresponding to the graphical object G3. The first mirror image M1 may be stored in the first external electronic device 10c_1 and the second mirror image M2 may be stored in the second external electronic device 10c_2.
Referring to
The size of the icon may correspond to the size of an application icon displayed on the screen of the mobile terminal.
The predetermined area of the display unit 151 may be an area other than the first mirror image region M1 and the second mirror image region M2.
Referring to
When the icon I is moved to the first mirror image region M1, the controller 180 may transmit the capture image corresponding to the icon I to the first external electronic device 10c_1 corresponding to the first mirror image region M1.
Referring to
As shown in
The method of controlling an electronic device according to the second embodiment of the present invention may be implemented in the electronic devices 100 and 10. The method of controlling an electronic device according to the second embodiment of the present invention and operations of the electronic device 100 for implementing the method will now be described in detail on the basis of the electronic device 100 for convenience of description. The second embodiment of the invention may be based on the embodiments described above with reference to
Referring to
When the screen capture command is received from the first external electronic device 10c while the video C1 is played, the electronic device 100 may transmit the capture image 20 to the first external electronic device 10c while continuously playing the video C1 on the display unit 151.
Accordingly, the first external electronic device 10c may exert a predetermined animation effect to the capture image 20 to represent that the capture image 20 is transmitted from the electronic device 100 and displayed. The animation effect may include animation showing the capture image 20 is scaled down while being moved from the direction of the electronic device 100 to the first external electronic device 10c on the screen of the first external electronic device 10c.
The method of controlling an electronic device according to the third embodiment of the present invention may be implemented in the electronic devices 100 and 10. The method of controlling an electronic device according to the third embodiment of the present invention and operations of the electronic device 100 for implementing the method will now be described in detail on the basis of the electronic device 100 for convenience of description. The third embodiment of the invention may be based on the embodiment described above with reference to
Referring to
When the capture image 20 overlaps with at least part of the graphical object G1, the capture image 20 may be associated with the graphical object G1.
Here, association of the capture image 20 with the graphical object G1 may mean that the capture image 20 can be controlled to be transmitted to the external electronic device corresponding to the graphical object G1 and stored in the external electronic device.
Referring to
The controller 180 may select the graphical object G1 associated with the capture image 20 (S330).
Then, the controller 180 may display a preview image of the capture image on the display unit (S340).
Referring to
Referring to
The method of controlling an electronic device according to the fourth embodiment of the present invention may be implemented in the electronic devices 100 and 10. The method of controlling an electronic device according to the fourth embodiment of the present invention and operations of the electronic device 100 for implementing the method will now be described in detail on the basis of the electronic device 100 for convenience of description. The fourth embodiment of the invention may be based on the method of controlling an electronic device according to the embodiment described above with reference to
Referring to
The controller 180 of the electronic device 100 may display animation of moving the capture image 20 a graphical object corresponding to the electronic device 100 or an external electronic device (S410). The controller 180 may display the graphical object associated with the capture image 20 on the display unit for a predetermined time (S420). The controller 180 may select the graphical object associated with the capture image (S430).
Then, the controller 180 may display a menu window for sharing the capture image on the display unit (S440).
Referring to
The sharing means may include menu items such as e-mail, a messenger, an SNS application, etc. When one of the menu items is selected, the capture image 20 may be transmitted to a corresponding counterpart device through sharing means corresponding to the selected menu item.
Referring to
Accordingly, the second external electronic device 10c_2 can display the capture image 20 shared with the electronic device 100 on the screen thereof.
According to the above-described embodiments of the present invention, a capture operation can be performed between devices sharing the screens thereof, a capture image can be stored in the devices and shared with other device.
In the embodiments of the invention, when the electronic device executes a capture command, screens of the electronic device and an external electronic device may blink to signal capture of the screens of the electronic device and the external electronic device. In addition to this visual effect, an effect sound may be generated when screen capture is performed to signal screen capture such that a user can easily recognize a captured screen from among the shared screens and a captured image.
In the embodiments of the present invention, animation displayed for the capture image is not limited to the above-described embodiments and can be modified and implemented in various manners.
The method of controlling a mobile terminal according to the present embodiment of the invention may be implemented in the electronic devices 100 and 10 shown in
Referring to
Here, the first item may include a messenger application.
The messenger application may include at least one of a short message service (SMS), multimedia messaging service (MMS), instant message (IM), and e-mail.
The messenger application execution screen may include a virtual keyboard region for inputting a message and a message display region for displaying an input message.
It is assumed that the mobile terminal 100 is connected to a DTV 10c through a predetermined network(for example, the predetermined network comprises N screen) such that the mobile terminal 100 and the DTV 10c share screens thereof.
The controller 180 of the mobile terminal 100 may receive an input predetermined for the mobile terminal 100 while being connected to an external electronic device that display a second item execution screen (S520).
The predetermined input may include an input for capturing the screen while the messenger application is executed.
For example, the input for capturing the screen may include an input of simultaneously receiving multi-touch inputs to two points on the touch screen 151.
The input for capturing the screen may include an input according to a combination of a hard key and a soft key of the mobile terminal 100.
The second item may include at least one of a web browser, application and multimedia content.
The mobile terminal 100 may associate a capture image of the second item execution screen with execution of the first item (S530).
The operation of associating the capture image with execution of the first item may be modified and implemented in various manners. For example, an operation of associating a screen capture image of the DTV 10c with execution of the first item may depend on the type of the first item executed in the mobile terminal 100.
A description will be given of an operation of associating a capture image with execution of a messenger application after dual capture when the first item executed in the mobile terminal 100 is the messenger application.
Referring to
The mobile terminal 100 may execute the messenger application and display a messenger application execution screen on the touch screen 151 (S620).
When the mobile terminal 100 receives a predetermined input while a message is input to the mobile terminal 100 (S630), the controller 180 may capture the screen of the external electronic device 10c and automatically attach the capture image to a message input window (S650).
When an input of transmitting the message is received on the messenger application, the screen capture image of the external electronic device 10c may be attached to the message and transmitted.
Referring to
The DTV 10c that shares the screens with the mobile terminal 100 may execute a web browser application and display a predetermined web site on the screen thereof.
When the mobile terminal 100 simultaneously receives multi-touch inputs to two arbitrary points on the touch screen 151 while transmitting/receiving a message, the controller 180 may transmit a control signal for controlling the DTV 10c to perform a screen capture operation to the DTV 10c through the communication unit 110.
Referring to
The mobile terminal 100 may automatically attach the capture image CI to the message to be transmitted and display the capture image on a message execution screen.
Accordingly, the mobile terminal 100 can receive a screen capture image from an external electronic device sharing the screens with the mobile terminal 100 and apply the screen capture image to execution of the messenger application. Specifically, to transmit an image of the screen of the DTV 10c to a receiving part while executing the messenger application, the mobile terminal 100 should end the messenger application or execute a camera application in a multi-tasking manner and then additionally capture the screen of the DTV 10c. Then, the mobile terminal 100 should attach the capture image to the input window of the messenger application.
However, according to the mobile terminal according to the present embodiment of the invention, the mobile terminal 100 can easily capture the screen of the other electronic device that shares the screens with the mobile terminal 100 while executing a predetermined application and associate the capture image with execution of the predetermined application so as to use the image of the screen of the device sharing the screens with the mobile terminal 100 more conveniently.
Referring to
Referring to
The mobile terminal 100 may display the messenger application execution screen MA on the touch screen 151 and the DTV 10c may play content C2 to which DRAM is applied on the screen thereof.
Upon reception of a predetermined input, the mobile terminal 100 may transmit the control signal for controlling the DTV 10c to perform screen capture to the DTV 10c and receive a screen capture image from the DTV 10c.
Referring to
The source information may include URL 43 for acquiring the content C2. The source information may further include the title 41 of the content C2 and capture time 42 when screen capture is performed.
The controller 180 of the mobile terminal 100 may attach the source information about the content C2 to a message input window and transmit the source information with a message to a receiving part.
According to the method of controlling the mobile terminal according to the present embodiment of the invention, the source information about the content C2 can be received and then transmitted to a second mobile terminal. The operation of the second mobile terminal will now be described with reference to
In the following description, the source information about the content C2 is referred to as execution information of the content C2.
Referring to
Here, the external device may include a first external device 100 and a second external device 12. The first external device 11 and the second external device 12 may perform the procedures described in the above embodiments.
For example, the first external device 11 may execute DRM content (S11).
A predetermined network is established such that the first external device 11 and the second external device 12 can share the screens thereof. For example, the first external device 11 and the second external device 12 can share the screens thereof through a DLNA network.
Upon reception of a screen capture command from the second external device (S12), the first external device 11 may capture a content execution screen (S13).
The first external device 11 may capture the screen thereof irrespective of the screen capture command from the second external device 12.
The second external device 12 may receive capture data from the first external device 11 (S14).
Here, the capture data may include at least one of a capture image of the content execution screen, capture time information, the URL of the content, the address of a web page in which the content can be searched, and the title of the content.
The second external device 12 may transmit the received capture data in the form of a message to the second mobile terminal 200 (S15).
The second mobile terminal 200 may receive a message including content execution information from the second external device 12 (S710).
Here, the message including the content execution information may include at least one of a capture image of the content execution screen, capture time information, the URL of the content, the address of a web page in which the content can be searched, and the title of the content.
When the content is DRM content, the content execution information may include at least one of the information other than the capture image of the content execution screen.
The second mobile terminal 200 may determine whether the content is stored in the memory thereof in association with the content execution information included in the received message (S720).
When the second mobile terminal 200 stores the content (S720: YES), the second mobile terminal 200 may execute the content on the basis of playback time information included in the content execution information (S740).
For example, if the content is a video, the second mobile terminal 200 can play the video from the content playback time on the basis of the content playback time information.
If the second mobile terminal 200 does not store the content (S720: NO), the second mobile terminal 200 may display the web page for searching for the content on the display unit (S730). Here, the message including the content execution information may include the address of the web page for searching for the content.
Referring to
For example, if the content C2 to which DRM is applied is stored in the second mobile terminal 200, the second mobile terminal 200 can play the content 2 from the capture time corresponding to the capture time information 42 included in the message.
If the content C2 is not stored in the second mobile terminal 200, the second mobile terminal 200 can access the content C2 using the URL 43 from among the content execution information included in the message.
The method for controlling of the mobile terminal according to embodiments of the present invention may be recorded in a computer-readable recording medium as a program to be executed in the computer and provided. Further, the method for controlling a mobile terminal according to embodiments of the present invention may be executed by software. When executed by software, the elements of the embodiments of the present invention are code segments executing a required operation. The program or the code segments may be stored in a processor-readable medium or may be transmitted by a data signal coupled with a carrier in a transmission medium or a communication network.
The computer-readable recording medium includes any kind of recording device storing data that can be read by a computer system. The computer-readable recording device includes a ROM, a RAM, a CD-ROM, a DVD?ROM, a DVD-RAM, a magnetic tape, a floppy disk, a hard disk, an optical data storage device, and the like. Also, codes which are distributed in computer devices connected by a network and can be read by a computer in a distributed manner are stored and executed in the computer-readable recording medium.
As the present invention may be embodied in several forms without departing from the characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be construed broadly within its scope as defined in the appended claims, and therefore all changes and modifications that fall within the metes and bounds of the claims, or equivalents of such metes and bounds are therefore intended to be embraced by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2012-0070773 | Jun 2012 | KR | national |
| 10-2012-0076796 | Jul 2012 | KR | national |
