This application is the National Stage filing under 35 U.S.C. 371 of International Application No. PCT/KR2014/011871, filed on Dec. 5, 2014, the contents of which are all hereby incorporated by reference herein in its entirety.
The present invention relates to a mobile device, a wearable device, and a method of providing an interface using the mobile device and the wearable device.
Wearable devices having a display of various shapes are developing. For example,
Hence, as shown on the top of
Meanwhile, as shown on the bottom of
Hence, it is necessary for the user of the wearable device 200 to edit the picture to make the picture fit the display unit 200 of the wearable device 200. Yet, since the wearable device 200 has the relatively small display unit 220, it is not easy to edit the picture. And, the user can edit the picture using an image editing program of a different device. In this case, it is necessary to consider a size, resolution, and a shape of the display unit 220 of the wearable device 200. Moreover, it is necessary to have a separate processor for transmitting an edited picture to the wearable device 200.
Therefore, it is necessary to have an interface capable of being easily used and processing an intuitive image.
An object of the present specification is to provide a mobile device capable of editing an image based on device information of a wearable device and an interaction method between the mobile device and the wearable device. In particular, the object of the present specification is to provide a more enhanced interface for editing and transmitting an image by providing an interface corresponding to a display unit of the wearable device.
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, according to one embodiment, a mobile device includes a display unit configured to display an image and receive a touch input, a communication unit configured to communicate with a wearable device, a detecting unit configured to detect a relative position of the wearable device for the mobile device, and a processor configured to control the display unit, the communication unit, and the detecting unit, the processor configured to display a first image on the display unit, the processor, if the wearable device is positioned in the vicinity of the mobile device, configured to receive device information of the wearable device from the wearable device using the communication unit, the processor configured to display an interface for editing the first image on the first image based on the received device information. In this case, the interface has a shape practically identical to a shape of a display of the wearable device and can be changed based on a change of a relative position of the wearable device for the mobile device.
To further achieve these and other advantages and in accordance with the purpose of the present invention, according to a different embodiment, a wearable device includes a display unit configured to display an image, a communication unit configured to communicate with a mobile device, and a processor configured to control the display unit and the communication unit, the processor, if the mobile device is positioned in the vicinity of the wearable device, configured to transmit device information of the wearable device to the mobile device using the communication unit, the processor configured to display an image received from the mobile device on the display unit. In this case, if the device information is transmitted, the mobile device provides an interface for editing the image displayed on the mobile device to a user and the interface has a shape practically identical to a shape of the display unit of the wearable device and can be changed based on a change of a relative position of the wearable device for the mobile device.
According to the present specification, a mobile device can provide a more intuitive image editing method.
According to the present specification, a mobile device can generate an image appropriate for a wearable device by providing an interface of a shape identical to a shape of a display unit of the wearable device.
According to the present specification, since an image editing interface is controlled based on an interaction between a mobile device and a wearable device, it is able to easily edit an image.
According to the present specification, since a wearable device controls an interface for editing an image based on a gesture, it is able to provide a more intuitive and enhanced image editing method.
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. While embodiments are concretely described with reference to the attached diagrams and the contents written on the diagrams, the present specification may be non-restricted or non-limited to the embodiments.
Although terminologies used in the present specification are selected from general terminologies used currently and widely in consideration of functions, they may be changed in accordance with intentions of technicians engaged in the corresponding fields, customs, advents of new technologies and the like. Occasionally, some terminologies may be arbitrarily selected by the applicant(s). In this case, the meanings of the arbitrarily selected terminologies shall be described in the corresponding part of the detailed description of the specification. Therefore, terminologies used in the present specification need to be construed based on the substantial meanings of the corresponding terminologies and the overall matters disclosed in the present specification rather than construed as simple names of the terminologies.
A mobile device 100 according to one embodiment of the present specification can include a display unit 120 configured to display an image and receive a touch input, a communication unit 130 configured to communicate with a wearable device 200, a detecting unit 140 configured to detect a relative position of the wearable device 200 for the mobile device 100, and a processor 110 configured to control the display unit 120, the communication unit 130, and the detecting unit 140.
The display unit 120 displays at least one image and can receive a touch input. The display unit 120 can include an LCD (liquid crystal display), a plasma display, or a display of a different type. And, the display unit 120 can include a touch sensor. In particular, the display unit 120 can include a touch sensitive display unit. The touch sensor can be positioned on the display unit 120 or in the inside of the display unit 120. The touch sensor can sense various touch inputs such as a contact touch input or a non-contact touch input including a sliding touch input, a multi touch input, a long-press touch input, a short-press touch input, a drag touch input, a hovering input, and a flicking touch input. Moreover, the touch sensor can sense a touch input inputted by various input tools such as a touch pen, a stylus pen, and the like. The touch sensor can forward a result of sensing a touch input to the processor 110.
The communication unit 130 communicates with the wearable device 200 and can receive device information of the wearable device 200 from the wearable device 200. The communication unit 130 can receive information from at least one external device. The communication unit 130 performs communication via a wired or wireless network using various protocols and can transmit/receive data. For example, the communication unit 130 can use WLAN (Wireless LAN), IEEE 802.11 based wireless LAN communication, Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), Bluetooth, NFC (Near Field Communication) standard, etc. to access a wireless network. And, the communication unit 130 can access the Internet via a wired/wireless network.
The detecting unit 140 can detect a relative position of the wearable device 200 for the mobile device 100. The detecting unit 140 can include at least one sensor for sensing a position of the wearable device 200. For example, the detecting unit 140 can include an image sensor and/or a proximity sensor. For example, the detecting unit 140 can detect a position of the wearable device 200 via image processing. In order to detect a position of the wearable device 200, the detecting unit 140 can include one or more image sensors and/or proximity sensors. The detecting unit 140 can detect a position of the wearable device 200 using a magnetic field and/or an electric field. For example, the detecting unit 140 can include one or more magnetic field sensors and/or electric field sensors located at a different position. The detecting unit 140 compares values measured by the electric field sensors and/or the magnetic field sensors located at a different position with each other to detect a position of the wearable device 200. The detecting unit 140 can include a touch sensor. The detecting unit 140 senses a touch input caused by the wearable device 200 to sense a position of the wearable device 200.
The detecting unit 140 can sense a position of the wearable device 200 by selectively combining the aforementioned sensing methods. For example, if a distance between the mobile device 100 and the wearable device 200 is equal to or greater than a predetermined distance, the detecting unit 140 senses a position of the wearable device 200 using an image sensor. If the distance between the mobile device 100 and the wearable device 200 is less than the predetermined distance, the detecting unit 140 can detect a position of the wearable device 200 using a magnetic field sensor, an electric field sensor, a proximity sensor and/or a touch sensor. The aforementioned sensors of the detecting unit 140 are an example only. It may use sensors of a different type to determine a relative position of the wearable device 200 for the mobile device 100.
If a side to which the display unit 120 of the mobile device 100 is deployed corresponds to the front side, the sensors of the detecting unit 140 can be deployed to the rear side of the mobile device 100. For example, the sensors of the detecting unit 140 can sense a position of the wearable device 200 at the rear side of the mobile device 100.
The detecting unit 140 can detect a position of the wearable device 200 together with the communication unit 130. For example, the detecting unit 140 can include 2 sensors respectively existing at opposite edges. In this case, the detecting unit 140 measures a distance between the wearable device 200 and the mobile device 100 using the communication unit 130 and determines a position of the wearable device 200 using the sensors of the detecting unit 140.
The mobile device 100 according to the present specification may not require an absolute position of the wearable device 200. In particular, the mobile device 100 according to the present specification may detect a relative position of the wearable device 200 only for the mobile device 100. Yet, the mobile device 100 can obtain the absolute position of the wearable device 200 using a GPS of the wearable device 200.
The processor can control the display unit 120, the communication unit 130, and the detecting unit 140. And, the processor 110 can control other configurations included in the mobile device 100. The processor 110 can execute various applications by processing data of the mobile device 100. The processor 110 can control the mobile device 100 and contents executed in the mobile device 100 based on a command
The wearable device 200 according to one embodiment of the present specification can include a display unit 220 configured to display at least one image, a communication unit 230 configured to communicate with the mobile device 100, and a processor 210 configured to control the display unit 220 and the communication unit 230.
The display unit 220 can displays at least one image. The display unit 220 can include an LCD (liquid crystal display), a plasma display, or a display of a different type. And, the display unit 220 can include a touch sensor. In particular, the display unit 220 can include a touch sensitive display unit. The touch sensor can be positioned on the display unit 220 or in the inside of the display unit 220. The touch sensor can sense various touch inputs such as a contact touch input or a non-contact touch input including a sliding touch input, a multi touch input, a long-press touch input, a short-press touch input, a drag touch input, a hovering input, and a flicking touch input. Moreover, the touch sensor can sense a touch input inputted by various input tools such as a touch pen, a stylus pen, and the like. The touch sensor can forward a result of sensing a touch input to the processor 210. For example, the display unit 220 may have a circle shape or a rectangular shape.
The communication unit 230 communicates with the mobile device 100 and can transmit device information of the wearable device 200 to the mobile device 100. The communication unit 230 can receive information from at least one external device. The communication unit 230 performs communication via a wired or wireless network using various protocols and can transmit/receive data. For example, the communication unit 230 can use WLAN (Wireless LAN), IEEE 802.11 based wireless LAN communication, Wibro (Wireless Broadband), Wimax (World Interoperability for Micorwave Access), HSDPA (High Speed Downlink Packet Access), Bluetooth, NFC (Near Field Communication) standard, etc. to access a wireless network. And, the communication unit 230 can access the Internet via a wired/wireless network.
The processor 210 can control the display unit 220 and the communication unit 130. And, the processor 110 can control other configurations included in the wearable device 200. The processor 210 can execute various applications by processing data of the wearable device 200. The processor 210 can control the wearable device 200 and contents executed in the wearable device 200 based on a command
The mobile device 100 and the wearable device 200 can further include configurations not depicted in
The aforementioned configurations can be selectively combined according to selection of a manufacturer, or a type of the mobile device 100 and/or the wearable device 200. The configurations can be connected with each other via a bus and can be respectively controlled by the processors 110/210.
Meanwhile, the configuration diagram of the mobile device 100 and the wearable device 200 shown in
Meanwhile, the mobile device and the wearable device according to the present specification can be controlled based on various inputs. For example, the mobile device 100 and/or the wearable device 200 can include a physical button and can receive an input from the physical button. And, the mobile device 100 and/or the wearable device 200 can include a voice receiving unit, perform voice recognition based on received voice, and can be controlled based on the voice recognition. Specifically, the voice recognition can be performed in a unit of a syllable, a word, or a sentence. The mobile device 100 and/or the wearable device 200 can be controlled by combining the recognized syllable, the word, or the sentence. The mobile device 100 and/or the wearable device 200 can perform image analysis using an image sensing unit and can be controlled based on an analyzed image. The mobile device 100 and/or the wearable device 200 can include a touch sensing unit and can be controlled based on a touch inputted on the touch sensing unit. Moreover, the mobile device 100 and/or the wearable device 200 can be controlled based on a combination of the aforementioned inputs.
And, operations of the mobile device 100 and the wearable device 200 described in the following can be performed by the mobile device 100 and/or the wearable device 200 mentioned earlier with reference to
Referring to
Referring to
As mentioned earlier with reference to
If the wearable device 200 is placed in the vicinity of the mobile device 100, the mobile device 100 receives device information of the wearable device 200 from the wearable device 200 using the communication unit. For example, the device information of the wearable device 200 can include at least one selected from the group consisting of a shape, a size, and a resolution of a display unit 220 of the wearable device 200. And, the device information of the wearable device 200 includes a model number and/or a unique number of the wearable device 200. The mobile device 100 can determine at least one selected from the group consisting of a shape, a size, and a resolution of a display unit 220 of the wearable device 200 based on information stored in advance.
Having received the device information of the wearable device 200, the mobile device 100 displays an interface 305 for editing the first image 301 on the first image 301 based on the device information. The wearable device 200 can make the mobile device 100 provide the interface 305 by transmitting the device information of the wearable device 200 to the mobile device 100.
The interface 305 has a form practically identical to the display unit 220 of the wearable device 200. The interface 305 can be changed based on a change of a relative position of the wearable device 200 for the mobile device 100.
For example, as shown in
And, the interface 305 can be changed based on a position change changed by a user by moving the wearable device 200 or the mobile device 100 between the wearable device 200 and the mobile device 100. For example, if the wearable device 200 is moved to the upper side in a manner that the user moves a left hand of the user to the upper side, the interface 305 can also be moved to the upper side.
As shown in
The mobile device 100 can provide the interface 305 to a position closest to the wearable device 200. Yet, if the wearable device 200 is placed in the vicinity of the mobile device, the mobile device 100 may provide the interface 305 to a predetermined position. For example, the center of the display unit 120 of the mobile device 100 can be configured as an initial position of the interface 305.
The mobile device 100 can transmit a partial image (e.g., the first image 301 in the interface 305) corresponding to the interface 305 among the first images 301 to the wearable device 200. For example, if a distance between the mobile device 100 and the wearable device 200 is less than a first distance, the mobile device 100 can display the interface 305. And, for example, the mobile device 100 can mirror the first image 301 in the interface 305 to the wearable device 200 after the interface 305 is provided.
After the interface 305 is displayed, if the distance between the mobile device 100 and the wearable device 200 exceeds a second distance, the mobile device 100 can transmit a partial image corresponding to the interface 305 among the first images 301 to the wearable device 200. Hence, a partial image of the first image 301 corresponding to a shape of the display unit 220 of the wearable device 200 is transmitted to the wearable device 200.
As shown in
Referring back to
Meanwhile, for example, the first image 301 can include a map image. In this case, the mobile device 100 can transmit a geographic coordinate to the wearable device 200 instead of the partial image of the first image 301. In particular, if the first image 301 corresponds to a map image, the mobile device 100 can transmit a geographic coordinate corresponding to a position of the interface 305 to the wearable device 200. Having received the geographic coordinate, the wearable device 200 may start to guide a way based on the received coordinate.
When the mobile device 100 provides the interface 305 to the wearable device 200, the mobile device can provide auditory feedback or tactile feedback to the wearable device 200 together with the interface 305.
The operations of the mobile device 100 and/or the wearable device 200 mentioned earlier with reference to
Referring to
In this case, as shown in
In
The movement of the interface 305 shown in
Referring to
Referring to
Referring to
In this case, the distance change changed by moving the wearable device 200 and the distance change changed by moving the mobile device 100 can be performed as a different operation. For example, the mobile device 100 can change a display size of the interface 305 based on a changed distance only when the distance between the mobile device 100 and the wearable device 200 is changed by moving the wearable device 200.
The operations of the mobile device 100 and/or the wearable device 200 mentioned earlier with reference to
As mentioned earlier in
Referring to
In this case, a user may want to magnify the first image 301. Referring to
In particular, if the distance between the mobile device 100 and the wearable device 200 is changed due to the movement of the mobile device 100, the mobile device 100 changes a display size of the first image 301 based on the changed distance. For example, the mobile device 100 can magnify the first image 301 on the basis of a position at which the interface 305 is displayed.
Meanwhile, although the distance between the mobile device 100 and the wearable device 200 is changed due to the movement of the wearable device 200, the first image 301 can also be magnified.
And, if the distance between the mobile device 100 and the wearable device 200 is maintained for more than prescribed time after the size of the first image 301 is changed, the mobile device 100 can transmit a first image 301 corresponding to the interface 305 to the wearable device 200. Yet, the mobile device 100 may operate in a mode for changing the size of the first image 301 based on an input inputted on a sub interface described in the following.
The mobile device 100 can transmit a first image 301 in the interface 305 to the wearable device 200 based on the input inputted on the sub interface described in the following.
In this case, the distance change changed by moving the wearable device 200 and the distance change changed by moving the mobile device 100 can be performed as a different operation. For example, the mobile device 100 can change a display size of the first image 301 based on a changed distance only when the distance between the mobile device 100 and the wearable device 200 is changed by moving the mobile device 100.
The operations of the mobile device 100 and/or the wearable device 200 mentioned earlier with reference to
Referring to
Referring to
The mobile device 100 can rotate the interface 305 on the display unit 120 based on an angle between the display unit 120 of the mobile device 100 and the display of the wearable device. Referring to
The operations of the mobile device 100 and/or the wearable device 200 mentioned earlier with reference to
In
Referring to
Referring to
For example, the mobile device 100 can display a neighboring image of the displayed image. The mobile device 100 can determine a neighboring direction of an image to be changed based on a direction in which the wearable device 200 rotates.
The digital device 100 can detect the rotation of the wearable device based on image processing. The wearable device 200 can detect the rotation of the wearable device 200 using a gyro sensor. And, the mobile device 100 can detect the rotation of the wearable device 200 based on a signal received from the wearable device 200.
The operations of the mobile device 100 and/or the wearable device 200 mentioned earlier with reference to
The mobile device 100 can provide a sub interface 306 for editing a first image 301 together with the interface 305. In
Referring to
As shown in
For example, if an input for copying is inputted on the sub interface 306, the mobile device 100 can transmit a partial image corresponding to the interface 305 among the first image to the wearable device. As mentioned in the following
The operations of the mobile device 100 mentioned earlier with reference to
As mentioned earlier with reference to
For example, as shown in
The operations of the mobile device 100 mentioned earlier with reference to
The mobile device displays a first image on a display unit of the mobile device [S1101]. If the wearable device is positioned in the vicinity of the mobile device, the mobile device receives device information of the wearable device from the wearable device [S1102]. As mentioned in the foregoing description, the device information can include a size, a shape, a resolution, a name, and a unique number of a display unit of the wearable device. The mobile device can display an interface for editing the first image on the first image based on the received device information [S1103]. As mentioned earlier with reference to
The method of controlling the mobile device mentioned earlier with reference to
The method of controlling the wearable device mentioned earlier with reference to
In the present specification, a wearable device capable of being worn on a wrist of a user is explained as an example. Yet, the wearable device can be worn on a different body part rather than the wrist. The wearable device has a relatively small display unit. In general, the wearable device has a display unit of a shape different from a shape of a display unit of a mobile device. Hence, a wearable device worn on a different body part rather than the wrist can also be included in the wearable device according to the present specification.
A mobile device, a wearable device, and a method of controlling therefor according to the present specification may not limitedly apply to the composition and method of the aforementioned embodiments. The aforementioned embodiments may be configured in a manner of being selectively combined the whole of the embodiments or a part of the embodiments to achieve various modifications.
Meanwhile, a mobile device, a wearable device, and a method of controlling therefor can be implemented with software readable by a processor in a recording media readable by the processor, which is equipped in the digital device. The recording media readable by the processor may include all kinds of recording devices for storing data capable of being read by the processor. The examples of the recording media readable by the processor may include a ROM, a RAM, a magnetic tape, a floppy disc, an optical data storing device and the like. And, implementing in a form of a carrier wave such as a transmission via the internet and the like is also included. And, since the recording media readable by the processor are distributed to the computers connected by a network, codes readable by the processor can be stored and executed in a manner of being distributed.
While the present specification has been described and illustrated herein with reference to the preferred embodiments and diagrams thereof, the present specification may be non-limited to the aforementioned embodiments and it will be apparent to those skilled in the art that various modifications and variations can be made therein without departing from the spirit and scope of the present specification. Thus, it is intended that the present specification covers the modifications and variations of this invention that come within the scope of the appended claims and their equivalents.
Various embodiments have been described in the best mode for carrying out the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
The present invention can be used in a terminal device and is usable in the industry having possibility of repetition.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/KR2014/011871 | 12/5/2014 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2016/088922 | 6/9/2016 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20130254705 | Mooring | Sep 2013 | A1 |
20140168063 | Kita | Jun 2014 | A1 |
20140273849 | Lee | Sep 2014 | A1 |
20140298353 | Hsu et al. | Oct 2014 | A1 |
Number | Date | Country |
---|---|---|
104182190 | Dec 2014 | CN |
2014113891 | Jul 2014 | WO |
2014175505 | Oct 2014 | WO |
Entry |
---|
PCT International Application No. PCT/KR2014/011871, Written Opinion of the International Searching Authority dated Jul. 29, 2015, 19 pages. |
Number | Date | Country | |
---|---|---|---|
20170353686 A1 | Dec 2017 | US |