Patent Grant
8965400
This application claims the benefit under 35 U.S.C. §119(a) from a Korean patent application Serial No. 10-2011-0135352, filed on Dec. 15, 2011 in the Korean Intellectual Property Office, the entire disclosure of which is hereby incorporated by reference in its entirety.
1. Field of the Invention
The present invention relates to an apparatus and a method for displaying a location of a portable terminal. More particularly, the present invention relates to an apparatus and a method for displaying a location of a terminal of other subscribers during a call.
2. Description of the Related Art
A portable terminal now provides various types of functions, particularly communication functions, among which is a video call service. In the video call service, the information of a calling party (caller and callee) is displayed on a screen of each party to the call. Typically, an image of the other calling party is displayed to be larger than an image of the calling party.
Here, when a location of the other calling party needs to be identified during the video call, the portable terminal cannot immediately display the location information during a call even if the location information of the other party is received. In other words, when a subscriber A receives location information of a subscriber B during a call, a received location may not be immediately displayed without two or more steps of an application that are required to be performed to display a location of the subscriber B on the display of the portable terminal of subscriber A. The requirement applies regardless of a distance between a user and a destination.
For example, when the portable terminal has an application which displays location information provided by a third party, location information provided by another subscriber is searched through a global positioning system (GPS) and a distance and a direction from a current location of the portable terminal to the other subscriber is calculated and displayed based on a searched result. Thus, a method of displaying location information described above uses a one way communication, not a two way communication.
Therefore, in a conventional portable terminal, the problems include that location information may not be shared between calling parties during a call and the shared location information may not be displayed while a call is performed.
Accordingly, the present invention has been made to provide a method and an apparatus for providing a three dimensional user interface of an electronic device in which a user may easily manipulate content items may be easily disposed in a three dimensional space.
The present invention provides an apparatus and a method for sharing location information between calling parties during a call and displaying the shared information. To this end, information of a destination to which a calling party wishes to go is provided from the other subscriber during a call and a result is displayed on a screen. According to the present invention, during a video call, the calling party requests and receives location information of the other subscriber and the location information is immediately displayed on a communication window (a window in which an image of the calling party is displayed).
Thus, the present invention provides a method in which during a call supported by a terminal, an image display area, augmented reality technology, and technology for detecting location information of a calling party and another subscriber, wherein GPS information or information received through Wi-Fi or from three base stations may be utilized, such that a location of the other subscriber with whom a user is having a video call may be easily located and accessed.
In accordance with an exemplary aspect of the present invention, an apparatus for displaying a location of another subscriber's terminal in a calling party's terminal may preferably include a communication unit; a location detection unit configured to detect a location of a terminal; a direction detection unit configured to detect a direction of the terminal; a camera configured to photograph an image; a controller configured to receive location information of the other subscriber's terminal in a call mode, configured to drive the camera upon receiving the location information of the other subscriber's terminal to display an image photographed by the camera, configured to analyze location information detected by the location detection unit and the received location information of the other subscriber's terminal to calculate a distance between two terminals, and configured to display the location of the other subscriber's terminal on the displayed image when a direction detected by the direction detection unit aligns with the location of the other subscriber's terminal; and a display unit configured to display a location of the other subscriber on the image photographed by the camera, according to the controller.
According to an exemplary aspect of the present invention, the calling party requests the location information of the other subscriber during a call. Subsequently, the calling party receives location information, such as, for example, the location information of latitude and longitude transmitted from the other subscriber, and calculates a distance between the calling party and other subscriber using location information of the other subscriber and current location information of calling party. Also, the calling party detects a direction of other subscriber using a detection unit.
The present invention provides a sharing location information between calling party and called party during a call without a call disconnection without using complicated location search procedure.
In accordance with another exemplary aspect of the present invention, a method of displaying a location of another subscriber's terminal in a calling party's terminal may preferably include: performing/operating in a call mode that is preferably a video call mode; driving a camera upon receiving location information of the other subscriber's terminal in the call mode to display an image photographed by the camera; and analyzing location information detected by a location detection unit and the received location information of the other subscriber to determine a distance between two terminals and displaying a location of the other subscriber's terminal on the displayed image when a direction of the calling party's terminal detected by a direction detection unit aligns with a direction of the other subscriber's terminal.
In another exemplary aspect of the invention, a first portable terminal detects and displays a location of a second portable terminal during a wireless call therebetween, the first portable terminal comprising:
a display unit; a communication unit; a location detection unit configured to detect a first location of the first portable terminal; a direction detection unit configured to detect a direction of the first portable terminal relative to the second portable terminal during a call between the first portable terminal and the second portable terminal; a camera configured to photograph an image; a controller configured to receive location information of the second portable terminal while the first portable terminal is engaged in a call mode with the second portable terminal, configured to operate the camera upon receiving the location information of the second portable terminal to display an image photographed by the camera on the display, configured to analyze the first location information detected by the location detection unit of the first portable terminal and the received location information of the second portable terminal to calculate a distance between the first portable terminal and the second portable terminal, and configured to display the location of the second portable terminal on the displayed image when a direction of the first portable terminal detected by the direction detection unit aligns with the location of the second portable terminal; and wherein the display unit is configured to display a location of the second portable terminal on the image photographed by the camera, according to control of the controller.
The exemplary objects, features and advantages of the present invention will become more apparent to the person of ordinary skill in the art from the following detailed description in conjunction with the accompanying drawings, in which:
Exemplary embodiments of the present invention are described with reference to the accompanying drawings in detail. The same reference numbers are used throughout the drawings to refer to the same or like parts. Detailed descriptions of well-known functions and structures incorporated herein may be omitted to avoid obscuring appreciation of the subject matter of the present invention by a person of ordinary skill in the art.
In the present invention, location information of another subscriber's portable terminal is requested during a call by a first portable terminal that is a party to the call, and location information received from the other subscriber's portable terminal is displayed on a screen of a calling party. To this end, a portable terminal according to an exemplary embodiment of the present invention provides a function and a configuration for obtaining and transmitting location information thereof while maintaining a call state when a location information request message is received during a call. Also, the portable terminal according to an exemplary embodiment of the present invention provides a function and a configuration for requesting location information from a portable terminal of another subscriber during a call and displays the received location information of the other subscriber on an image photographed by a camera or a map. The portable terminal according to an exemplary embodiment of the present invention may easily access a location of the other party of a user's call by using augmented reality (AR) technology and a user's location detection technology such as, for example, global positioning system (GPS) information or information received from Wi-Fi or three base stations. Also, a method of displaying a location of the other subscriber on the image photographed by the camera or a map screen is provided. The above method may be effective particularly in case of a video call.
Referring now to
A communication unit 120 performs to wirelessly connect the portable terminal with a respective corresponding base station. Here, the communication unit 120 may be, for example, a base station communication network or an Internet communication network. The communication unit 120 may be provided with a transceiver including a transmission unit, which includes a frequency up converter for up-converting a transmission signal into an RF frequency band and a power amplifier, and a reception unit, which includes a low noise amplifier for low noise amplifying a received signal and a frequency down converter for down-converting the RF signal into a base band. Also, the communication unit 120 may be provided with a modulation unit (not shown) for modulating the transmission signal to be transmitted to the transmission unit and a demodulating unit for demodulating a signal output from the reception unit. An artisan should understand and appreciated that all of the items throughout with the term “unit” constitute hardware, and/or hardware configured with software or firmware as to constitute statutory subject matter in the scope of the appended claims. In this case, the modulation/demodulation unit may compatible with 3G such as, for example, WCDMA or CDMA, or compatible with 4G such as GSM or LTE. Alternatively, the modulation/demodulation unit may comply with Wi-Fi or Wibro, or Wimax.
A camera 130 performs a function to photograph an external image. The camera may include, for example, an active pixel sensor (APS), or a charge-coupled device (CCD), or any other type of optical sensor to obtain an image.
A display unit 150 performs a function to display a display data according to control of the controller 100. An input unit 140 performs a function to input a command and a data for controlling an operation of the portable terminal. Here, the input unit 140 and the display unit 150 may be integrated into a touch screen panel, and may constitute, for example, any type of thin film technology (TFT) display compatible with touch sensitivity.
The controller 100, which constitutes hardware such as a processor or microprocessor, is configured to control an overall operation of the portable terminal. Also, the controller 100 receives location information of other subscriber during a call according to an exemplary embodiment of the present invention and performs to display the received location information on a screen.
A memory 110, which is a non-transitory machine readable medium, may include a program memory portion for storing an operation program of the portable terminal and programs in accordance with an exemplary embodiment of the present invention and a data memory portion for storing an installation data and a data generated during executing the program. The memory 110 may include a map storage unit for storing a map data. The map may store a 2D map or 3D map data.
In the portable terminal described above, the controller 100 may control the display of a location of the other subscriber of a call during operation of the call. This display of location of the other subscriber can be automatic without any user request, and may be configured as modifiable default. For example, if the battery power drops to below a threshold, the display of the location of the other subscriber's terminal location may not be automatically displayed. Here, the location of the other subscriber may be displayed through an augmented reality (AR) function on a screen photographed through the camera 130.
In the description herein below, a calling party refers to a user whose portable terminal (e.g. a first portable terminal or an initiating portable terminal) requests the location information of the other subscriber (i.e. the location of the portable terminal (e.g. a second portable terminal or a target portable terminal) used by the other subscriber, receives location information transmitted from the other subscriber, and displays the location information on the first portable terminal, and the other subscriber refers to a user whose second (target) portable terminal generates and transmits location information thereof when the location information is requested by the first portable terminal, which is the calling party. Also, in order to display the location of the other subscriber's terminal according to an exemplary embodiment of the present invention, the controller 100 may be provided with a actuation capability to actuate a function (some examples may be a display of a virtual or an actual button, a menu or an application) requesting the location information of the other subscriber during a call and a function (button, menu or application) for generating the location information thereof when the location information is requested and transmitting the location information to the calling party.
In order to display the location of the other subscriber (the other subscriber's portable terminal) during a call, in response to a detected selection by the calling party regarding a location information request function, the controller 100, which detects the request function, generates a location information request message to be transmitted to the other subscriber's portable terminal through the communication unit 120. Then, the other subscriber selects (or alternatively the other subscriber's portable terminal may automatically activate a location information transmission function during a call. The controller 100, which detects this identifies the location information of the other subscriber via the other subscriber's portable terminal through the location detection unit 160, generates a location information message to be transmitted through the communication unit 120. Here, the location detection unit 160 may be a GPS receiving unit and may receive the latitude and longitude information of a location at which the other subscriber and their portable terminal is currently located. Also, when the location detection unit 160 is provided with an altitude detecting function, the detected altitude information may be included in addition to the latitude and longitude information.
Also, the controller 100 of the portable terminal which requests the transmission of the location information also drives the rear side camera 130 of the portable terminal, i.e., a camera located on a rear side of the display unit 150, to photograph the external image for transmission to the other calling party. When the location information is received from the other subscriber's portable terminal, a current location of the portable terminal is detected through the location detection unit 160 and a distance between two portable terminals is calculated by analyzing detected locations of both the portable terminal of the calling party and the portable terminal of the other subscriber. Also, the controller 100 sets a direction, e.g., North, East, West or South (NEWS), to which the camera 130 is directed through the direction detection unit 170. Namely, the direction detection unit 170 detects a direction to which the camera 130 is directed and may comprise an electromagnetic sensor and/or a gyroscope. Here, the reason for detecting the direction to which the camera 130 is directed is to identify a direction of the image photographed by the camera 130. In other words, an AR display function according to an exemplary embodiment of the present invention may display the location of the other subscriber in the image photographed by the camera 130 and, to this end, a photographing direction of the camera 130 may be determined through the direction detection unit 170 and direction sensor 175.
The controller 100 may detect a distance and a direction to the other subscriber and their portable terminal according to the location (latitude and longitude) information exchanged between the portable terminal of the calling party (first portable terminal) and the portable terminal of the other subscriber (second portable terminal). In addition, the detected distance and direction may be displayed on the display unit 150. Also, the controller 100 may display the location of the other subscriber and direction information detected by the direction detection unit 170 on an image screen photographed by the camera 130 as well as distance change information according to movement of the calling party.
As discussed herein above, according to an exemplary embodiment of the present invention, a method of displaying the location information of the other subscriber may be applied to a video call. In the below description, it is assumed that the calling performs the video call with the other subscriber.
In this case of a video call with the other subscriber, the portable terminal which transmits the location information has an application that generates the location information and, to this end, the location detection unit (here, e.g., GPS receiving unit) 160 and a route that can access a ‘share my location’ menu need to be provided. Also, the portable terminal which receives and displays the location information includes the camera 130, the location detection unit 160, the display unit 150 which includes as shown in
Referring now to
Referring now to
With continued reference to
An artisan should understand and appreciating that a typical non-limiting range between the two devices may comprise, for example, a local area like a line of sight. For example, user of portable terminal requests a location information of the other portable terminal in a nearly appointed place.
As described above, regarding the location information of the portable terminal of the other subscriber displayed on the display unit 150, the AR technology may be additionally supported to provide increased detail of the information transmitted from the portable terminal of the other subscriber's portable terminal and improved convenience. The portable terminal according to an exemplary embodiment of the present invention may display the location of the other subscriber (and their portable terminal) in the areas 210 and 220 in which the image is shown during the video call, and when displaying the location of the other subscriber, the AR technology may be applied to increase utility of a preview area and provide convenience such that the user may easily locate a desired location.
As described above, when the portable terminal of the calling party requests the portable terminal of the other subscriber to share the location during a call (a video call or a general call), the portable terminal of the other subscriber receiving such a request transmits the current location of the other subscriber by automatic selection by the portable terminal or by the portable terminal detecting selection of the ‘share my location’ menu during the call. Then the calling party's portable terminal which receives the location information of the other subscriber switches the camera 130 from front to rear and previews a front view of the terminal. Here, in case of the video call, a preview image of the front view may be displayed in one area of an area in which the calling party's image is displayed and an area in which the other subscriber's image is displayed. Also, the controller 100 of the calling party's portable terminal may detect the direction to which the camera 130 is directed by using the direction detection unit 170 and the detection sensor 175, and may display a location of the other subscriber on the image previewed through the camera 130 when the location and the direction of the other subscriber that is identified in advance matches with that of the calling party while the calling party rotates 360 degrees with the terminal. Here, information displayed in AR includes not only the location of the other subscriber but also the direction of the other subscriber with respect to the calling party in a 360 degrees view.
Also, when displaying the other subscriber's location on the image from the camera 130 as shown in FIGS. 4A through 4D′, if additional information, e.g., a note or a memo, other than the location information of the other subscriber is received, the controller 100 of the calling party's portable terminal may display the additional information on the other subscriber's location displayed on the image from the camera 130. In this case, the additional information may be a building name, a business name, a floor, or a company in a place in which the other subscriber is located.
Referring now to
Here, at (551) the controller 100 of the portable terminal which receives the location information request message detects the location information request message, and identifies the location information of the portable terminal through the location detection unit 160 (553). In this particular case, the location information may comprise the latitude and longitude information, and when the location detection unit 160 comprises the height (altitude) sensor, the location information may comprise latitude, longitude and height information. After the location information is identified, at (555) the controller 100 generates the location information message to be transmitted to the calling party's portable terminal (namely, the portable terminal which requests the transmission of the location information) through the communication unit 120. Also, when the location information is requested from the calling party's portable terminal through a detected voice command, the portable terminal of the other subscriber detects selection of the ‘share my location’ menu during the call. Then the controller 100 detects that the transmission of the location information is transmitted at step 551, obtains the location information of the portable terminal through the location detection unit 160 at step 553, and generates the obtained location information into a message to be sent from the calling party's portable terminal at step 555.
As described above, when the other subscriber's portable terminal receives the location information request message from the calling party's portable terminal, or the ‘share my location’ menu is selected by a subscriber or opens as a default, the controller 100 detects this information request at step 551, obtains the current location information of the terminal at step 553, and generates the location information into the message to be sent to the calling party's portable terminal at step 555. The location information may include the height (altitude) information as well as the latitude and longitude information. Also, the portable terminal of the other subscriber may transmit, as received through the input unit 140, a memo and/or a note message to be sent with the location information. Here, information of the memo and/or note may be additional information such as, for example, a building name, a business name, a street name, a floor, or surrounding information of an area in which the portable terminal of the other subscriber is located.
When the location information is received from the other subscriber's portable terminal after the transmission of the location information is requested, at (525) the controller 100 detects this receipt of requested information, stores at (527) the received location information of the other subscriber in the memory 110, and drives the rear side camera 130. Here, the reason for driving the rear side camera 130 is to display the location of the other subscriber in the AR function. Here, when the location of the other subscriber is displayed as the map information, the driving of the rear side camera 130 may be omitted. After driving the rear side camera 130, at (529) the controller 100 controls display of an image photographed by the camera 130 on the display unit 150. Here, the image photographed by the camera 130 may be displayed in the first area 210 in which the other subscriber's image is displayed. In this case, the image of the other subscriber may be displayed in the second area 220 in which the calling party's image is displayed.
Next, at (531) the controller 100 detects the location and direction of the calling party's portable terminal. In other words, the controller 100 detects the location information of the calling party's portable terminal through the location detection unit 160 and detects the direction of the image currently photographed by the camera 130 through the direction detection unit 170. Next, the controller 100 analyzes the location information of the calling party's portable terminal and the received location information of the other subscriber to calculate the distance between the two portable terminals (533). Here, the location information comprises the latitude and longitude information such that the distance between the two terminals and the direction in which the other subscriber's portable terminal is located may be known. Therefore, when the portable terminal is rotated, the controller 100 detects a moving direction of the portable terminal through the location detection unit 160, and when the portable terminal is rotated until the photographing direction of the camera 130 aligns with a direction in which the other subscriber is located, the image photographed by the camera 130 in the direction in which the other subscriber is located may be obtained.
Here, when the direction in which the camera 130 is directed is different from the direction in which the other subscriber is directed, the controller 100 may detect this through the location detection unit 160. When the photographing direction of the camera 130 is different from the direction in which the other subscriber is located, at (535) the controller 100 detects this difference in direction and at (537) may control an output of a message for directing to rotate the direction of the terminal through the display unit 150 or a speaker (not shown). When the photographing direction of the camera 130 aligns with the direction in which the other subscriber is located (namely, when the location of the other subscriber can be displayed within the image photographed by the camera 130), the controller 100 detects this at step 535 and at (539) display the location of the other subscriber (e.g. the target point). Here, when the location information transmitted from the other subscriber includes the altitude information, the controller 100 may display the other subscriber's location of the portable terminal at a corresponding altitude in the photographed image. Also, a method of displaying the location of the other subscriber may be displayed in one method among display methods as in
When the location of the other subscriber is displayed as in the above, the calling party may identify the location of the other subscriber that is displayed in one of forms as shown in
A method of displaying the other subscriber's location performed as shown in
According to the present invention, when a portable terminal of a calling party requests location information of the portable terminal of another subscriber during a call between the portable terminals, the location information is received and displayed on a communication window (a window in which an image of the calling party is displayed) such that the inconvenience of switching to other windows (or other applications) for viewing a searched result as in the conventional art is eliminated or may be avoided and utility of a window used in a video call (a two way communication) may be increased.
The above-described methods according to the present invention can be implemented in hardware, firmware or as software or computer code loaded into hardware such as a processor or microprocessor and executed, the machine executable code being stored on a recording medium such as a CD ROM, an RAM, a floppy disk, a hard disk, or a magneto-optical disk or computer code downloaded over a network originally stored on a remote recording medium or a non-transitory machine readable medium and to be stored on a local recording non-transitory medium, so that the methods described herein can be rendered in such software that is stored on the recording medium using a general purpose computer, or a special processor or in programmable or dedicated hardware, such as an ASIC or FPGA. As would be understood in the art, the computer, the processor, microprocessor controller or the programmable hardware include memory components, e.g., RAM, ROM, Flash, thumbnail, etc. that may store or receive software or computer code that when accessed and executed by the computer, processor or hardware implement the processing methods described herein. In addition, it would be recognized that when a general purpose computer accesses code for implementing the processing shown herein, the execution of the code transforms the general purpose computer into a special purpose computer for executing the processing shown herein. The terms “unit” or “module” as used herein is to be understood as constituting hardware such as a processor or microprocessor configured for a certain desired functionality in accordance with statutory subject matter under 35 U.S.C. §101 and does not constitute software per se.
Although exemplary embodiments of the present invention have been described in detail hereinabove, it should be clearly understood that many variations and modifications of the basic inventive concepts herein taught which may appear to those skilled in the present art will still fall within the spirit and scope of the present invention, as defined in the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2011-0135352 | Dec 2011 | KR | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 8594709 | Jang et al. | Nov 2013 | B2 |
| 8600412 | Jang et al. | Dec 2013 | B2 |
| 8638720 | Huang et al. | Jan 2014 | B2 |
| 8670781 | Kim et al. | Mar 2014 | B2 |
| 8744489 | Jang et al. | Jun 2014 | B2 |
| 8750910 | Jang et al. | Jun 2014 | B2 |
| 20140055098 | Lee | Feb 2014 | A1 |
| 20140141802 | Huang et al. | May 2014 | A1 |
| 20140235281 | Jang et al. | Aug 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 10-1013751 | Feb 2011 | KR |
| 10-2011-0048939 | May 2011 | KR |
| Number | Date | Country | |
|---|---|---|---|
| 20130157697 A1 | Jun 2013 | US |
