Patent Grant
9052192
This application is related to and claims the benefit under 35 U.S.C. §119(a) of a Korean patent application filed in the Korean Intellectual Property Office on May 31, 2010 and assigned Serial No. 10-2010-0050847 and a Korean patent application filed in the Korean Intellectual Property Office on Feb. 11, 2011 and assigned Serial No. 10-2011-0012486, the entire disclosure of both of which are hereby incorporated by reference.
The present invention relates to an apparatus and method for recognizing an indoor zone by using a magnetic field sensor in a portable terminal. More particularly, the present invention relates to an apparatus and method for recognizing an indoor zone in which a user is located by using an Earth's magnetic field that is generated naturally instead of the conventional method of combining a magnetic field generator and a magnetic field sensor.
Portable terminals have become necessities of modern life for people of all ages. Thus, service providers and terminal manufacturers are competitively developing differentiated products and services.
For example, the portable terminal has developed into a multimedia device capable of providing various services such as phonebooks, games, Short Message Service (SMS), Electronic mail (E)-mail, morning calls, MPEG-1 Audio Layer 3 (MP3) player, scheduling, digital cameras, Multimedia Message Service (MMS), and wireless Internet.
Additionally, the aforementioned portable terminal provides a location information service which measures a location of the portable terminal, i.e., a location of a user, to inform the location. By using the location information service, the user can determine a user's current location, a bus stop around the current location, a path to a destination from the current location, and so forth. The location information service is one service frequently used by the user.
The location information service uses a Global Positioning System (GPS) in general. The GPS can obtain correct information in an outdoor zone where a satellite signal can be readily received, but cannot be used in an indoor zone where the satellite signal cannot be received.
In order to use the location information service in the indoor zone where the satellite signal cannot be received, a Wi-Fi Positioning System (WPS) technique that utilizes a Wi-Fi signal can be used. The WPS technique can be classified into a triangulation technique and a fingerprint technique. However, since Wireless Local Area Network (WLAN) signal strength is measured and used in both of the two techniques, at least 3 or more Access Points (APs) may be required to provide the location information service with high accuracy. Further, there is a problem in that AP information (e.g., Service Set IDentifier (SSID), Media Access Control (MAC) address, location, and the like) has to be managed in advance in a form of a database.
Instead of the aforementioned method, a sensor may be installed in a lattice form in an indoor zone (floor, ceiling, and the like), and thereafter a user location may be recognized by using a difference in a signal transfer rate between an ultrasonic signal and a signal generated from the sensor, or the user location can be recognized by utilizing a plurality of cameras, a pressure sensor, an infrared ray, and a Radio Frequency IDentification (RFID). However, this method may result in great expenses to install the sensor.
In addition, when using a method in which a magnetic field sensor is utilized to recognize the user location, a magnetic field generator is used to implement the method. Therefore, this method also has a problem in that the installation cost increases similarly to the case of using the sensor.
To address the above-discussed deficiencies of the prior art, it is a primary aspect of the present invention to solve at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide an apparatus and method for recognizing an indoor zone by using a magnetic field sensor in a portable terminal.
Another aspect of the present invention is to provide an apparatus and method for recognizing an indoor zone by using an Earth's magnetic field that is generated naturally in a portable terminal instead of using a magnetic field generator.
Another aspect of the present invention is to provide an apparatus and method for correcting a value of a magnetic field sensor according to a posture of a portable terminal.
Another aspect of the present invention is to provide an apparatus and method for improving performance of a zone recognition technique by using an Earth's magnetic field that is generated naturally in a portable terminal.
Another aspect of the present invention is to provide an apparatus and method for improving performance of a zone recognition technique by using an image at a location at which an Earth' magnetic field component is collected in a portable terminal.
In accordance with an aspect of the present invention, an apparatus for recognizing a zone of a portable terminal is provided. The apparatus includes a zone evaluator for primarily recognizing a location of the portable terminal by using first and second components of an Earth's magnetic field and for finally recognizing the location of the portable terminal by using first and second images.
In accordance with another aspect of the present invention, a method of recognizing a zone of a portable terminal is provided. The method includes primarily recognizing a location of the portable terminal by using first and second components of an Earth's magnetic field, and finally recognizing the location of the portable terminal by using first and second images.
Before undertaking the DETAILED DESCRIPTION OF THE INVENTION below, it may be advantageous to set forth definitions of certain words and phrases used throughout this patent document: the terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation; the term “or,” is inclusive, meaning and/or; the phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like. Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases.
For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts:
Throughout the drawings, like reference numerals will be understood to refer to like parts, components and structures.
The present invention described hereinafter relates to an apparatus and method for improving performance of a zone recognition technique by using a component of an Earth's magnetic field that is generated naturally in a portable terminal instead of a magnetic field generator. The component of the Earth's magnetic field that is generated naturally includes an Earth's magnetic field that is distorted by an indoor wall structure, arrangement of home appliances, a metal- or ore-contained product, and the like. The distorted Earth's magnetic field component changes negligibly over time and has a particular component depending on a location in an indoor zone, and such a property is used in location recognition in the indoor zone. Further, in addition to the Earth's magnetic field component, the present invention will improve zone recognition performance by comparing images at locations at which the Earth's magnetic field component is collected.
In the following description, a finger print is information corresponding to a location for zone recognition, and includes the Earth's magnetic field component including a horizontal intensity, a vertical intensity, an azimuth angle, and the like, which are determined by measuring the Earth's magnetic field. The finger print includes a reference finger print for a zone predetermined (or to be determined) by a user and a target finger print corresponding to a current location of the portable terminal. In addition, in the following description, a reference image is an image acquired by capturing a surrounding environment of a zone in which the reference finger print is determined, and a target image is an image acquired by capturing a surrounding environment of a zone in which the target finger print is determined.
As shown in
The controller 100 of the portable terminal provides overall control to the portable terminal. For example, the controller 100 processes and controls voice telephony and data communication, and other typical functions. Under the control of the controller 100, a reference finger print, which is an Earth's magnetic field component corresponding to a location to be determined as a reference zone, and a target finger print, which is an Earth's magnetic field component corresponding to a current location, are collected to recognize a current location in which the portable terminal is located. Herein, the finger print may include a horizontal intensity, a vertical intensity, an azimuth angle, and the like. The controller 100 may collect the finger print by measuring the Earth's magnetic field.
That is, the controller 100 determines a reference zone by collecting and storing the reference finger print for a zone to be determined as the reference zone by a user of the portable terminal, and thereafter persistently collects a finger print for the current location. By comparing the two finger prints, it is determined whether the zone in which the portable terminal is currently located corresponds to the reference finger print. If it is determined that the portable terminal is located in a specific location as a result of determining the current location, the portable terminal (more specifically, the controller 100) may perform a specific function (e.g., data transmission to a television set existing in the specific zone) in the specific zone.
Further, if the zone is recognized by comparing the reference finger print and the target finger print, the controller 100 determines the zone in which the portable terminal is currently located after comparing a reference image and a target image to improve a recognition rate. This is to solve a problem of the conventional zone recognition technique in which zone recognition cannot be performed correctly when the zone is recognized by using only the finger print since the same pattern of the Earth's magnetic field is detected in different zones.
Furthermore, when the portable terminal moves to the location determined as the reference zone, the controller 100 may execute a pre-registered interworking program so that the portable terminal may automatically interwork with a peripheral device in the reference zone.
The zone evaluator 102 collects the target finger print and the reference finger print which is information used to determine the current location of the portable terminal under the control of the controller 100. Herein, the finger print is information corresponding to a location for zone recognition, and includes a horizontal intensity, a vertical intensity, an azimuth angle, and the like, which are determined by measuring the Earth's magnetic field. The zone evaluator 102 uses the vertical intensity which is a component of an Earth's direction when recognizing the zone since the Z-axis out of the three axes (i.e., X, Y, and Z) clearly shows a value of the Earth's magnetic field distorted with respect to a building's floor, ceiling, and the like. For example, wherever the portable terminal is located in a 10-story building, a component Z is influenced by 11 thick concrete floor/ceiling constructions whereas components X and Y (i.e., horizontal components) are influenced by only a glass window and several pillars and walls.
Additionally, the zone evaluator 102 uses the horizontal intensity as a representative value for zone recognition. The horizontal intensity is obtained by removing a direction component from values of the X-axis and the Y-axis including the distorted Earth's magnetic field component weaker than that of the Z-axis of the portable terminal.
Further, the zone evaluator 102 obtains the azimuth angle by using the values of the X-axis and Y-axis which are horizontal components of the Earth's magnetic field of the portable terminal. Thereafter, since a directional change of the user can be determined by using the azimuth angle even at one fixed location, the azimuth angle that changes depending on the directional change of the user is used as a representative value for zone recognition. That is, the zone evaluator 102 uses the azimuth angle to determine the vertical intensity and the horizontal intensity which change depending on the directional change of the portable terminal according to the directional change of the portable terminal.
Furthermore, the zone evaluator 102 captures a surrounding environment of a location at which the reference finger print is collected and then stores the captured image by defining it as a reference image, and also captures a surrounding environment of a location at which the target finger print is collected and then stores the captured image by defining it as a target image. Thereafter, the zone evaluator 102 classifies a candidate zone by primarily comparing the finger prints and thereafter finally performs zone determination by comparing the reference image and the target image.
The memory unit 104 preferably includes, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), a flash ROM, and such. The ROM stores a microcode of a program, by which the controller 100 and the zone evaluator 102 are processed and controlled, and a variety of reference data.
The RAM is a working memory of the controller 100 and stores temporary data that is generated while programs are performed. The flash ROM stores a variety of rewritable data, such as phonebook entries, outgoing messages, and incoming messages. The memory 104 stores the collected reference finger print and reference image according to the present invention.
The input unit 106 includes a plurality of function keys such as numeral key buttons of ‘0’ to ‘9’, a menu button, a cancel button, an OK button, a talk button, an end button, an Internet access button, a navigation key button, a character input key, and such. Key input data, which is input when the user presses these keys, is provided to the controller 100. According to the present invention, the input unit 106 provides the controller 100 with a user input for determining the reference zone.
The display unit 108 displays information such as state information, which is generated while the portable terminal operates, numeric characters, moving and still pictures, and such. The display unit 108 may be a color Liquid Crystal Display (LCD), Active Mode Organic Light Emitting Diode (AMOLED), and such. The display unit 108 may include a touch input device as an input device when using a touch input type portable terminal.
The communication unit 110 transmits and receives a Radio Frequency (RF) signal of data that is input and output through an antenna (not illustrated). For example, in a transmitting process, data to be transmitted is subject to a channel-coding process and a spreading process, and then the data is transformed to an RF signal. In a receiving process, the RF signal is received and transformed to a base-band signal, and the base-band signal is subject to a de-spreading process and a channel-decoding process, thereby restoring the data.
Referring to
The sensor 111 is a sensor for obtaining sensing information used to determine a current location of the portable terminal. The sensor 111 is a magnetic field sensor capable of measuring the Earth's magnetic field. The present invention is not limited to the magnetic field sensor for measuring the Earth's magnetic field. Thus, the sensor 111 may include a terrestrial magnetic sensor according to another embodiment of the present invention.
The finger print collector 113 of the zone evaluator 102 collects a horizontal intensity, a vertical intensity, an azimuth angle, and the like, of the portable terminal. The collected items are Earth's magnetic field components used to determine a zone in which the portable terminal is currently located. The Earth's magnetic field component can be defined as a finger print.
The finger print collector 113 collects a reference finger print which is a finger print for a zone (i.e., a reference zone) to be determined by a user of the portable terminal, and collects a target finger print which is a finger print for a current location of the portable terminal. Herein, the reference finger print and a current finger print are used to determine whether the current location of the portable terminal is the reference zone determined by the user. The finger print collector 113 may collect the target finger print if no movement of the portable terminal is detected for a specific time period according to the embodiment of the present invention.
Since the portable terminal cannot always remain in a posture parallel to an Earth's horizontal plane, the posture correction unit 115 corrects a value of the magnetic field sensor of the portable terminal according to angles of X′ and Y′ with respect to the earth horizontal plane as if the portable terminal remains parallel to the Earth's horizontal plane.
The image capturing unit 117 captures a surrounding environment of a location determined to the reference zone in order to correctly determine the zone in which the portable terminal is located, and captures a surrounding environment of a location at which the target finger print is collected. The image capturing unit 117 may include a camera module. The reference image is used as a reference for determining whether the portable terminal is located in the reference zone determined by the user.
The storage unit 119 stores the finger print collected by the finger print collector 113 and the reference image collected by the image capturing unit 117.
The finger print comparator 121 compares the target finger print and the reference finger print collected by the finger print collector 113, and primarily determines whether the current location of the portable terminal is the reference zone determined by the user.
For example, if a comparison value of the reference finger print and the target finger print is within a specific range, the finger print comparator 121 may determine that there is a possibility that the two finger prints have the same zone.
The image comparator 123 finally evaluates a zone determination result of the finger print comparator 121. The reference image is compared with the target image to determine whether the primary determination result is correct.
The image comparator 123 may compare the target image with a comparative image by using such an algorithm as Mean, Variance, Mean Squared Error, Peak Signal to Noise Ratio, Average Difference, Normalized Cross-Correlation, Maximum Difference, Laplacian Mean Squared Error, Normalized Absolute Error, Picture Quality Scale, and the like.
Although one or more functions of the zone evaluator 102 can be performed by the controller 100, they are separately constructed in the present invention for exemplary purposes only. Thus, those ordinary skilled in the art can understand that various modifications can be made within the scope of the present invention. For example, functions of the zone evaluator 102 and the controller 100 can be both processed by the controller 100.
Referring to
In step 205, the portable terminal defines the finger print collected in step 203 as a reference finger print. Herein, the reference finger print is the Earth's magnetic field component for a zone to be registered by the user, and is used to determine whether the current location of the portable terminal is the location for zone recognition.
Thereafter, the portable terminal operates a camera module in step 207, and captures a reference image in step 209. Herein, the reference image is an image acquired by capturing a surrounding environment of a zone in which the reference finger print is determined (i.e., a reference zone determined by the user). The portable terminal may capture an image of a ceiling or wall with respect to a current location according to a location of the camera module included in the portable terminal.
In step 211, the portable terminal registers an interworking program that is automatically executed when the portable terminal is located in the reference zone determined by the user. Thereafter, the procedure of
Referring to
In step 305, the portable terminal performs a process for comparing the reference finger print and the target finger print in order to determine whether the portable terminal is located in a zone registered by the user, and thereafter proceeding to step 307, determines the comparison result of step 305. The portable terminal may pre-store the reference finger print and then compare it with the collected target finger print. Alternatively, according to another embodiment, the portable terminal may transmit the two collected finger prints to a specific server so that the specific server may compare the two finger prints.
That is, by comparing the two finger prints, the portable terminal determines whether a current zone is the zone registered by the user. For example, the portable terminal may obtain a distribution for each of a horizontal intensity, a vertical intensity, and an azimuth angle corresponding to the finger print, and then compare the distribution for each element between the finger prints to determine the zone according to a similarity of the two finger prints. In another embodiment, the portable terminal may obtain an average, a minimum value, a maximum value, a standard deviation, and the like, for each of the horizontal intensity, the vertical intensity, and the azimuth angle, and then compare the average, the minimum value, the maximum value, the standard deviation, and the like, for each data element between the two finger prints to determine the zone according to the similarity of the two finger prints. The portable terminal may compare all elements or some elements of the finger prints, and may differently determine a weight for each element.
The portable terminal may use the following methods in order to decrease a computational amount used to determine the zone registered by the user.
1) A method of decreasing a computational amount by decreasing the number of steps of the process for comparing the reference finger print and the target finger print.
First, the portable terminal may determine secondary location information when the reference finger print is registered in order to avoid the increase of the computational amount resulted from the unnecessary comparison between the reference print and the target print. Herein, the secondary location information may include a cell IDentifier (ID), a Wi-Fi Service Set ID (SSID), a Global Positioning System (GPS) coordination, and the like. The portable terminal may classify the target finger print corresponding to the zone registered by using the secondary location information and thus may perform the process for comparing the target finger print and the reference finger print. (Herein, the cell ID and the Wi-Fi SSID use information having the strongest signal strength.)
2) A method of decreasing a computational amount by decreasing the number of steps of the process for collecting the target finger print.
As described above, the portable terminal may determine the secondary location information when the reference finger print is registered and thereafter may collect the target finger print for a specific zone when the portable terminal is located in a zone registered by using the secondary location information.
This method is for decreasing the steps of a computational operation of the portable terminal. The aforementioned two methods may be performed independently, or may be performed in a combined manner.
If it is determined in step 307 that information on the reference finger print is not similar to information on the target finger print, processing to step 319, the portable terminal determines that the portable terminal is not located in the zone corresponding to the reference finger print.
Otherwise, if it is determined in step 307 that the information on the reference finger print is similar to the information on the target finger print, it is primarily determined that the portable terminal is located in the zone corresponding to the reference finger print. If it is determined that there is a plurality of reference finger prints similar to the target finger print, then the portable terminal creates a list of candidate reference finger prints.
The candidate reference finger print is generated because the same pattern of the Earth's magnetic field is detected in different zones. Due to such a phenomenon, correct zone recognition becomes difficult in the portable terminal. Therefore, the portable terminal of the present invention additionally performs a process for determining whether the primary zone determination is correct.
In order to determine whether the primary zone determination is correct, the portable terminal operates a camera module in step 309, and captures a surrounding environment at a current location in step 311. That is, the portable terminal captures the surrounding environment where the target finger print is collected as an Earth's magnetic field component for the current location, and defines the captured image as a target image.
In step 313, the portable terminal compares a pre-stored reference image (i.e., an image corresponding to a reference zone) and a target image which is a surrounding environment image of the current location. In step 315, the portable terminal determines the comparison result of step 313.
If it is determined in step 315 that the reference image is not similar to the target image, proceeding to step 319, the portable terminal determines that the portable terminal is not located in the zone corresponding to the reference finger print.
Otherwise, if it is determined in step 315 that the reference image is similar to the target image, proceeding to step 317, the portable terminal determines that the portable terminal is located in the zone corresponding to the reference finger print. If the portable terminal determines that there is a plurality of reference finger prints similar to the target finger print, the portable terminal may determine a reference image similar to the target image among reference images corresponding to the plurality of reference finger prints and then may determine that the portable terminal is located in a zone corresponding to the reference image.
When it is determined that the portable terminal is located in the zone corresponding to the reference finger print, the portable terminal may automatically interwork with a device located in the reference zone by executing a pre-registered interworking program.
Thereafter, the procedure of
Referring to
Herein, the X-axis of the portable terminal represents a direction in which a screen width is short in a plane parallel to a screen of the portable terminal, the Y-axis represents a direction in which the screen width is long in the plane parallel to the screen of the portable terminal, and the Z-axis represents a direction vertical to the screen. An Earth's magnetic field component is a vector value consisting of a strength and a direction. The strength of the Earth's magnetic field component corresponding to the X-axis is expressed by |X′|, and the direction thereof is expressed by a unit vector of a direction in which the screen width is short in the plane parallel to the screen.
In step 403, the portable terminal determines a strength |T| of the total Earth's magnetic field by using the Earth's magnetic field components X′, Y′, and Z′ measured in step 301 and Equation (1) below.
|T|=((X′)2+(Y′)2+(Z′)2)0.5 [Eqn. 1]
In step 405, the portable terminal determines angles α and β of X′ and Y′ with respect to an Earth's horizontal plane by using Equation (2) below. Herein, since the portable terminal cannot always be in a posture that is parallel to the Earth's horizontal plane, a correction process is performed so that the portable terminal remains in the posture as if it remains parallel to the Earth's horizontal plane. In the correction process, the portable terminal corrects a value of the magnetic field sensor of the portable terminal according to the angles of X′ and Y′ with respect to the Earth's horizontal plane.
α=sin−1(|Xa′|/g0)
β=sin−1(Ya′/g0) [Eqn. 2]
In Equation (2), α denotes an angle of the vector X′ deviated from the Earth's horizontal plane, and β denotes an angle of the vector Y′ deviated from the Earth's horizontal plane. Xa′ denotes a gravity acceleration component of a direction in which a screen width is short in a plane parallel to a screen, and Ya′ denotes a gravity acceleration component of a direction in which the screen width is long in the plane parallel to the screen. In addition, g0 denotes an average gravity acceleration and is a constant having a value of 9.80665 m/s2 (˜32.174 ft/s2).
In step 407, the portable terminal determines a vertical intensity |Z| by using the angles of X′ and Y′ determined in step 405 with respect to the horizontal plane.
Herein, if the portable terminal is tilted against the Earth's horizontal plane, the portable terminal may determine the vertical intensity as a component of a magnetic north direction from the Earth's magnetic field components X′, Y′, and Z′ according to Equation (3) below by utilizing the tilted angle. If the portable terminal is parallel to the Earth's horizontal plane, the tilted angle is ‘0’. Therefore, by substituting this angle to Equation (3) below, the vertical intensity |Z| can be determined for the horizontal posture.
|Z|=|sin α·X′+sin β·Y′+cos α·cos β·Z′| [Eqn. 3]
In step 409, the portable terminal determines an inclination I used to determine a horizontal intensity |H| of the portable terminal by using the vertical intensity |Z| and the total Earth's magnetic field strength |T| according to Equation (4) below.
I=sin−1(|Z|/|T|) [Eqn.4]
In step 411, the portable terminal determines the horizontal intensity |H| of the portable terminal by using the inclination determined in step 409 and the total Earth's magnetic field strength according to Equation (5) below. In step 413, the portable terminal determines an azimuth angle D of the portable terminal. The portable terminal may determine the azimuth angle of the portable terminal by using the direction sensor, or may determine the azimuth angle by substituting the Earth's magnetic field components X′ and Y′ to Equation (6) below. Herein, the Earth's magnetic field component corresponds to a direction of the portable terminal with respect to a plane parallel to the screen of the portable terminal.
|H|=|T|*cos(I) [Eqn. 5]
The portable terminal determines the vertical intensity |Z| determined in step 407, the horizontal intensity |H| determined in step 411, and the portable terminal's azimuth angle D determined in step 413 whenever the Earth's magnetic field is measured, and defines them as a finger print collected by the portable terminal. The finger print is the Earth's magnetic field component corresponding to a location of the portable terminal located in an indoor zone, and is used for both collecting the reference finger print and the target finger print.
Since the Z-axis out of the three axes (i.e., X, Y, and Z) clearly shows a value of the Earth's magnetic field distorted with respect to a building's floor, ceiling, and the like, when recognizing the zone, the portable terminal uses the vertical intensity which is a component of an Earth's direction, and uses the horizontal intensity obtained by removing a direction component from values of the X-axis and the Y-axis including a distorted Earth's magnetic field component weaker than that of the Z-axis of the portable terminal.
Further, the portable terminal obtains the azimuth angle by using the values of the X-axis and Y-axis which are horizontal components of the Earth's magnetic field of the portable terminal to determine a directional change of the user. Therefore, the azimuth angle that changes depending on the directional change of the user is used even at one fixed location.
Thereafter, the procedure of
Referring to
The Earth's magnetic field component is a vector value consisting of a strength and a direction. The strength of the Earth's magnetic field component corresponding to the X-axis is expressed by |X′|, and the direction thereof is expressed by a unit vector of a direction in which the screen width is short in the plane parallel to the screen. In addition, the strength of the Earth's magnetic field corresponding to the Y-axis is expressed by |Y′|, and the direction thereof is expressed by a unit vector of a direction in which the screen width is long in the plane parallel to the screen.
Referring to
Referring to
Since the portable terminal cannot collect a correct finger print (i.e., a vertical intensity |Z|, a horizontal intensity |H|), and an azimuth angle D of the portable terminal) for evaluating an indoor zone in a state where the portable terminal is tilted against the Earth's horizontal plane, the portable terminal measures Xa′, (i.e., a gravity acceleration component of a direction in which a screen width is short in a plane parallel to the screen) and Ya′, (i.e., a gravity acceleration component of a direction in which the screen width is long in the plane parallel to the screen) by utilizing a gravity acceleration sensor as illustrated in
Referring to
The portable terminal 701 collects a reference finger print for the zone for communicating with the TV sets 703 and 705 (step 710).
Herein, the reference finger print is information for specifying the zone for data transmission, and is an Earth's magnetic field component such as vertical intensity |Z|, horizontal intensity |H|, and an azimuth angle D of the portable terminal 701.
Upon collecting the reference finger print, the portable terminal 701 may acquire an image for a reference zone (step 712), store the acquired image, and then determine a reference zone for the first TV set 703. Although only a process in which the portable terminal 701 determines the reference zone for the first TV set 703 is shown herein in order to show a process for determining the reference zone capable of communicating with the TV set, the portable terminal 701 may also predetermine a zone capable of communicating with the second TV set 705.
When the reference zone is determined as described above, for zone recognition, the portable terminal 701 may collect a target finger print which is a finger print at a current location (step 714), compare it with the reference finger print (step 716), and determine a location of the portable terminal 701.
That is, the portable terminal 701 determines whether the two finger prints are similar to each other by collecting the target finger print which is the finger print for the current location (step 714) and then by comparing the collected target finger print and the pre-stored reference finger print (step 716).
If the reference finger print and the target finger print are similar to each other, the portable terminal 701 may determine that there is a possibility that the current zone is the zone capable of communicating with the TV set.
Thereafter, to improve a zone recognition rate, the portable terminal 701 of the present invention acquires a target image that captures a surrounding environment of a location at which the target finger print is obtained (step 718), and compares the acquired image and a pre-stored reference image (step 720). Accordingly, the portable terminal 701 determines a zone in which the portable terminal is located.
This is to avoid a problem in which correct zone recognition becomes difficult since a plurality of candidate finger prints are generated when the same pattern of the Earth's magnetic field is detected in different zones.
After comparing the reference image and the target image, the portable terminal determines whether it is located in a zone for the first TV set 703 (step 722). If it is determined that the portable terminal 701 is located in the first TV set 703 (i.e., if the reference image is similar to the target image in a first zone), the portable terminal 701 transmits data to the first TV set 703 (step 724). For example, the portable terminal 701 may execute an interworking program which is registered to be executed in the first TV set 703 while being located in the first TV set 703, and thereafter may perform data transmission. Upon receiving the data, the first TV set 703 outputs the received data (step 726).
If it is determined that the portable terminal 701 is not located in the first TV set 703 as a result of comparing the reference image and the target image, the portable terminal 701 determines whether it is located in a zone for the second TV set 705 (step 728).
If the portable terminal 701 is not located in the zone for the first TV set 703 and the zone for the second TV set 705, the process for collecting the target finger print is performed again.
Otherwise, if it is determined that the portable terminal 701 is located in a zone capable of communicating with the second TV set 705, the portable terminal transmits data to the second TV set 705 (step 730), and the second TV set 705 outputs the received data (step 732). Accordingly, a user of the portable terminal 701 may persistently evaluate the data, which is output to the first TV set 703 depending on the movement made in an indoor zone, from the second TV set 705. The portable terminal 701 may execute an interworking application for transmitting data to the second TV set 705 while being located in the zone for the second TV set 705, and thereafter may perform data transmission.
Referring to
A TV set #1 and a TV set #2 are present for the respective rooms, i.e., the first room 700 and the second room 704. The TV sets may automatically establish a communication connection with the portable terminal located in a predetermined zone.
For example, if a user of the portable terminal intends to determine the first zone 702 enabling an automatic connection to the first TV set in the first room 700, the user of the portable terminal is located in the first zone 702 and collects a finger print for the first zone. The finger print for the first zone 702 becomes a reference finger print, and the collected reference finger print is stored in order to be compared with a target finger print. In addition, the portable terminal captures a surrounding environment of a zone in which the reference finger print is collected, and registers the captured image as a reference image.
In addition, in order to determine the second zone 706 enabling an automatic connection with the second TV set in the second room 704, the portable terminal registers a finger print and reference image for the second zone.
After determining the reference zone for each room by collecting the reference finger print and the reference image, the portable terminal persistently collects the target finger print or if there is no movement of the portable terminal, collects the target finger print. That is, the portable terminal collects the target finger print for a zone (or location) to which the user of the portable terminal moves, in order to recognize a current location of the portable terminal. The current location of the portable terminal can be recognized by comparing the collected target finger print and the reference finger print as described above.
The finger print is information capable of identifying the indoor zone, and is an Earth's magnetic field component such as a vertical intensity |Z|, a horizontal intensity |H|, and an azimuth angle D of the portable terminal. Accordingly, by comparing the reference finger print obtained in the first zone 702 and the target finger print corresponding to the current location of the portable terminal, the portable terminal can determine the current location and the predetermined reference zone even if the user moves to anywhere in the indoor zone.
However, if the zone is determined by using only the finger print which is the Earth's magnetic field component, a finger print similar to the reference finger print for the first room can be collected in the second room. That is, although the portable terminal is located in the second room, it can be determined that the portable terminal is located in the first room by using a similar finger print.
In order to solve such a problem, the portable terminal can determine whether the finger print is for a finger print for the first room or a finger print for the second room by using a surrounding environment image at a location where the finger print is collected.
Accordingly, the portable terminal compares the target finger print and the reference finger print. If it is determined that the two finger prints are similar to each other, the portable terminal acquires a surrounding environment image of a current location and compares the acquired image and a pre-stored reference image.
If it is determined that a reference image of the first zone is the same as the acquired target image, it is determined that the portable terminal is located in the first zone and thus data is transmitted to the first TV set.
Thereafter, if the user of the portable terminal moves to the second room 704 while watching data stored in the portable terminal by using the first TV set and thus the portable terminal is located in the second zone 706, the portable terminal compares the persistently collected target finger print and the reference finger print corresponding to the second room 704.
If it is determined that the portable terminal is located within the second zone 706 as a result of comparing the two finger prints, the portable terminal compares a target image and a reference image for the second zone.
If the reference image is the same as the target image, it is determined that the portable terminal is located in the second zone, and photo/video currently being watched are transmitted to the second TV set, so that data stored in the portable terminal can be persistently watched through the second TV set.
Otherwise, if the reference image is not the same as the target image, it can be determined that the portable terminal is not located in the reference zone.
According to exemplary embodiments of the present invention, an apparatus and method for determining a zone of a portable terminal located in an indoor zone are provided. Since an Earth's magnetic field that is generated naturally is measured to determine the indoor zone instead of using a magnetic field generator, an installation cost of a device for recognizing the indoor zone can be decreased.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2010-0050847 | May 2010 | KR | national |
| 10-2011-0012486 | Feb 2011 | KR | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5444669 | Polvani | Aug 1995 | A |
| 6323807 | Golding et al. | Nov 2001 | B1 |
| 7224903 | Colmenarez et al. | May 2007 | B2 |
| 7653212 | Haughawout et al. | Jan 2010 | B2 |
| 8385591 | Anguelov et al. | Feb 2013 | B1 |
| 20030134665 | Kato et al. | Jul 2003 | A1 |
| 20050126023 | Kwon et al. | Jun 2005 | A1 |
| 20050194973 | Kwon et al. | Sep 2005 | A1 |
| 20050231359 | Kampel et al. | Oct 2005 | A1 |
| 20060210169 | Colestock et al. | Sep 2006 | A1 |
| 20070150195 | Koskan et al. | Jun 2007 | A1 |
| 20070279248 | Matsumoto et al. | Dec 2007 | A1 |
| 20080226130 | Kansal et al. | Sep 2008 | A1 |
| 20090247183 | Fahrenthold | Oct 2009 | A1 |
| 20100188280 | Bunch et al. | Jul 2010 | A1 |
| 20110063167 | Gum et al. | Mar 2011 | A1 |
| 20110098056 | Rhoads et al. | Apr 2011 | A1 |
| 20110169947 | Gum et al. | Jul 2011 | A1 |
| 20110227788 | Lundgren et al. | Sep 2011 | A1 |
| Number | Date | Country |
|---|---|---|
| 1651864 | Aug 2005 | CN |
| 101556154 | Oct 2009 | CN |
| 2001311628 | Nov 2001 | JP |
| 2002044763 | Feb 2002 | JP |
| 2002358005 | Dec 2002 | JP |
| 10-2003-0041659 | May 2003 | KR |
| 10-2005-0009092 | Jan 2005 | KR |
| 1020050063469 | Jun 2005 | KR |
| Entry |
|---|
| International Search Report dated Dec. 23, 2011 in connection with International Patent Application No. PCT/KR2011/003967. |
| Written Opinion of International Searching Authority dated Dec. 23, 2011 in connection with International Patent Application No. PCT/KR2011/003967. |
| Translated Japanese Office Action dated Jan. 26, 2015 in connection with Japanese Patent Application No. 2013-513106; 13 pages. |
| Translated Chinese Office Action dated Mar. 26, 2015 in connection with Chinese Patent Application No. 201180026857.5; 12 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20110294517 A1 | Dec 2011 | US |
