This application claims the benefit under 35 U.S.C. § 119(a) of an Indian patent application filed on May 27, 2015 in the Indian Patent Office and assigned Serial number 2661/CHE/2015, and of a Korean patent application filed on Apr. 7, 2016 in the Korean Intellectual Property Office and assigned Serial number 10-2016-0042937, the entire disclosure of which is hereby incorporated by reference.
The present disclosure relates to indoor positioning techniques. More particularly, the present disclosure relates to a mechanism for identifying a location of an electronic device in an indoor environment by computing an intersection point of determined directions of a plurality of static markers.
Currently, techniques for identifying a location of an electronic device in an enclosed space use various sources of information including wireless signal strength, radio frequency (RF) signal strength, pedestrian tracking systems and/or a combination thereof. For example, in an existing system, a pedestrian dead reckoning technique utilizes heading information of the user to continuously calculate the user's steps taken, step length and the direction of the user information. Based on the calculated movement of the user, the location is updated on a floor map after each step. In another existing system, a Wi-Fi signal or RF signal is used for periodically correcting a position estimate of the user. Based on the calculated position estimation of the user, the location is updated on the floor map after each step.
In another existing system, a position tracking system uses a database of known Wi-Fi transmitters or other unregulated RE transmitters. The database in each case however, must be regularly maintained and updated to provide good accuracy. In some cases, the database can be updated manually. Further, maintenance of the database requires expensive tracking equipment, trained field person to survey locations, and regular updates. Additionally, such approaches do not address changing signal environments or changing signal conditions.
In yet another existing system, a position tracking system utilizes a ray tracing propagation model for indoor signal strength modelling, a sparse extended information filter approach, and other approaches based on dead reckoning, but requires prior information about a shape, layout, and sometimes materials of the location. This approach can work if there are pre-existing maps and shape information that an authoritative source can provide. However, this technique is often too computationally complex to run within the constraints of a mobile device.
The above information is presented as background information only, and to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the present disclosure.
Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages, and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide a method for identifying a location of an electronic device in an indoor environment by computing an intersection point of determined directions of a plurality of static markers.
Another aspect of the present disclosure is to provide an electronic device for identifying a location of the electronic device in the indoor environment by computing an intersection point of determined directions of the plurality of static markers.
Another aspect of the present disclosure is to provide a mechanism for identifying a location of an object in the indoor environment.
In accordance with an aspect of the present disclosure, an indoor environment location identifying method is provided. The indoor environment location identifying method includes obtaining a visibility map of an indoor environment. The visibility map includes a first static marker and a second static marker in the indoor environment. The method further includes determining directions of the first static marker and the second static marker with respect to magnetic north, when a user points an electronic device toward the first static marker and the second static marker. The method further includes identifying a location of the electronic device in the indoor environment by computing an intersection point of the determined directions of the first static marker and the second static marker.
In accordance with another aspect of the present disclosure, an electronic device is provided. The electronic device is configured to obtain a visibility map of an indoor environment. The visibility map includes a first static marker and a second static marker in the indoor environment. The electronic device is further configured to determine directions of the first static marker and the second static marker with respect to magnetic north, when a user points an electronic device toward the first static marker and the second static marker. The electronic device is further configured to identify a location of the electronic device in the indoor environment by computing an intersection point of the determined directions of the first static marker and the second static marker.
In accordance with another aspect of the present disclosure, a computer executable program code recorded on a computer readable non-transitory storage medium is provided. The computer executable program code when executed by a processor, configures the processor to obtain a visibility map of an indoor environment. The visibility map includes a first static marker and a second static marker in the indoor environment. The computer executable program code when executed further configures the processor to determine directions of the first static marker and the second static marker with respect to magnetic north, when a user points an electronic device toward the first static marker and the second static marker. The computer executable program code when executed further configures the processor to identify a location of the electronic device in the indoor environment by computing an intersection point of the determined directions of the first static marker and the second static marker.
Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the present disclosure.
The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the present disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding, but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the spirit and scope of the present disclosure. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used to enable a clear and consistent understanding of the present disclosure. Accordingly, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustration purpose only, and not for the purpose of limiting the present disclosure as defined by the appended claims and their equivalents.
It is to be understood that the singular forms “a”, “an”, and “the”, include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to “a component surface” includes reference to one or more of such surfaces.
Also, the various embodiments described herein are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments. The term “or” as used herein, refers to a non-exclusive or, unless otherwise indicated, The examples used herein are intended merely to facilitate an understanding of ways in which the various embodiments herein can be practiced, and to further enable those skilled in the art to make and practice the various embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the various embodiments herein.
Prior to describing the present disclosure in detail, it may be useful to provide definitions for key terms and concepts used herein, Unless defined otherwise, technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art.
A visibility map as used herein refers to a specific area or areas within a line of sight of an indoor environment. The visibility map can be expressed on a two dimensional (2D) map or three dimensional (3D) map in the form of colored or highlighted areas on the map, but embodiments are not limited thereto. In some cases, the visibility maps in 3D space can be expressed as a 3D construction, limited at least by the line of sight of the indoor environment.
The terms electronic device and mobile device are used interchangeably throughout the description.
The terms indoor environment and an enclosed space are used interchangeably throughout the description.
In the appended aspects or claims, the terms “first static marker”, “second static marker” and “third static marker” are used merely as labels, and are not intended to impose numerical or sequential requirements on their objects. Also, a first location and a second location are used only for illustrative purposes, and do not limit the scope of the disclosure.
The various embodiments disclosed herein achieve an indoor environment location identification method. The method includes obtaining a visibility map of an indoor environment. The visibility map includes at least a first static marker and a second static marker in the indoor environment. Further, the method includes determining directions of the first static marker and the second static marker with respect to magnetic north, when a user points an electronic device toward the first static marker and the second static marker, respectively. Further, the method includes computing an intersection point of the determined directions of the first static marker and the second static marker. Further, the method includes identifying a location of the electronic device in the indoor environment.
The method also includes determining a direction of an object in the indoor environment with respect to a first location of the user and a second location of the user. Further, the method includes computing an intersection point of the determined direction of the object. Still further, the method includes identifying a location of the object in the indoor environment.
In an embodiment of the present disclosure, the object is disposed by further considering vertical placement of the object from a ground surface in the indoor environment.
Unlike systems of the related art, the proposed method identifies a location of the user in the indoor environment using the electronic device, the static markers, and magnetic north. Magnetic north is used in embodiments of the present disclosure, since it is an easily discerned and relatively constant reference variable known to those skilled in the art. Any number of technologies can be used by the elements of the embodiments to identify and/or measure magnetic north, such as a compass. in other embodiments, other suitable reference variables may be used in addition to or in place of magnetic north. The location information of the user in the indoor environment is useful to a smart home control system, where the user will be able to control an object by directly pointing toward the object using the electronic device in a cost effective and quick manner.
The proposed method does not require additional infrastructure (e.g. WiFi router) or generate maps of signal strength (e.g. magnetic field) for the indoor environment. The proposed method is free from effects of magnetic fields apart from the earth's magnetic field. This results in identifying a location of the electronic device(the object) in an accurate and consistent manner.
Referring to the drawings and more particularly to
Referring to
In an embodiment of the present disclosure, the electronic device 104 can be for example, but not limited to, a smart phone, smart watch, ultra-mobile personal computer (UMPC), smart band, smart glasses, smart ring, tablet PC, personal digital assistant (PDA), mapping unit, laptop, or other similar type of electronic device. The object 106a can be for example, but not limited to, a smart television (TV), smart refrigerator, smart air conditioner (AC) unit, smart light, smart oven, and the like. In an embodiment of the present disclosure, the objects 106a to 106c can be connected over a home network protocol for communicating with each other and with components outside the system 100. The indoor environment can be rooms in buildings or any enclosed space.
The electronic device 104 obtains a visibility map of the indoor environment. The visibility map includes a plurality of static markers in the indoor environment. A static marker can be for example, but not limited to, an edge of a wall intersection, ceiling intersection or floor intersection, a door or door edge, a window or window edge, a room corner, room pillars, and the like. In an embodiment of the present disclosure, a static marker can also be an external marker which is installed inside the room including a quick response (QR) code, barcode and the like.
One or more of the static markers are visible to the user from any position inside the indoor environment. The static markers are provided to the electronic device in a structure model form, but embodiments are not limited thereto. A structure model can be a design file, drawing file, or other type of electronic representation that describes an interior configuration of the indoor environment.
After obtaining the visibility map of the indoor environment, the electronic device 104 determines directions of the static markers with respect to magnetic north, when a user 102 points the electronic device 104 toward the static markers, respectively. In an embodiment, the electronic device may have a lengthwise axis and/or first and second ends. Pointing of the electronic device therefore can describe alignment of the axis with a pointing target, and/or facing one of the first or second ends toward the pointing target, but embodiments are not limited thereto. Features of the electronic device can detect a pointing operation, or can be triggered to recognize a pointing operation. For example, if the electronic device is disposed toward a static marker based on a determined reference posture or reference direction, the electronic device can identify an operation of pointing the static marker. The electronic device can be disposed in a reference posture or reference direction (for example, a posture of disposing the top center of the display of the electronic device toward a ceiling, or a posture of disposing the display of the electronic device parallel to a ground surface). According to various embodiments of the present disclosure, the disposition of the electronic device can be identified by a user input after disposing the electronic device in a reference direction. For example, the electronic device can identify the disposition of the electronic device in a reference direction corresponding to the number of individual static markers. In this case, the electronic device can identify the disposition of the electronic device with respect to magnetic north.
Based on the determined directions of the static markers with respect to magnetic north, the electronic device 104 computes an intersection point of the determined directions of the static markers. After computing the intersection point of the determined directions of the static markers, the electronic device 104 identifies a location of the electronic device 104 in the indoor environment at the computed intersection point as illustrated in
The electronic device 104 according to various embodiments of the present disclosure can assign (set) the reference direction to a magnetic (compass) direction. According to the present disclosure, the electronic device 104 can be disposed in a compass direction, and a direction to a static marker can be calculated by receiving an input of each corresponding static marker. For example, the electronic device can receive inputs of directions to each static marker from a user in a state of being disposed corresponding to the compass direction. The electronic device 104 can identify a location of the electronic device 104 based on the input directions to each static marker.
In an embodiment of the present disclosure, the electronic device 104 then determines directions of the object 106a in the indoor environment with respect to a set plurality of locations of the user 102. Based on the determined directions of the object 106a in the indoor environment with respect to the locations of the user 102, the electronic device 104 computes an intersection point of the determined directions of the object 106a. After computing the intersection point of the determined directions of the object 106a, the electronic device 104 identifies a location of the object 106a in the indoor environment at the computed intersection point as illustrated in
In an embodiment of the present disclosure, the object 106a is disposed by also considering vertical placement of the object 106a from a ground surface in the indoor environment.
In an example using a smart watch as the electronic device 104, initially, the smart watch obtains the visibility map of the room of the building. The visibility map includes a first corner and a second corner of the room of the building as static markers. A smart watch may be disposed toward a first corner corresponding to a direction to the first corner with respect to magnetic north. Alternatively, the smart watch may be disposed toward a second corner corresponding to a direction to the second corner with respect to magnetic north. The user 102 points the smart watch toward the first corner to determine the direction of the first corner with respect to magnetic north. Further, the user 102 points the smart watch toward the second corner to determine the direction of the second corner with respect to magnetic north. Any number of technologies can be used by the smart watch to identify and target the static markers, measure magnetic north, and determine the directions of the static markers with respect to magnetic north. Based on the determined directions of the first corner and the second corner, the smart watch computes the intersection point of the determined directions of the first corner and the second corner using, for example, one or more algorithms as described in greater detail below. Based on the computed intersection point, the smart watch then identifies a location of the electronic device in the room of the building at the computed intersection point.
Referring to
Based on the determined directions of the static markers, the location identification unit 208 is configured to compute the intersection point of the determined directions of the static markers. After computing the intersection point of the determined directions of the static markers, the location identification unit 208 is configured to identify a location of the electronic device 104 in the indoor environment at the computed intersection point.
In an embodiment of the present disclosure, the direction determination unit 206 is configured to determine the directions of the object 106a in the indoor environment with respect to the locations of the user 102. Based on the determined directions of the object 106a in the indoor environment with respect to the locations of the user 102, the electronic device 104 computes the intersection point of the determined directions of the object 106a. After computing the intersection point of the determined directions of the object 106a, the location identification unit 208 is configured to identify a location of the object 106a in the indoor environment at the computed intersection point.
In an embodiment of the present disclosure, the object 106a is disposed by also considering vertical placement of the object 106a from the ground surface in the indoor environment.
Referring to
At operation 304, the method includes determining directions of the static markers with respect to magnetic north. In an embodiment, the direction determination unit 206 is used to determine the directions of the static markers with respect to magnetic north by using any existing technique.
At operation 304, the electronic device according to the present disclosure can identify a disposition to a static marker based on a determined reference posture or reference direction. If the electronic device is disposed corresponding to the determined reference posture or reference direction, the electronic device can identify that the electronic device is pointing at the static marker. The electronic device according to various embodiments of the present disclosure can identify that the electronic device has been finally disposed according to a user input if the electronic device is disposed in the reference posture or reference direction. The electronic device according to various embodiments of the present disclosure can identify the disposition of the electronic device corresponding to the number of individual static markers. The electronic device according to the present disclosure can determine the directions of static markers responding to the completion of disposing the electronic device.
Further at operation 304, the electronic device according to the present disclosure can assign (set) the reference direction to a magnetic (compass) direction. The electronic device can be disposed in a compass direction, and directions to each static marker can be calculated by receiving inputs of each corresponding static marker. For example, the electronic device can receive inputs of directions to each static marker from a user in a state of being disposed corresponding to a compass direction. The electronic device 104 can identify a location of the electronic device 104 based on the input directions to each static marker. The electronic device according to the present disclosure can determine directions of each static marker in a state of being disposed corresponding to the compass direction.
At operation 306, the method includes computing the intersection point of the determined directions of the static markers, in an embodiment, the location identification unit 208 is used to compute the intersection point of the determined directions of the static markers.
At operation 308, the method includes identifying a location of an electronic device 104 in the indoor environment. In an embodiment, the location identification unit 208 is used to identifying a location of an electronic device 104 in the indoor environment at or near the intersection point.
At operation 310, the method includes then determining directions of the object 106a in the indoor environment, in an embodiment, the direction determination unit 206 is used to determine the directions of the object 106a in the indoor environment with respect to a plurality of locations of the user 102.
At operation 312, the method includes computing the intersection point of the determined directions of the object 106a. In an embodiment, the location identification unit 208 is used to compute the intersection point of the determined directions of the object 106a. At operation 314, the method includes identifying a location of the object 106a in the indoor environment. In an embodiment, the location identification unit 208 is used to identify a location of the object 106a in the indoor environment at or near the intersection point.
At operation 316, the method includes estimating a height of placement of the object 106a in a 3D space. In an embodiment, the location identification unit 208 is used to estimate the height of placement of the object 106a in the 3D space. In an embodiment, the location identification unit 208 can then be used to identify a location of the object 106a in a 3D manner at or near the intersection point by considering the height of placement of the object 106a.
The various actions, acts, blocks, operations, and the like in the method may be performed in the order presented, in a different order, or in parallel or simultaneously. Further, in some embodiments, some actions, acts, blocks, operations, and the like may be combined, omitted, added, modified, skipped, and the like without departing from the scope of the disclosure.
Referring to
The user 102. then points the electronic device 104 toward the first static marker 402 to determine the direction of the first static marker with respect to magnetic north (NS), An angle θ1 is determined with respect to a direction of the user 102 and the direction of the first static marker 402. The user 102 then points the electronic device 104 toward the second static marker 404 to determine the direction of the second static marker with respect to magnetic north. An angle θ2 is determined with respect to a direction of the user 102 and the direction of the second static marker 404.
Based on the determined directions and angles of the user 102, the first static marker 402, and the second static marker 404, the electronic device 104 computes the intersection point 406 of the determined directions of the first static marker 402 and the second static marker 404. Based on computed intersection point 406 of the determined directions of the first static marker 402 and the second static marker 404, the electronic device 104 identifies a location of the electronic device 104 in the indoor environment at the intersection point 406. The location identification of the electronic device is shown in an identifiable color shade in a circular form at the intersection point 406.
Referring to
A user 102 points the electronic device 104 toward the first static marker 502 to determine the direction of the first static marker with respect to magnetic north (NS). An angle θ1 is determined with respect to a direction of the user 102 and the direction of the first static marker 502. The user 102 then points the electronic device 104 toward the second static marker 504 to determine the direction of the second static marker with respect to magnetic north. An angle θ2 is determined with respect to a direction of the user 102 and the direction of the first static marker 502. The user 102 then points the electronic device 104 toward the third static marker 508 to determine the direction of the third static marker with respect to magnetic north. An angle θ3 is determined with respect to a direction of the user 102 and the direction of the first static marker 402.
Based on the determined directions and angles of the user 102, the first static marker 502, the second static marker 504, and the third static marker 508, the electronic device 104 computes the intersection point 506 of the determined directions of the first static marker 502, the second static marker 504, and the third static marker 508. Based on the computed intersection point 506 of the determined directions of the first static marker 502, the second static marker 504, and the third static marker 508, the electronic device 104 identifies a location of the electronic device 104 in the indoor environment at the intersection point 506. The location identification of the electronic device is shown in an identifiable color shade in a circular form at the intersection point 506. By including more than 2 static markers, The location identification of the electronic device can be performed in a more accurate manner. Any number of static markers can be used.
Referring to
The user is then moved to a second location 620. Here, the user is disposed the same as the procedure described above in regard to
Based on the determined directions and angles of the object 106a in the indoor environment with respect to the first location 610 of the user 102 and the second location 620 of the user 102, the electronic device computes the intersection point 630 of the determined direction of the object 106a. After computing the intersection point 630 of the determined direction of the object 106a, the electronic device 104 identifies a location of the object 106a in the indoor environment at the intersection point 630. Any number of user locations can be used.
Referring to
The electronic device 104 also finds a height H of the object 106a from a ground surface by solving the following Equation 1:
H=U+Dsinθ, Equation (1)
where is the height of the object 106a, U is the height of the user 102, D is the distance between the object 106a and the user 102, and θ is the angle with respect to the position of the user 102 and the object 106a. Based on the vertical height of the object 106a from the ground surface, the electronic device 104 disposes the object 106a in the indoor environment in a 3D manner.
Referring to
The overall computing environment 802 can include multiple homogeneous and/or heterogeneous cores, multiple central processing units (CPUs) of different kinds, special media and other accelerators. The processing unit 808 is responsible for processing the instructions of the algorithms. Further, the plurality of processing units 808 may be located on a single chip or distributed over multiple chips.
The algorithms can include instructions and codes required for the implementation and operations, such as those described above in regard to
In case of hardware implementations, the various networking devices 816 or external I/O devices 814 may be connected to the computing environment 802 to support the implementation through the networking unit and the I/O device unit.
The various embodiments disclosed herein can be implemented through at least one software program running on at least one hardware device and performing network management functions to control the elements. The elements shown in
According to various embodiments of the present disclosure, at least part of a device (for example, modules, units or functions thereof) or a method (for example, operations) according to this disclosure, for example, as in a form of a programming module, may be implemented using an instruction stored in non-transitory computer-readable storage media. When at least one processor (for example, the processing unit 808) executes an instruction, it may perform a function corresponding to the instruction.
The non-transitory computer-readable storage media may include hard disks, floppy disks, magnetic media (for example, magnetic tape), optical media (for example, compact disc read only memory (CD-ROM), and digital versatile disc (DVD)), magneto-optical media (for example, floptical disk), and hardware devices (for example, read only memory (ROM), random access memory (RAM), or flash memory). Additionally, a program instruction may include high-level language code executable by a computer using an interpreter in addition to machine code created by a compiler. The hardware device may be configured to operate as at least one software module to perform an operation of various embodiments and vice versa.
A module or programming module according to various embodiments of the present disclosure may include at least one of the above-mentioned components, may not include some of the above-mentioned components, or may further include another component. Operations performed by a module, programming module, or other components according to various embodiments of the present disclosure may be executed through a sequential, parallel, repetitive or heuristic method. Additionally, some operations may be executed in a different order or may be omitted, and other operations may be added. Moreover, the embodiments disclosed in this specification are suggested for the description and understanding of technical content, but do not limit the range of the present disclosure. Accordingly, the range of the present disclosure should be interpreted as including all modifications or various other embodiments based on the technical idea of the present disclosure.
While the present disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present disclosure as described by the appended claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2661/CHE/2015 | May 2015 | IN | national |
10-2016-0042937 | Apr 2016 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
20030080992 | Haines | May 2003 | A1 |
20060247847 | Carter | Nov 2006 | A1 |
20100253624 | Wilson | Oct 2010 | A1 |
Number | Date | Country | |
---|---|---|---|
20160349349 A1 | Dec 2016 | US |