This application relates to the field of communications, and more particularly, to wireless communications systems and related methods.
Mobile communication systems continue to grow in popularity and have become an integral part of both personal and business communications. Various mobile devices now incorporate Personal Digital Assistant (PDA) features such as calendars, address books, task lists, calculators, memo and writing programs, media players, games, etc. These multi-function devices usually allow electronic mail (email) messages to be sent and received wirelessly, as well as access the Internet via a cellular network and/or a wireless local area network (WLAN), for example.
Some mobile devices incorporate contactless card technology and/or near field communication (NFC) chips. NFC technology is commonly used for contactless short-range communications based on radio frequency identification (RFID) standards, using magnetic field induction to enable communication between electronic devices, including mobile wireless communications devices. This short-range high frequency wireless communications technology exchanges data between devices over a short distance, such as only a few centimeters.
The present description is made with reference to the accompanying drawings, in which embodiments are shown. However, many different embodiments may be used, and thus the claims should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. Like numbers refer to like elements throughout, and prime notation and multiple prime notation are used to indicate similar elements or steps in alternative embodiments.
Generally speaking, a communications system is disclosed herein which may include at least one first near field communication (NFC) device associated with an object, and a mobile wireless communications device. The mobile wireless communications device may include a second NFC device configured to communicate with the at least one first NFC device based upon proximity thereto, an image sensor, and a controller coupled to the second NFC device and the image sensor. The controller may be configured to determine at least one stored image of the object based upon NFC communication between the second NFC device and the at least one first NFC device, determine a sensed image of the object from the image sensor, and perform image comparison between the at least one stored image and the sensed image. The system may therefore advantageously simplify the task of monitoring or tracking objects (e.g., people) through the use of NFC communication and image recognition techniques.
More particularly, the mobile wireless communications device may further include a display coupled to the controller, and the controller may be further configured to display the sensed image on the display along with verification indicia based upon matching of the at least one stored image and the sensed image. Also, the controller may further be configured to display the sensed image on the display along with verification failure indicia based upon failed matching of the at least one stored image and the sensed image.
The at least one NFC device may comprise a plurality of NFC devices each associated with a respective object. As such, the controller may be configured to determine the at least one stored image for each object based upon NFC communication with a respective NFC device, and the controller may be further configured to perform image recognition based upon the stored images and the sensed image. By way of example, the controller may be further configured to determine at least one stored image of the object by downloading the at least one stored image from the at least one NFC device. In accordance with another example, the system may further comprise an object profile server configured to store the at least one stored image, and the controller may be configured to determine the at least one stored image by downloading the at least one stored image from the object profile server.
The controller may also be configured to determine an age of the at least one stored image, and perform image recognition based upon a threshold age. In this way, the controller may “filter” stored images older than a desired age from consideration to help expedite the object recognition processing, for example. By way of example, the object may comprise a face, and the controller may perform image recognition based upon facial features determined from the at least one stored image and the sensed image. In accordance with another example aspect, the at least one NFC device may comprise a plurality of NFC devices for a respective plurality of objects, and the controller may be configured to generate a missing object alert based upon failed matching of the stored images and the sensed image.
A mobile wireless communications device, similar to the one described briefly above, and a related communications method are also provided. The method may include determining at least one stored image of the object at the mobile wireless communications device based upon NFC communication between the second NFC device and the at least one NFC device, determining a sensed image of the object from the image sensor at the mobile wireless communications device, and performing image recognition between the at least one stored image and the sensed image at the mobile wireless communications device.
A related non-transitory computer-readable medium for use with a mobile wireless communications device, such as the one described briefly above, may have computer-executable instructions for causing the mobile wireless communications device to perform various steps. The steps may include communicating with at least one NFC device associated with an object via NFC communication, determining at least one stored image of the object based upon the NFC communication between the second NFC device and the at least one NFC device, determining a sensed image of the object from the image sensor, and performing image recognition between the at least one stored image and the sensed image.
Referring initially to
By way of example, the object associated with the NFC device 31 may be a person, and more particularly a face of the person. For clarity of explanation, the example embodiments described herein will generally be made with reference to human faces being the objects to be recognized through image (i.e., facial) recognition techniques, but it will be appreciated that recognition of other types of objects (e.g., animals, statues, paintings, etc.) may be performed in various embodiments.
By way of background, NFC is a short-range wireless communications technology in which NFC-enabled devices are “swiped,” “bumped” or otherwise moved in close proximity to communicate. In one non-limiting example implementation, NFC may operate at 13.56 MHz and with an effective range of several centimeters, typically 4 cm or less, but other suitable versions of near-field communication which may have different operating frequencies, effective ranges, etc., for example, may also be used.
The mobile device 32 illustratively includes a second NFC device 33 (e.g., an NFC transceiver) configured to communicate with the NFC device 31 based upon proximity thereto using NFC communication, an image sensor 34, and a controller 35 coupled with the second NFC device and the image sensor. By way of example, the image sensor 34 may comprise one or more digital camera or image capture components, such as a lens, a charge-coupled device (CCD), etc. The controller 35 may be implemented using hardware (e.g., processor, memory, etc.) and software components, i.e., computer-readable instructions for causing the mobile device 32 to perform the various functions or operations described herein. The NFC device 31 may be an NFC tag, an NFC-enabled mobile device, etc.
Beginning at Blocks 80, 80′, the controller 35 is configured to determine at least one stored or archived image of the object based upon NFC communication between the second NFC device 33 and the first NFC device 31, at Blocks 81, 81′. More particularly, an archive image may include a previously stored image (e.g., a digital image) of the object in question. Generally speaking, the archive image is an image that may be used for a later image recognition comparison operations. Referring additionally to the example embodiment of the system 30′ shown in
In accordance with another example embodiment now described with reference to
Referring again to
The controller 35 is further configured to determine a sensed image of the object from the image sensor 34, at Blocks 82, 82′. For example, the controller may cause the image sensor 34 to capture a single image or a continuous stream of images, as in the case with taking a digital picture or a digital video. In the example of
Furthermore, the controller 35 is also configured to perform image recognition between the archive image(s) and the sensed image, at Blocks 83, 83′, which illustratively concludes the methods (Block 84, 84′). In the case where the objects to be recognized comprise faces, facial recognition processing techniques may be used to identify or verify a person from a digital image or a video frame from a video source. This may be done by comparing selected facial features from the sensed image and the archived images, which may be stored in a database, for example. Similar recognition processing may be used for other types of objects, such as those discussed above.
In the example illustrated in
Referring additionally to
In some applications, it may also be desirable to filter archived images when performing image recognition to advantageously reduce the number of archive images that require searching to determine matches, and thereby decrease processing time. By way of example, the controller 33 may be configured to determine an age of the archive images, and perform image recognition based a threshold age. In this way, the controller 33 may filter archive images older than a desired age from consideration to help expedite the object recognition processing, for example. This may allow a comparison to be performed using only archived images stored within a prior period of minutes, hours, days, weeks, etc.
In accordance with another example aspect, the controller 33 may also optionally be configured to generate a missing object alert based upon failed matching of the archive images and the sensed image, at Block 87′ (
The above-described embodiments advantageously allow for NFC and AR (Augmented Reality) to provide a basis for tracking people (or other objects), and address a problem of keeping track of people from whom NFC exchanges have occurred. Some examples of where the above-described approach may be used include business meetings or events, chaperoning of groups of children, tour groups, etc. When in a large group, the mobile device 32 may be directed at a group of people, and all of the individuals who have passed along their archived images via respective NFC devices 31 are identified or recognized accordingly. Those who are not are then candidates for establishing NFC communications with their respective NFC devices 31. Another option is that the mobile device 32 may be used to discreetly sense images of people in a group where names have been forgotten, and the AR identification may advantageously be used to provide a reminder of the forgotten names.
In accordance with one example use case, a chaperone may be responsible for a group of twenty students. Each student “bumps” his or her NFC enabled phone or NFC tag to the mobile device of the chaperone at the beginning of the outing. Then, during or after the outing, the chaperone takes a picture of the collection of students with the mobile device camera, and she can see any student that is not there, as described above. If other students have appeared that do not belong in the group, their faces will not be recognized and may be identified by verification failure indicia, as noted above.
Example components of a mobile wireless communications device 1000 that may be used in accordance with the above-described embodiments are further described below with reference to
The housing 1200 may be elongated vertically, or may take on other sizes and shapes (including clamshell housing structures). The keypad may include a mode selection key, or other hardware or software for switching between text entry and telephony entry.
In addition to the processing device 1800, other parts of the mobile device 1000 are shown schematically in
Operating system software executed by the processing device 1800 is stored in a persistent store, such as the flash memory 1160, but may be stored in other types of memory devices, such as a read only memory (ROM) or similar storage element. In addition, system software, specific device applications, or parts thereof, may be temporarily loaded into a volatile store, such as the random access memory (RAM) 1180. Communications signals received by the mobile device may also be stored in the RAM 1180.
The processing device 1800, in addition to its operating system functions, enables execution of software applications 1300A-1300N on the device 1000. A predetermined set of applications that control basic device operations, such as data and voice communications 1300A and 1300B, may be installed on the device 1000 during manufacture. In addition, a personal information manager (PIM) application may be installed during manufacture. The PIM may be capable of organizing and managing data items, such as e-mail, calendar events, voice mails, appointments, and task items. The PIM application may also be capable of sending and receiving data items via a wireless network 1401. The PIM data items may be seamlessly integrated, synchronized and updated via the wireless network 1401 with corresponding data items stored or associated with a host computer system.
Communication functions, including data and voice communications, are performed through the communications subsystem 1001, and possibly through the short-range communications subsystem. The communications subsystem 1001 includes a receiver 1500, a transmitter 1520, and one or more antennas 1540 and 1560. In addition, the communications subsystem 1001 also includes a processing module, such as a digital signal processor (DSP) 1580, and local oscillators (LOs) 1601. The specific design and implementation of the communications subsystem 1001 is dependent upon the communications network in which the mobile device 1000 is intended to operate. For example, a mobile device 1000 may include a communications subsystem 1001 designed to operate with the Mobitex™, Data TAC™ or General Packet Radio Service (GPRS) mobile data communications networks, and also designed to operate with any of a variety of voice communications networks, such as AMPS, TDMA, CDMA, WCDMA, PCS, GSM, EDGE, etc. Other types of data and voice networks, both separate and integrated, may also be utilized with the mobile device 1000. The mobile device 1000 may also be compliant with other communications standards such as 3GSM, 3GPP, UMTS, 4G, etc.
Network access requirements vary depending upon the type of communication system. For example, in the Mobitex and DataTAC networks, mobile devices are registered on the network using a unique personal identification number or PIN associated with each device. In GPRS networks, however, network access is associated with a subscriber or user of a device. A GPRS device therefore typically involves use of a subscriber identity module, commonly referred to as a SIM card, in order to operate on a GPRS network.
When required network registration or activation procedures have been completed, the mobile device 1000 may send and receive communications signals over the communication network 1401. Signals received from the communications network 1401 by the antenna 1540 are routed to the receiver 1500, which provides for signal amplification, frequency down conversion, filtering, channel selection, etc., and may also provide analog to digital conversion. Analog-to-digital conversion of the received signal allows the DSP 1580 to perform more complex communications functions, such as demodulation and decoding. In a similar manner, signals to be transmitted to the network 1401 are processed (e.g. modulated and encoded) by the DSP 1580 and are then provided to the transmitter 1520 for digital to analog conversion, frequency up conversion, filtering, amplification and transmission to the communication network 1401 (or networks) via the antenna 1560.
In addition to processing communications signals, the DSP 1580 provides for control of the receiver 1500 and the transmitter 1520. For example, gains applied to communications signals in the receiver 1500 and transmitter 1520 may be adaptively controlled through automatic gain control algorithms implemented in the DSP 1580.
In a data communications mode, a received signal, such as a text message or web page download, is processed by the communications subsystem 1001 and is input to the processing device 1800. The received signal is then further processed by the processing device 1800 for an output to the display 1600, or alternatively to some other auxiliary I/O device 1060. A device may also be used to compose data items, such as e-mail messages, using the keypad 1400 and/or some other auxiliary I/O device 1060, such as a touchpad, a rocker switch, a thumb-wheel, or some other type of input device. The composed data items may then be transmitted over the communications network 1401 via the communications subsystem 1001.
In a voice communications mode, overall operation of the device is substantially similar to the data communications mode, except that received signals are output to a speaker 1100, and signals for transmission are generated by a microphone 1120. Alternative voice or audio I/O subsystems, such as a voice message recording subsystem, may also be implemented on the device 1000. In addition, the display 1600 may also be utilized in voice communications mode, for example to display the identity of a calling party, the duration of a voice call, or other voice call related information.
The short-range communications subsystem enables communication between the mobile device 1000 and other proximate systems or devices, which need not necessarily be similar devices. For example, the short-range communications subsystem may include an infrared device and associated circuits and components, a Bluetooth™ communications module to provide for communication with similarly-enabled systems and devices, or a near field communications (NFC) sensor for communicating with a NFC device or NFC tag via NFC communications.
Many modifications and other embodiments will come to the mind of one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is understood that various modifications and embodiments are intended to be included within the scope of the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
7362210 | Bazakos et al. | Apr 2008 | B2 |
7362219 | Nogami et al. | Apr 2008 | B2 |
8208681 | Heller et al. | Jun 2012 | B2 |
20060082439 | Bazakos et al. | Apr 2006 | A1 |
20080095527 | Lee et al. | Apr 2008 | A1 |
20090161918 | Heller et al. | Jun 2009 | A1 |
20090185763 | Park et al. | Jul 2009 | A1 |
20120143726 | Chirnomas | Jun 2012 | A1 |
Number | Date | Country |
---|---|---|
1533767 | May 2005 | EP |
Entry |
---|
“The RFID Weblog: RFID Cigarette Vending Machine with Face Recognition Software: Are They Foolproof?” http://www.rfid-weblog.com/50226711/rfid—cigarette—vending—machine . . . Printed Oct. 7, 2010. |
“Patently Apple: Apple Gearing Up for the Coming NFC—iPhone Revolution” http://vvww.patentlyapple.com/patently-apple/2010/04/apple-gearing . . . Printed Oct. 7, 2010. |
N. Jobanputra, V. Kollkarmi, D, Rao, and Jerry Gao, “Emerging Security Technologies for Mobile User Accesses”, Accepted by the electronic Journal on E-Commerce Tools and Applications (eJETA), 2008. |
Number | Date | Country | |
---|---|---|---|
20130012124 A1 | Jan 2013 | US |