Patent Application
20080004892
For the purpose of illustrating the invention, there is shown in the figures a form that is presently preferred; it being understood, however, that this invention is not limited to the precise arrangements and instrumentalities shown.
The present invention provides a biometric aid for customer relations. Biometrics are automated methods of recognizing a person based on physiological or behavioral characteristics. Among the features measured are face, fingerprints, hand geometry, handwriting, iris, retinal, vein, and voice. A biometric system is essentially a pattern recognition system which recognizes a user by determining the authenticity of a specific physiological or behavioral characteristic possessed by the user. Several important issues must be considered in designing a practical biometric system. First, a user must be enrolled in the system so that his biometric template can be captured. This template is securely stored in a central database or a smart card issued to the user. The template is retrieved when an individual needs to be identified. Depending on the context, a biometric system can operate either in a verification (authentication) or an identification mode.
Referring to the drawings, wherein like numerals indicate like elements, there is shown in
The system 10 for welcoming a customer to a retail outlet may further comprise a terminal 100 where a greeter 20/clerk 120 can add additional information about a customer 130 to the database 52. In one embodiment, the system 10 may further comprise a program to recognize known undesirables 80 that notifies security of their presence. In another embodiment, the system 10 may further comprise a program to recognize images of individuals authorized to use a credit/debit card 75. If the person using a credit/debit card does not match the image on file in said database 52 and notifies the clerk 120 and/or security. In still another embodiment, the system may further comprise a program to track the shopping habits of a customer 54.
The system 10 for welcoming a customer to a retail outlet and the customer recognition system 30 may further comprise a camera 40 with either: cross hairs 90,
A customer 130, as used herein, refers to an individual who makes use of or receives the products or services of an individual or organization at a retail outlet. In one embodiment, a customer may refer to an individual who has never purchased a product or service and is merely comparing pricing and merchandise in a retail outlet. In another embodiment, a customer may refer to an individual who frequently purchases products and/or services from a retail outlet.
Retail outlet, as used herein, refers to a location where a customer 130 may go to purchase the products or services of an individual, association or organization. A retail outlet may include, but is not limited to, a store, a kiosk, a mall, a tent, a warehouse, a strip mall, a shopping center, or combinations thereof.
A greeter 20 or clerk 120, as used herein, refers to one or more persons who are employees of a retail outlet. A greeter 20/clerk 120 may also occupy another position within the retail outlet such as a cashier, a manager, or a security guard. In one embodiment, a greeter 20 may refer to an employee permanently positioned near the entrance of a retail outlet. In another embodiment, a greeter 20 may refer to an employee who randomly moves within a retail outlet, greeting customers 130 as he/she meets them. In yet another embodiment, a greeter 20 may refer to a computer generated, virtual person or character who welcomes a customer into a retail outlet. In yet another embodiment, a greeter 20 may refer to a computer controlled robot who welcomes customers into a retail outlet.
A customer recognition system (CRS), as used herein, is a system comprised of a central processing unit (CPU) 50, a camera or a plurality of cameras 40, a database 52, and a biometric face recognition program 70. The CRS may be comprised of three basic components. The first component is a sensor that detects the characteristic being used for identification. In one embodiment the sensors are the camera or the plurality of cameras used to obtain an image of the customer. The second component is a computer that processes and/or stores the information obtained from the sensor. In one embodiment the computer is the CPU and database that processes and/or stores the information obtained from the plurality of cameras. The third component is software that analyzes the characteristic, converts the characteristic into a computer readable format and performs the comparison of new characteristic information with characteristic information on file. In one embodiment, the biometric face recognition program is the software that analyzes the information obtained from the camera or plurality of cameras and compares it with information previously saved in the database.
Additionally, the CRS may be comprised of a credit/debit card reader 60. In one embodiment, the credit/debit card reader 60, like the camera 40, is a sensor used to obtain personal information about the customer. The CPU 50 then associates the information obtained by the credit/debit card reader with the image of the customer and processes and/or stores the customer image and information in the database 52. The biometric face recognition program 70 is the software that analyzes the information obtained by the credit/debit card reader 60 and the camera or plurality of cameras 40 and compares it with information previously on the database 52 to determine the identity of the customer 130.
Operatively associated, as used herein, refers to two or more devices working with one another. Devices may be operatively associated mechanically, by wire, or wirelessly.
A central processing unit (CPU) 50, as used herein, interprets computer program instructions and processes data. CPUs provide the fundamental digital computer trait of programmability, and are one of the necessary components found in computers of any era, along with primary storage (e.g., database) and input/output facilities (e.g., camera, terminal). In one embodiment, one or more CPUs may operate within the CRS. In one embodiment the CPU may be operatively associated with the following items including, but not limited to, a database 52, a camera or a plurality of cameras 40, a camera at a checkout counter 44, a credit/debit card machine 60, a terminal 110, an input terminal 114, an output terminal 118, a program to track the shopping habits of a customer 54, a customer recognition program 70, a program to recognize images of individuals authorized to use a credit/debit card 75, a customer recognition program 80, or combinations thereof.
A camera or a plurality of cameras 40, as used herein, refers to one or more cameras, used separately or together to monitor the retail outlet, improve security, prevent theft, and improve customer relations within a retail outlet. The camera or plurality of cameras 40 may be operatively associated with the CPU 50. A camera at a checkout counter 44 refers to a camera which is temporarily or permanently mounted at or near a checkout counter in a retail outlet. In another embodiment, a camera at a checkout counter 44 may be mounted near a credit/debit card reader 60 in a retail outlet. The type of camera may be selected from the group comprising: digital, film, still, video, webcams, or combinations thereof. In one embodiment, a camera may be equipped with cross hairs 90 to enhance the ability of a camera operator to select the individual or customer they wish to image. In another embodiment, a camera may be equipped with a laser pointer 100 to enhance the ability of a camera operator to select the individual or customer they wish to image. In yet another embodiment, the camera 40 may be controlled by a greeter/clerk by using a keyboard, a mouse, a joystick, a touchpad, a touchscreen, a light pen, a stylus, or combinations thereof.
A database 52, as used herein, refers to a device which is operatively associated with the CPU 50. The database 52 may be a collection of information organized in such a way that a computer program can quickly select desired pieces of data. A database 52 may be an electronic filing system comprised of a structured collection of records or data that is stored in a storage device so that a program can consult it to answer queries. The records retrieved in answer to queries become information that can be used to make decisions. Examples of a storage device include, but are not limited to CD, CD-R, CD-RW, DVD, Flash memory, Floppy disk, Zip Drive, Hard disk drive, Magnetic tape, Paper tape, Punch card, RAM disk, External Hard Drive, Blu-Ray, HD-DVD, Thumb Drive, or combinations thereof. In one embodiment, the database 52 may contain images and information about known individuals, including customers 130, obtained from sources including, but not limited to, local government offices, state government offices, national government offices, foreign government offices, affiliated businesses, non-affiliated businesses, in-store cameras, out-of-store cameras, or combinations thereof. In yet another embodiment, the database 52 may contain images and information about known undesirables from each of the sources listed above. In still another embodiment, the database 52 may contain images, information, and data from sources including, but not limited to, a program for recognizing images of individuals authorized to use a debit/credit card 75, a program for recognizing known undesirables 80, a program to track the shopping habits of a customer 54, a biometric face recognition program 70, known customers from the sources listed above, known undesirables obtained from the sources listed above, or combinations thereof.
A credit/debit card reader 60, as used herein, refers to a device which may be operatively associated with the CPU 50. It is a device which has the ability to extract information from an individual's credit/debit card and send that information to the database 52 to be recorded. Information obtained from said credit/debit card reader 60 refers to customer information selected from the group comprising: a first name, a middle name or initial, a last name, an address, a phone number, or combinations thereof. In one embodiment, a credit/debit card reader may be used to extract personal information from the credit/debit card of a customer at a retail outlet. In another embodiment, the information obtained from the credit/debit card of a retail outlet customer may be combined with a digital image of that customer and stored in a database 52. In yet another embodiment, a credit/debit card reader may be used to extract personal information from any type of magnetic stripe card. In yet another embodiment, a credit/debit card reader may be used to extract personal information from an integrated circuit card (i.e., smart card). In still another embodiment, a credit/debit card reader may be used to extract personal information from a computer chip carried by an individual or implanted into an individual.
A first image, as used herein, refers to the first image captured of a customer 130 by a camera 40. In one embodiment, the first image may be captured by the camera at the checkout counter 44. The first image is stored in a database 52 along with personal information about the customer 130 obtained from the credit/debit card reader 60 during a purchase of goods or services at a retail outlet. Software exists to pick the optimum photo, from a group of photos, for subsequent use in enrollment. In this application multiple cameras take shots of an individual and software/program selects the best digital photo to quote ‘enroll’ the biometric data for general use. Present and ongoing future use of an image requires a high quality image. The system rates images on scale of 1-10, with a 10 being the best image. To use an image for ‘enrollment’ one needs an image with an assigned quality of at least 6.5 or better, for the photo to be used in enrollment. This image quality ensures high accuracy for the best results.
A biometric face recognition program 70, is a computer-driven application for automatically identifying a person from a digital image operatively associated with the CPU 50. It does that by comparing selected facial features in the live image and a facial database. It refers to a computer program with the ability to recognize a face in a digital image and then measure the various features of that face and record them. Every face has numerous, distinguishable landmarks, the different peaks and valleys that make up facial features. Each human face has approximately 80 landmarks. The biometric face recognition program 70 may measure and compare landmarks on a customer's face selected from the group comprising: the distance between the eyes, the width of the nose, the depth of the eye sockets, the shape of the cheekbones, the length of the jaw line, or combinations thereof. These landmarks are measured creating a numerical code which represents the face when it is stored in the database 52.
Additional images, as used herein, refer to images of customers obtained by a camera or plurality of cameras 40 operating within and around the retail outlet. These additional images may be sent to the CPU 50 and compared by the biometric face recognition program 70 with previously captured first images and/or other known individuals (e.g., known undesirables 80). In one embodiment, additional images are compared and discarded. In another embodiment, additional images are compared and stored, or vice versa, in the database 52.
A message, as used herein, refers to information sent from the CPU and/or database 52 to the greeter 20 or clerk 120. The message may be comprised of information about a customer which is detailed below. The message will enable the greeter 20 or clerk 120 to greet the customer with a personal greeting. In one embodiment, the message contains information from the database 52. In another embodiment, the message contains information from the customer recognition program 70. In yet another embodiment, the message contains information from the program to recognize undesirables 80. In yet another embodiment, the message contains information from the program to track the shopping habits of customers 54. In still another embodiment, the message may contain information from the program for recognizing images of individuals authorized to use a debit/credit card 75. In still another embodiment, the message may contain information from one or more of the sources listed above.
Information about a customer may refer to information selected from the group comprising: a first name, a middle name or initial, a last name, a nickname, height, weight, hair color, eye color, skin color, ethnicity, an address, a phone number, an occupation, hobbies, relative's names, employer, employees, friends, hometown, vacation plans, upcoming celebrations (graduations, birthdays, anniversaries, etc.), or combinations thereof. A personal greeting, as used herein, refers to a greeting from a greeter 20 or a clerk 120 employed by a retail outlet to a customer 130 which may include any of the information about a customer previously discussed.
A program for recognizing known undesirables 80, as used herein, is a computer-driven application for automatically identifying a person from a digital image which may operate in conjunction with, or separately from a biometric face recognition program (BFRP). The program for recognizing known undesirables 80 is operatively associated with the CPU 50. Known undesirables are individuals who are known for perpetrating or participating in unscrupulous behaviors or activities. Known undesirables include, but are not limited to, persons with criminal records, terrorists, shoplifters, a person banned from a retail outlet, or combinations thereof. If working separately from the BFRP, the program for recognizing known undesirables operates using the same principals and techniques as the BFRP. If the program for recognizing know undesirables 80 identifies a know undesirable, security may be notified to allow security to monitor the known undesirable or escort them from the retail outlet. Retail outlet security, as used herein, refers to any individual employed by a retail outlet to prevent theft, monitor store employees and customers, and to keep known undesirables out of the retail outlet. In one embodiment, the program for recognizing known undesirables is augmented by an additional database containing images and information about known undesirables from any of the sources detailed above.
A program for recognizing images of individuals authorized to use a debit/credit card 75, as used herein, refers to a computer-driven application for automatically identifying a person from an image which may operate in conjunction with, or separately from a biometric face recognition program (BFRP). The program for recognizing images of individuals authorized to use a debit/credit card is operatively associated with the CPU 50. In one embodiment, the program for recognizing images of individuals authorized to use a debit/credit card 75 may be augmented by an additional database containing images and information about individuals authorized to use a debit/credit card.
A program to track the shopping habits of a customer 54, as used herein, refers to a computer-driven application operatively associated with the CPU 50. The program to track shopping habits of a customer 54 may track behaviors including, but not limited to, purchases, returns, browsing history, shopping frequency, or combinations thereof.
A terminal 110, as used herein, refers to an electronic device operatively associated with the CPU used to input and receive data. The terminal 110 is operatively associated with a greeter 20 or clerk 120. For example, a terminal 110 may be used to input data into a database or CPU and receive data from the database or CPU. The terminal 110 may send and receive data from the database by any method including, but is limited to, mechanically, by-wire, wirelessly, or combinations thereof. In one embodiment, the terminal 110 may be comprised of an input terminal 114 and/or an output terminal 118. An input terminal may be selected from the group comprising: a keyboard, a mouse, a joystick, a touchpad, a touchscreen, a light pen, a stylus, or combinations thereof. In one embodiment, a greeter 20/clerk 120 may use an input terminal to select a customer 130 to image with a camera 40 in a retail outlet. The output terminal may be selected from the group comprising: a cathode ray tube, a projector, electronic paper, light-emitting diode, liquid crystal display, plasma display panel, electroluminescent display, organic light emitting diode, surface-conduction electron-emitter display, laser TV, carbon nanotubes, nanocrystal display, a headset, a portable data terminal, or combinations thereof.
The invention also discloses a biometric face recognition process to be used by a greeter which is comprised of a series of steps. The steps include providing a customer recognition system (CRS) 30, imaging a customer 130 with the CRS 30, determining the customer's identity using the customer image and CRS 30, sending a message from the CRS 30 to the greeter 20 containing the customer's identity and the customer's information when a positive identification is made. The greeter 20 may then greet the customer with a personal greeting.
The biometric face recognition process may further comprise additional steps. The steps include providing a credit/debit card reader 60 operatively associated with the CRS 30. Obtaining information about the customer 130 from the credit/debit card reader 60, followed by associating the customer's image with the information obtained from the credit/debit card reader 60. The customer's image and information obtained by the credit/debit card reader 60 is then stored in the CRS 30.
The invention also discloses an additional biometric face recognition process to be used by a greeter which is comprised of a series of steps. The steps include imaging a customer 130 as said customer enters a retail outlet using one or more of the plurality of cameras 40 from the CRS 30. The image is sent to the CPU 50 where it is compared to previously obtained images (e.g., database images, first images) by the biometric face recognition program 70. If a match is found, the CPU 50 sends a message to the greeter 20 containing the customer's identity and information. The greeter 20 may then greet customer 130 with a personalized greeting. In one embodiment, the greeter 20 is provided with a terminal 110 having an input terminal 114 and an output terminal 118. In another embodiment, the customer 130 may be imaged anywhere within the retail outlet. In yet another embodiment, the customer 130 may be imaged outside of the retail outlet.
The biometric face recognition process may further comprise additional steps. The steps include providing a CPU 50, a camera or a plurality of cameras 40 including a camera at a checkout counter 44, a database 52, a credit/debit card reader 60, and a biometric face recognition program 70. The next step is to image a customer 130 at the checkout counter with the camera at the checkout counter 44 to obtain a first image. The next step is to associate information obtained by the credit/debit card reader 60 to the first image. Then both the information and the image are stored in the database 52. In one embodiment, a database 52 may be compiled and/or augmented over time by imaging customers 130 when a purchase is made and associating information obtained from the credit/debit card reader 60 and storing the customer image and customer information on the database 52.
The biometric face recognition process may further comprise additional steps. The additional steps include providing a program to recognize known undesirables 80. Customers 130 have their image taken as they enter the retail outlet or while inside the retail outlet by one or more of the plurality of cameras 40 from the CRS 30. The images of the customers are sent to the CPU 50 where the biometric face recognition program 70 then compares the new images to identify known undesirables by accessing the program to recognize known undesirables 80. Security may be notified when one or more known undesirables are identified. In one embodiment, the images may be stored in the database 52 or deleted.
The biometric face recognition process may further comprise additional steps. The additional steps include providing a terminal 110 which is operatively associated with the clerk 120 and the CPU 50. A customer's image is taken as the customer 130 walks up to a clerk 120 by one or more of the plurality of cameras 40 from the CRS 30. The image is sent to the CPU 50 wherein it is compared to previously obtained images (e.g., database images, first images) by the biometric face recognition program 70. If a match is found, the CPU 50 sends a message to the clerk 120 via the output terminal 118. The clerk 120 can then greet the customer 130 with a personalized greeting. In one embodiment, the image(s) may be stored in the database 52 or deleted. In another embodiment, the image(s) may be associated with known images and stored in the database 52.
The biometric face recognition process may further comprise additional steps including speaking with the customer 130 and imputing additional data obtained from that conversation about the customer 130 into the database 52 by the greeter 20 or the clerk 120. In one embodiment, the additional data may be entered into the database using an input terminal 114.
The biometric face recognition process may further comprise additional steps. The additional steps include providing a program to recognize images of individuals authorized to use a credit/debit card 75 which is operatively associated with said CPU 50 and said biometric face recognition program. A customer's image is taken as the customer 130 makes a purchase using a credit card. The image is sent to the CPU 50 where the biometric face recognition program 70 compares the image to images of individuals authorized to use a credit/debit card and by accessing the program for recognizing images of individuals authorized to use a debit/credit card 75. Then security can be alerted if person using credit/debit card does not match an existing image.
This system can also use additional cameras that are set up at the check out point and when a customer 130 pays by a credit card the store can take a high quality image of the customer 130 and match that image with the information provided by that customer's credit or debit card. This is then stored in the database 52. When the same customer revisits the store, one or more of the plurality of cameras 40 may image the customer 130, the image is sent to the CPU 50 and compared to existing images by the biometric face recognition program 70, and if a match is found, prompt the greeter 20 to greet the customer 130 by name. Other information can be entered into the store's database 52 by clerks 120 using a terminal 110. For example, if a clerk chats with a customer and finds out the customer's child is graduating from school this information can be imputed into the database 52 and the cashier can use the information when the customer 130 checks out so that the customer's visit to the establishment is more personalized, such as “congratulations” about their child graduating.
The present invention may be embodied in other forms without departing from the spirit and the essential attributes thereof, and, accordingly, reference should be made to the appended claims, rather than to the forgoing specification, as indicated in the scope of the invention.
This application claims the benefit of co-pending provisional application Ser. No. 60/817,873 filed Jun. 30, 2006.
| Number | Date | Country | |
|---|---|---|---|
| 60817873 | Jun 2006 | US |
