Fare collection for public and private transportation systems generally requires that the transit user purchases a ticket prior to entry into the transportation system, followed by the user presenting the purchased ticket at a gate either to a machine (in an automated fare collection system) or to a transit personnel. As transportation systems become burdened with increased ridership, ticketing gates become increasingly congested, causing delays to transit users and increased costs to the transportation systems. Another issue exists where transportation systems are unable to provide a hands-free approach for wheelchair users who may have difficulty presenting a paper ticket prior to entry. Systems and methods for increased efficiency in the area are needed.
Embodiments described herein may include methods, systems, and other techniques for implementing vision-based fare collection. For example, a method may include determining that a user is approaching an entry point. The entry point may define a passageway and separate a non-restricted access area from a restricted access area. The method may also include tracking the location of the user as the user approaches the entry point. The tracking may be performed using a camera. The method may further include determining that the user is permitted to access the restricted access area. In some embodiments, the method may include determining that the user is within a threshold distance from the entry point. The method may also include allowing the user to access the restricted access area via the entry point upon the user being within the threshold distance from the entry point.
In some embodiments, the method may include detecting, using an RFID receiver, an
RFID tag located within a particular distance from the user. The RFID tag may have information linking to an account balance of the user. The method may also include determining that the RFID tag is associated with the user. The method may further include determining that the user is permitted to access the restricted access area based on the information linking to the account balance of the user. In some embodiments, the method may include facilitating tracking, using the RFID receiver, the location of the user as the user approaches the entry point.
The method may also include determining that the user is permitted to access the restricted access area based on the user purchasing a ticket at a ticket vending machine. The method may further include determining that the user is permitted to access the restricted access area based on detection of a portable communications device located within a particular distance from the user. In some embodiments, allowing the user to access the restricted access area includes opening a gate or turnstile at the entry point. The method may also include detecting, using a sensor, one or more unique identifiers associated with the user.
The accompanying drawings, which are included to provide a further understanding of the invention, are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the detailed description serve to explain the principles of the invention. No attempt is made to show structural details of the invention in more detail than may be necessary for a fundamental understanding of the invention and various ways in which it may be practiced.
In the appended figures, similar components and/or features may have the same numerical reference label. Further, various components of the same type may be distinguished by following the reference label with a letter or by following the reference label with a dash followed by a second numerical reference label that distinguishes among the similar components and/or features. If only the first numerical reference label is used in the specification, the description is applicable to any one of the similar components and/or features having the same first numerical reference label irrespective of the suffix.
Various specific embodiments will be described below with reference to the accompanying drawings constituting a part of this specification. It should be understood that, although structural parts and components of various examples of the present disclosure are described by using terms expressing directions, e.g., “front”, “back”, “upper”, “lower”, “left”, “right” and the like in the present disclosure, these terms are merely used for the purpose of convenient description and are determined on the basis of exemplary directions displayed in the accompanying drawings. Since the embodiments disclosed by the present disclosure may be set according to different directions, these terms expressing directions are merely used for describing rather than limiting. Under possible conditions, identical or similar reference numbers used in the present disclosure indicate identical components.
Systems, methods, and techniques are provided in the present disclosure for implementing vision-based fare collection. Vision-based fare collection systems described herein may improve passenger throughput across stations and lines of a city rapid transit system without the need for expanding current transit systems with additional gates and transit personnel. Cameras and/or RFID tags allow passengers to be identified at a distance and allow a hands-free experience for transit users. Passengers may be identified using various sensors that detect one or more unique identifiers associated with the passengers. Passengers may also be identified using the RFID tags which may provide information linking to their account balances. The vision-based fare collection system described herein may be implemented in many types of public and private transportation systems, including airlines, taxis, city buses, long-distance buses, trolleybuses, trams, light rail, rapid transit, people movers, commuter rail, monorail suspension railways, personal rapid transit, ferries, and the like. The term “restricted access area” may have different meanings in different transportation systems. For example, in a light rail transportation system, the restricted access area may include both the inside of the trains and the platforms surrounding the train tracks. In a city bus transportation system, the restricted access area may only include the inside of the bus.
In some embodiments, the vision-based fare collection system described herein may include a barrier placed across a gate. The barrier may be retracted when it is determined that a transit user is properly entering or exiting a restricted access area, or conversely, the barrier may be placed when a transit user is improperly entering or exiting a restricted access area. In some embodiments, gates may be barrierless and may instead include an audible and/or visual alarm to prevent a transit user from improperly entering or exiting a restricted access area.
Used herein, the term “camera” may refer to any optical device for recording video and/or images. Cameras described herein may be stationary, moveable, controllable, motion-activated, laser-triggered, ceiling-mounted, wall-mounted, floor-mounted, digital, analog, and the like.
Used herein, the term “RFID” may refer to any communication technology employing electromagnetic waves, fields, and/or signals to identify and track stationary or moving objects. The term “RFID tag” may refer to any communication device that may be carried by or secured to an object. RFID tags may be passive, active, or battery-assisted passive. Active RFID tags have on-board batteries and periodically or constantly transmit wireless signals with identifying information. Battery-assisted passive RFID tags have small batteries on board and are activated when they are near an RFID reader. Passive RFID tags lack on-board batteries and are instead energized by the wireless signals received from RFID readers. RFID tags may have individual serial numbers or IDs that allow each individual RFID tag to be identified from among a larger group. In some embodiments, an RFID tag may be a credit card sized carrier or a key fob. RFID tags may operate in a 13.56 MHz band (HF), a 900 MHz band (UHF), or a 2.4 GHz band, among others. In some embodiments, UHF tags may co-exist with HF tags and vice-versa. In some embodiments, RFID tags may be used as tokens in an account based system so that only a serial number needs to be read to access an account. In other embodiments, a system may interact with the RFID tags and read and write data to them. For example, instead of an RFID tag containing information for linking to an account via a serial number or ID, the tag may ping back modifiable information regarding a balance. In some embodiments, an RFID tag may support mutual authentication to prevent spoofing or replay attacks. In some embodiments, active RFID tags may be turned on and off by a user pressing a button on or near the RFID tag. For example, a wheelchair user may press a button fixed to their wheelchair to power an active RFID tag. Such embodiments may save power and preserve battery life.
Used herein, the term “RFID reader” may refer to any communication device that may transmit and/or receive wireless signals to or from an RFID tag. The term “RFID reader” may be used interchangeably with the terms “RFID transceiver”, “RFID transmitter”, “RFID receiver”, “transceiver”, “transmitter”, “receiver”, “transmitter antenna”, “receiver antenna”, and “antenna”. For example, in embodiments where several transceivers are disclosed as being ceiling-mounted, some embodiments may include transmitters and/or receivers being ceiling-mounted. Similarly, in embodiments where several antennas are disclosed as being ceiling-mounted, some embodiments may include RFID transceivers, RFID transmitters, and/or RFID receivers being ceiling-mounted.
An RFID transmitter may be a narrow beam antenna or an omnidirectional antenna, which, in some embodiments may cover a 180 degree hemisphere. Similarly, an RFID receiver may be a narrow beamwidth antenna or an omnidirectional antenna. In some embodiments, a narrow beam antenna may be focused to eliminate unfavorable near field patterns. In some embodiments, multiple RFID receivers may share antenna elements in a phased array fashion, or may be individual, larger antennas for different channels. In some embodiments, antennas may have circular polarization so that they can communicate with RFID tags regardless of their orientation.
The station entry 106 may be located at or near an entrance to a transit station. The vision-based fare collection system 100 may include a single station entry or multiple station entries. In some embodiments, the station entry 106 may be RFID enabled such that RFID transceivers 118 may be equipped on or near the station entry 106 and may detect RFID tags carried by passengers as they pass through the station entry 106. In some embodiments, RFID tags carried by passengers may link to an account and/or an account balance of the passengers. In this manner, the vision-based fare collection system 100 may determine whether passengers carrying RFID tags are permitted to access the restricted access area 114.
The ticket vending machine 108 may give passengers an option to exchange payment for a transit fare and/or ticket. Passengers may purchase a single ticket, multiple tickets, or a transit pass associated with a number of tickets or a period of time, among other possible purchasable items. In some embodiments, the ticket vending machine 108 may issue a physical fare. In some embodiments, the ticket vending machine 108 may issue electronic tickets via digital delivery to a an electronic device. In some embodiments, where a passenger purchases a single ticket, the ticket vending machine 108 may not issue a physical ticket or an electronic ticket, and may instead notify the vision-based fare collection system 100 that a passenger 120 has purchased a single ticket and should be permitted to access the restricted access area 114. The ticket vending machine 108 may be located inside and/or outside the transit station, and may include multiple ticket vending machines.
Cameras 110 may be positioned inside and/or outside the transit station to provide visual coverage areas 112 of the walking area of the transit station. In some embodiments, cameras 110 are positioned such that all possible walking areas of the transit station are covered by at least one visual coverage area. In some embodiments, visual coverage areas 112 may overlap significantly with each other and may correspond to different visual angles of the walking area, depending on the positioning of cameras 110. For example, although
In some embodiments, passenger tracking may generally occur according to one of two methods. In the first method (denoted as “Option 1” in
When the passenger 220-1 purchases a ticket at the ticket vending machine 108, the information associated with the passenger 220-1 may be modified so that the passenger 220-1 is designated as permitted to access the restricted access area 114. As the passenger walks from Area A to Area C (visual coverage area 112a to visual coverage area 112c) at transition point 224-2, camera 110a sends transition information to camera 110c and/or to the vision-based fare collection system 200 indicating a location and that the passenger 220-1 is permitted to access the restricted access area 114. A similar step occurs at transition point 224-3. As the passenger 220-1 approaches the gate array 102 and the vision-based fare collection system 200 determines that the passenger 220-1 is near the gate array 102, the passenger 220-1 may be allowed to access the restricted access area 114. In some embodiments, a barrier within the gate array 102 that corresponds to the passenger's path may be retracted so that the passenger may continue to walk at a continuous speed through the gate array 102. After the passenger 220-1 walks through the gate array 102, the barrier that was retracted may be restored to prevent a nearby unpermitted passenger from accessing the restricted access area 114.
In the second method (denoted as “Option 2” in
In some embodiments, the RFID transceivers 324 may emit electromagnetic waves which comprise electromagnetic fields which reach the RFID tag 222. In response to receiving the electromagnetic fields from the RFID transceivers 324, the RFID tag 222 may emit electromagnetic fields containing identification information. Both the electromagnetic fields emitted by the RFID transceivers 324 and the electromagnetic fields emitted by the RFID tag 222 comprise a frequency, phase, and magnitude (i.e., amplitude) at which they are emitted. The values of the frequency, phase, and magnitude of the electromagnetic fields when transmitted by the RFID transceivers 324 may be different than the values that are received by the RFID tag 222. Similarly, the values of the frequency, phase, and magnitude of the electromagnetic fields when transmitted by the RFID tag 222 may be different that the values that are received by the RFID transceivers 324. For example, in general the received electric power by an antenna decreases by 1/D2 where D is the distance between the transmitting antenna and the receiving antenna. Variations in transmitted and received frequency and phase may occur due to the phenomenon known as the Doppler effect, which occurs when a receiving antenna is moving in reference to the transmitting antenna. The RFID transceivers 324 can gather and report a wide range of information to the vision-based fare collection system 300 by analyzing transmitted and received electromagnetic fields, including passenger location, distance, and speed.
As an example, passengers 520-1, 520-2, and 520-3 may approach gate 540 while walking close to each other. Passenger 520-1 may be carrying RFID tag 522-1 and may have previously been determined by the vision-based fare collection system to be permitted to access the restricted access area 114. Passenger 520-2 may be carrying RFID tag 522-2 and may have previously been determined to be permitted to access the restricted access area 114, and passenger 520-3 may not be carrying an RFID tag and may have previously been determined to not be permitted to access the restricted access area 114. In some embodiments, as passengers 520-1, 520-2, and 520-3 approach gate 540, the barrier 104 may be retracted to allow passengers 520-1 and 520-2 to pass through. If passenger 520-3 also passes through gate 540 before the barrier 104 is restored, an audible alarm and/or a visual alarm may be activated. For example, audible alarm 546-1 may output an audible alarm signal. In other embodiments, as passengers 520-1, 520-2, and 520-3 approach gate 540, the vision-based fare collection system may make a determination as to whether the unpermitted passenger, passenger 520-3, is too close to permitted passengers 520-1 and 520-2. If it is determined that passenger 520-3 is too close to either passenger 520-1 or 520-2, both passenger 520-1 and 520-2 may be denied access through gate 540 until passenger 520-3 is no longer too close.
Barrierless gates may have certain advantages over gates with barriers, such as a higher maximum passenger throughput. In some embodiments in which a barrierless gate is employed, an audible and/or a visual alarm may be activated to prevent an unpermitted passenger from accessing the restricted access area 114. For example, gate 542 may include audible alarm 546-2 and visual alarm 544. Visual alarm 544 may include a string of LEDs or displays positioned along one or both gate cabinets of gate 542 which provide a visual indicator as to whether a passenger is permitted or not permitted to access the restricted access area 114.
As an example, passengers 520-4 and 520-5 may approach gate 542 while walking close to each other. Neither passenger may be carrying RFID tags, however passenger 520-4 may have previously been determined by the vision-based fare collection system to be permitted to access the restricted access area 114 while passenger 520-5 may have previously been determined to not be permitted to access the restricted access area 114. In some embodiments, visual alarm 544 may include a string of displays that display either a check mark or an “X” alongside each passenger as they walk through gate 542. For example, because passenger 520-4 is permitted, check marks are displayed on both the left and right gate cabinets as he/she walks through gate 542. In contrast, because passenger 520-5 is not permitted, at least one “X” is displayed on both the left and right gate cabinets as he/she walks through gate 542. Visual alarm 544 can assist transit personnel to distinguish between permitted and unpermitted passengers that pass through barrierless gate 542.
The computer system 900 is shown comprising hardware elements that can be electrically coupled via a bus 905, or may otherwise be in communication, as appropriate. The hardware elements may include one or more processors 910, including without limitation one or more general-purpose processors and/or one or more special-purpose processors such as digital signal processing chips, graphics acceleration processors, and/or the like; one or more input devices 915, which can include without limitation a mouse, a keyboard, a camera, and/or the like; and one or more output devices 920, which can include without limitation a display device, a printer, and/or the like.
The computer system 900 may further include and/or be in communication with one or more non-transitory storage devices 925, which can comprise, without limitation, local and/or network accessible storage, and/or can include, without limitation, a disk drive, a drive array, an optical storage device, a solid-state storage device, such as a random access memory (“RAM”), and/or a read-only memory (“ROM”), which can be programmable, flash-updateable, and/or the like. Such storage devices may be configured to implement any appropriate data stores, including without limitation, various file systems, database structures, and/or the like.
The computer system 900 might also include a communications subsystem 930, which can include without limitation a modem, a network card (wireless or wired), an infrared communication device, a wireless communication device, and/or a chipset such as a Bluetooth™ device, an 802.11 device, a WiFi device, a WiMax device, cellular communication facilities, etc., and/or the like. The communications subsystem 930 may include one or more input and/or output communication interfaces to permit data to be exchanged with a network such as the network described below to name one example, other computer systems, television, and/or any other devices described herein. Depending on the desired functionality and/or other implementation concerns, a portable electronic device or similar device may communicate image and/or other information via the communications subsystem 930. In other embodiments, a portable electronic device, e.g. the first electronic device, may be incorporated into the computer system 900, e.g., an electronic device as an input device 915. In some embodiments, the computer system 900 will further comprise a working memory 935, which can include a RAM or ROM device, as described above.
The computer system 900 also can include software elements, shown as being currently located within the working memory 935, including an operating system 940, device drivers, executable libraries, and/or other code, such as one or more application programs 945, which may comprise computer programs provided by various embodiments, and/or may be designed to implement methods, and/or configure systems, provided by other embodiments, as described herein. Merely by way of example, one or more procedures described with respect to the methods discussed above, such as those described in relation to
A set of these instructions and/or code may be stored on a non-transitory computer-readable storage medium, such as the storage device(s) 925 described above. In some cases, the storage medium might be incorporated within a computer system, such as computer system 900. In other embodiments, the storage medium might be separate from a computer system e.g., a removable medium, such as a compact disc, and/or provided in an installation package, such that the storage medium can be used to program, configure, and/or adapt a general purpose computer with the instructions/code stored thereon. These instructions might take the form of executable code, which is executable by the computer system 900 and/or might take the form of source and/or installable code, which, upon compilation and/or installation on the computer system 900 e.g., using any of a variety of generally available compilers, installation programs, compression/decompression utilities, etc., then takes the form of executable code.
It will be apparent to those skilled in the art that substantial variations may be made in accordance with specific requirements. For example, customized hardware might also be used, and/or particular elements might be implemented in hardware, software including portable software, such as applets, etc., or both. Further, connection to other computing devices such as network input/output devices may be employed.
As mentioned above, in one aspect, some embodiments may employ a computer system such as the computer system 900 to perform methods in accordance with various embodiments of the technology. According to a set of embodiments, some or all of the procedures of such methods are performed by the computer system 900 in response to processor 910 executing one or more sequences of one or more instructions, which might be incorporated into the operating system 940 and/or other code, such as an application program 945, contained in the working memory 935. Such instructions may be read into the working memory 935 from another computer-readable medium, such as one or more of the storage device(s) 925. Merely by way of example, execution of the sequences of instructions contained in the working memory 935 might cause the processor(s) 910 to perform one or more procedures of the methods described herein. Additionally or alternatively, portions of the methods described herein may be executed through specialized hardware.
The terms “machine-readable medium” and “computer-readable medium,” as used herein, refer to any medium that participates in providing data that causes a machine to operate in a specific fashion. In an embodiment implemented using the computer system 900, various computer-readable media might be involved in providing instructions/code to processor(s) 910 for execution and/or might be used to store and/or carry such instructions/code. In many implementations, a computer-readable medium is a physical and/or tangible storage medium. Such a medium may take the form of a non-volatile media or volatile media. Non-volatile media include, for example, optical and/or magnetic disks, such as the storage device(s) 925. Volatile media include, without limitation, dynamic memory, such as the working memory 935.
Common forms of physical and/or tangible computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, EPROM, a FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read instructions and/or code.
Various forms of computer-readable media may be involved in carrying one or more sequences of one or more instructions to the processor(s) 910 for execution. Merely by way of example, the instructions may initially be carried on a magnetic disk and/or optical disc of a remote computer. A remote computer might load the instructions into its dynamic memory and send the instructions as signals over a transmission medium to be received and/or executed by the computer system 900.
The communications subsystem 930 and/or components thereof generally will receive signals, and the bus 905 then might carry the signals and/or the data, instructions, etc. carried by the signals to the working memory 935, from which the processor(s) 910 retrieves and executes the instructions. The instructions received by the working memory 935 may optionally be stored on a non-transitory storage device 925 either before or after execution by the processor(s) 910.
The methods, systems, and devices discussed above are examples. Various configurations may omit, substitute, or add various procedures or components as appropriate. For instance, in alternative configurations, the methods may be performed in an order different from that described, and/or various stages may be added, omitted, and/or combined. Also, features described with respect to certain configurations may be combined in various other configurations. Different aspects and elements of the configurations may be combined in a similar manner. Also, technology evolves and, thus, many of the elements are examples and do not limit the scope of the disclosure or claims.
Specific details are given in the description to provide a thorough understanding of exemplary configurations including implementations. However, configurations may be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques have been shown without unnecessary detail in order to avoid obscuring the configurations. This description provides example configurations only, and does not limit the scope, applicability, or configurations of the claims. Rather, the preceding description of the configurations will provide those skilled in the art with an enabling description for implementing described techniques. Various changes may be made in the function and arrangement of elements without departing from the spirit or scope of the disclosure.
Also, configurations may be described as a process which is depicted as a schematic flowchart or block diagram. Although each may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may have additional steps not included in the figure. Furthermore, examples of the methods may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments to perform the necessary tasks may be stored in a non-transitory computer-readable medium such as a storage medium. Processors may perform the described tasks.
Having described several example configurations, various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the disclosure. For example, the above elements may be components of a larger system, wherein other rules may take precedence over or otherwise modify the application of the technology. Also, a number of steps may be undertaken before, during, or after the above elements are considered. Accordingly, the above description does not bind the scope of the claims.
As used herein and in the appended claims, the singular forms “a”, “an”, and “the” include plural references unless the context clearly dictates otherwise. Thus, for example, reference to “a user” includes a plurality of such users, and reference to “the processor” includes reference to one or more processors and equivalents thereof known to those skilled in the art, and so forth.
Also, the words “comprise”, “comprising”, “contains”, “containing”, “include”, “including”, and “includes”, when used in this specification and in the following claims, are intended to specify the presence of stated features, integers, components, or steps, but they do not preclude the presence or addition of one or more other features, integers, components, steps, acts, or groups.
This application is a continuation of U.S. patent application Ser. No. 15/244,631, filed Aug. 23, 2016, entitled “VISION-BASED FARE COLLECTION,” which is a nonprovisional of and claims the benefit of priority to U.S. Provisional Patent Application No. 62/209,266, filed Aug. 24, 2015, entitled “VISION-BASED FARE COLLECTION,” the entire content of each of which is herein incorporated in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
9972149 | Busch-Sorensen et al. | May 2018 | B2 |
20040017929 | Bramblet et al. | Jan 2004 | A1 |
20040036574 | Bostrom | Feb 2004 | A1 |
20060017541 | Nguyen | Jan 2006 | A1 |
20060243796 | Macklin et al. | Nov 2006 | A1 |
20070252001 | Kail et al. | Nov 2007 | A1 |
20070273514 | Winand et al. | Nov 2007 | A1 |
20080208680 | Cho | Aug 2008 | A1 |
20090119213 | Hammad et al. | May 2009 | A1 |
20110001606 | Charych | Jan 2011 | A1 |
20120278137 | Dixon et al. | Nov 2012 | A1 |
20150012436 | Poole et al. | Jan 2015 | A1 |
20160012465 | Sharp | Jan 2016 | A1 |
Number | Date | Country |
---|---|---|
9923613 | May 1999 | WO |
2017035184 | Mar 2017 | WO |
Entry |
---|
International Search Report and Written Opinion dated Nov. 8, 2016 for PCT/US2016/048305; all pages. |
International Preliminary Report on Patentability dated Mar. 9, 2018 for PCT/US2016/048305; all pages. |
U.S. Appl. No. 15/244,631, “Final Office Action” dated May 1, 2017, 22 pages. |
U.S. Appl. No. 15/244,631, “First Action Interview Office Action Summary” dated Feb. 17, 2017, 21 pages. |
U.S. Appl. No. 15/244,631, “First Action Interview Pilot Program Pre-Interview Communication” dated Dec. 27, 2016, 20 pages. |
U.S. Appl. No. 15/244,631, “Non-Final Office Action” dated Dec. 27, 2017, 24 pages. |
U.S. Appl. No. 15/244,631, “Notice of Allowance” dated Mar. 21, 2018, 13 pages. |
Number | Date | Country | |
---|---|---|---|
20180174386 A1 | Jun 2018 | US |
Number | Date | Country | |
---|---|---|---|
62209266 | Aug 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15244631 | Aug 2016 | US |
Child | 15891196 | US |