The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention. In the drawings:
The present invention will now be described with reference to the accompanying drawings. In the drawings, like reference numbers may indicate identical or functionally similar elements. Additionally, the left-most digit(s) of a reference number may identify the drawing in which the reference number first appears.
The present invention provides computer based tools and methods to evaluate the quality of an airspace sector design. A method of the present invention includes identifying factors contributing to the quality of the airspace sector design, quantifying the factors and calculating a quality metric for the airspace sector design as a function of the quantified factors. The method includes identifying categories for each of the identified factors and identifying parameters for each of the identified categories. Each parameter has an associated weight and a range of associated threshold values. The method further includes determining an associated multiplier from the range of associated threshold values for each identified parameter, calculating a product of the associated weight and the determined multiplier for each identified parameter, and calculating a sum of the products for each identified parameter to obtain a quality metric for an airspace sector design. In an example, all quantitative values used in airspace sector quality evaluation are obtained by leveraging the knowledge of experienced airspace designers. The quantitative values may be stored in a database.
This specification discloses one or more embodiments that incorporate the features of this invention. The embodiment(s) described, and references in the specification to “an example”, “one embodiment”, “an embodiment”, “an example embodiment”, etc., indicate that the embodiment(s) or example(s) described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
An airspace design can be divided into sectors.
In embodiments of the invention, for airspace designs, specific “factors” that describe quality of the airspace design are identified and quantified. Examples of factors include airspace type, flow factors etc. Specific characteristics of a particular factor are referred to as “categories”. Examples of categories include low altitude sectors, high altitude sectors etc. For each category one or more “parameters” are identified. Examples of parameters include instantaneous aircraft count, 15 minute aircraft count etc. Each parameter may have an associated “weight” that is identified and quantified along with a range of associated “thresholds”. “Multipliers” associated with thresholds are also provided. The weight associated with each parameter defines its importance in relation to other parameters. In an example, weights may be on a scale of 1 to 5, with 5 being the most important and I being the least important compared to other parameters. Similarly, in an example, the multipliers associated with the threshold values may be on a scale of −5 to +5. A score of zero may indicate a nominal level of quality in that parameter. Positive values indicate quality better than a nominal level of quality and negative values indicate quality worse than a nominal level of quality.
The second parameter is the total number of aircraft for a fifteen minute period, entered as the peak period of the day. The IAC is the peak count at any given time for the day. The fifteen minute period is the peak period for the day. Traffic files used to determine parameter values reflect a day of normal operations when traffic volume is high for the facility and represents one of the facility's top thirty-seven days.
A fleet mix commonality factor 300b summarizes the impact of fleet mix on airspace design quality, where air traffic control “fleet mix” is a measure of the relative percentages of different types of aircraft for a particular sector. Powered aircraft are included and are divided into three categories (not shown) of props (e.g., piston engine aircrafts and helicopters), turbo-props, and turbojets. The percentage of each aircraft type that makes up the sector traffic is the parameter associated with each category. Commonality is described in greater detail below.
An approach control services factor 300c captures the complexity involved when a sector provides approach control services. It also captures the quality of a sector providing different levels of airport advisory services.
The associated parameter(s) for each category of approach control services factor 300c describes the number of airports in the sector for which these services are provided.
A separation standards factor 300d relates to separation standards other than the basic 5 nautical miles (NM) en route surveillance standard. Separation standards factor 300d includes the category “horizontal” (not shown) which has parameters (not shown) that are classified as a 3 NM parameter and a 3 NM to 5 NM parameter to trigger the calculation of reduced surveillance minima. Separation standards factor 300d also has categories “non-radar” and “transitional” (not shown). There are no thresholds required for the parameters associated with the “non-radar” and “transitional” categories; however, non-radar and transitional categories have a threshold value of 1 to apply the associated parameter multiplier to calculations.
A military traffic factor 300e includes categories (not shown) for different military air traffic operations, such as air re-fueling tracks and Airborne Warning and Control System (AWACS) Orbits that have quantified parameters (not shown). Each military air traffic operation has an associated factor parameter which measures how many of these operations occur within a sector, e.g. the number of air re-fueling tracks and the number of AWACS Orbits within a sector.
The flow factors factor 300f and its associated categories and parameters are discussed in further detail below with regards to
The category of merge points 302a relates to merge points as in merge point 106. Merge points 302a are calculated for each merge within a sector. The category of merge points 302a and its associated parameters are discussed in more detail below with regard to
The category of branch points 302b represents points at which a single flow diverges into two or more flows and are calculated for each branch within a sector. The parameters for branch points are weighted less than those for merge points 302a since separation must be established between flows inbound to the merge point, whereas when a single flow branches from the branch point into two or more flows, separation is required to be maintained only as the flow diverges. Only the number of branches and the number of branches from one flow may be used as parameters of a branch point. Crossing traffic is defined as a combination of a merge and a branch and becomes the sum of the calculated values of merge points and branch points.
The category of random flights 302c relates to flights that do not remain within a limited lateral and vertical section of airspace, and hence do not create a flow of traffic or a pattern. These categories include parameters of: (1) the number of flows impacted by these flights, and (2) whether the impacted flows are climbing or descending.
The category of point outs 302d provides a value for point-outs that are required due to the creation of an airspace shelf. This category and its parameters (not shown) are calculated for each shelf within a sector. Whenever a flight enters a sector, it must be handed-off to the air traffic controller who is responsible for that sector. If a flight crosses a sector boundary and enters an adjacent airspace sector for even a brief period of time, it must still be transferred to the adjacent sector controller. These transfers of control are referred to as “point outs.” The point out parameter measures the number of point-outs per hour, per shelf.
The category of single or bi-directional flows 302e relates to structured or unstructured flows that are procedural and are governed by a Letter of Agreement (LOA), Standard Terminal Arrival Route (STAR), Departure Procedure (DP) or airway definitions. Unstructured flows are user-preferred trajectories that remain within a limited lateral and vertical portion of airspace to create a common flow of traffic. The flow parameters measure several metrics which include but are not limited to distances between adjacent flows, flow fleet mix commonality, number of flows merging, number of flows crossing, and the traffic flow rate. Several other parameters (not shown) may also be defined for flows.
The category of arrivals and departures 302f addresses arrival and departure restrictions required by a LOA between facilities or standard operating procedures within facilities. Arrivals and departures 302f includes parameter arrival compression (not shown) as an aircraft descends and compression created when an aircraft is required to reduce to 250 knots above 10,000 feet. These categories are evaluated for each arrival flow. Arrivals and departures 302f also includes parameter departure spacing (not shown) that often increases as speeds increase above 10,000 feet, with threshold values set by altitude.
The category of boundary runners 302g addresses the distance of a traffic flow from adjacent boundaries or boundary runners. A “boundary runner” refers to an air traffic flow that is located proximate to a sector boundary. Flights that travel within a specific distance from a boundary, such as 5 nautical miles, are typically transferred or “pointed-out” to the adjacent sector controller. Airspace designers typically try to avoid designing sectors with boundary runners because such designs may require additional air traffic control. The boundary runner parameter measures the number of flows which are located within a specific distance from a sector boundary. Such flows are likely to be boundary runners.
Every parameter of a merge point may not apply for every merge point in a sector. Where the merge of a flow begins in one sector and ends in another sector, only those factors of the merge point are measured that impact the sector being studied to correctly measure airspace quality. Parameters 304a and 304b are described below.
The parameter of number of merges 304a, measures the number of merge points in a sector.
The parameter of number of flows at merge 304b measures each flow of a merge against each of the other flows within that merge and repeats for every individual merge in a sector.
Flights in a particular sector flow enter a sector at a specific entry point, and exit at an exit point. The flights in the flow may merge or cross at merge points or crossing points, respectively. The parameter distance from boundary on entry 304c refers to the distance from the sector entry point to the merge point.
The parameter distance from boundary on exit 304d refers to the distance from a particular merge point to the exit point.
The parameters number of flights counting/descending 304f counts the number of flights climbing (gaining altitude), and the number of flights descending (losing altitude).
The parameter distance between merge points 304g, measures the distances between each pair of merge points in nautical miles.
The parameter convergence angle of a flow 304h measures the angle between each pair of merging flows.
In one embodiment, the overall quality score for an airspace design is the weighted sum of selected parameter weights and parameter multipliers. The parameter multipliers are selected as a function of associated parameter threshold values. This overall score is called the “Airspace Quality Metric” (AQM) and is the sum of the products of all relevant parameter weights and parameter multipliers. An airspace design can be evaluated by identifying the individual factors, categories and parameters that apply to the airspace sector design in question, selecting pre-assigned weights and multipliers for each parameter and then computing the AQM.
For example, consider a sector evaluated for the factor Airspace Type, under the category of high altitude and for the parameter Rate-IAC. The data for this factor/category/parameter can be found in the row corresponding to factor ID 5. If the threshold value for parameter Rate-IAC for that sector is 15, then a multiplier of 1 in the column 410d corresponding to the threshold value of 15 is identified. The weight corresponding to the factor Airspace Type, under the category of high altitude and for the parameter Rate-IAC is identified to be 4 under the column parameter weight 408. The parameter multiplier multiplied by the parameter weight gives a partial quality score. In this case, the value is +4 obtained by the product of the parameter multiplier 1 and the parameter weight 4. All partial quality scores for each identified factor/category/parameter are summed by SST 400 to obtain an AQM for an airspace design.
Table 1 below provides another example of a spreadsheet that includes example factors, categories and parameters. Table 1 includes 58 rows that comprise 8 factors and their associated categories, parameters, parameter weights, thresholds and multipliers.
A key factor in sector performance is the commonality of the planned traffic in the sector. Commonality is the degree to which the traffic is homogeneous with respect to aircraft type and performance. Traffic flows that carry a wide mix of aircraft types with different performance characteristics are generally more difficult to handle than flows comprising aircraft with more similar characteristics.
Table 2 below provides examples that may be used to determine the fleet mix commonality for the fleetmix factor 300b. The percentage of each aircraft type that makes up the sector traffic file is the parameter multiplier associated with each category. The commonality number may be entered as multipliers in a spreadsheet as in SST 400 or as in Table 1.
SST 400 may include the information presented in table 2 to assess the degree of commonality. A commonality score is extracted from this table based on the input mix of one, two or three types of aircraft in a stream and the approximate relative proportions of each. The commonality table is in two parts: ultra low, low and surface-to-infinity in the first part and high altitude in the second part. Ultra high sectors have only jet aircraft, so commonality is not an issue and is not evaluated for high sectors.
In an example, a low altitude sector with three types of traffic in approximately equal numbers would receive a commonality score of zero as a worst case. The same sector with only two types of traffic in a 90%/10% proportion would receive a commonality score of 80, reflecting a higher degree of commonality.
In step 412, factor and categories under the column airspace factors 404 are identified for an airspace design. The factors and categories may be identified by user input via a GUI generated by SST 400.
In step 414, one or more parameters 406 are identified for each factor and category identified in step 412. The parameters may be identified by user input via a GUI generated by SST 400.
In step 416, a quality metric such as an AQM is calculated for the airspace sector design in question based on data obtained in steps 412 and 414. The AQM may be calculated based on parameter weights 408 and multipliers 410. An example method of calculating the quality metric is described below with reference to the flowchart in
In one embodiment, an automated Computer Aided Design (CAD) tool is used to create and evaluate airspace designs. The CAD software will support drawing traffic flows and sector shapes, and will evaluate them based on a database of airspace design characteristics. These characteristics comprise a working definition of optimal airspace design characteristics developed by analysts such as airspace designers and operational controllers. The CAD tool is referred to as SETCAT (Sector Evaluation Tool Computer Aided Design Tool) throughout the application. SETCAT greatly enhances the utility of the SET database by adding Geographical Information System (GIS) capabilities with evaluation of the airspace using a database of airspace design characteristics. GIS systems provide a blend of both traditional CAD drawing and geographical database features that are ideally suited to drawing and analyzing airspace designs. Two- and three-dimensional drawing tools are used to create geographically accurate maps of airspace designs. The GIS database may comprise a drawing database, a geographical database and a design characteristics database. GIS database tools may be used to store information about airspace design characteristics. The GIS database may also contain a version of the SET database which may be used with geospatial analysis tools to calculate AQM values for each sector design or for the entire airspace design over multiple sectors.
SETCAT enables analysts to draw airspace designs to scale, and to calculate AQM for the designs. SETCAT also explores the relationships between sector geometry, traffic flows and other sector characteristics. SETCAT supports airspace design creation, modification, and evaluation. It provides a human computer interface to specify airspace design characteristics. The human computer interface may be a GUI. It supports both two-dimensional and three-dimensional views of airspace designs. It accepts user identified factors, categories, parameters, weights and thresholds contributing to the quality of an airspace design. It typically calculates an AQM or similar quality metric for the airspace design under consideration based on the user identified values. The SETCAT tool also facilitates comparisons between different airspace designs by comparing the airspace design under consideration and its quality metric to design metrics stored in the design characteristics database and calculating a comparative quality metric. The design metrics may be other standard airspace designs and/or quality metrics.
Computational unit 508 generates a GUI to allow for user input. Using geographical database 504 and drawing database 502, computational unit 508 creates and displays geographically accurate two- and three-dimensional maps of airspace designs in response to user input. In one embodiment, computational unit 508 may be a processor. SETCAT explores the relationships between sector geometry, traffic flows and other sector characteristics, based on user identified factors, and calculates a quality metric for each airspace sector design using design characteristics database 506. In one embodiment, SETCAT is enabled to compare an airspace sector design quality metric against other quality design metrics to determine a comparative quality metric.
In step 509, a GUI is generated to allow for user input. In one embodiment, the GUI may be generated by computational unit 508 and displayed on a monitor.
In step 510, an airspace sector design is created and/or modified by user input via the GUI generated in step 509. In one embodiment, computational unit 508 may use geographical database 504 and drawing database 502 to create and modify the airspace design according to user input.
In step 512, a two- and/or three-dimensional view of the airspace generated in step 510 is displayed via a GUI on a monitor. The GUI may be the same as in step 509. The GUI may be generated using computational unit 508.
In step 514, one or more quality factors for the airspace sector design created or modified in step 510 are identified. The factors are typically identified by user input.
In step 516, one or more categories are identified for each of the factors identified in step 514. The categories are typically identified via user input.
In step 518, one or more parameters are identified for each of the categories identified in step 516. The parameters are typically identified via user input.
In step 520, a quality metric for the airspace sector design is calculated.
The quality metric may be calculated by computational unit 508 using data from design characteristics database 506. The quality metric may be a function of the factors, categories and parameters identified in steps 514, 516 and 518 respectively. An example method of calculating a quality metric is described below with reference to the flowchart in
In step 522, the design created or modified in step 510 and the quality metric calculated in step 520 are compared against design metrics to determine a comparative quality of the design. In one embodiment, the comparison is made by computational unit 508 using data from design characteristics database 506.
In step 600, a weight and multiplier for each identified parameter are determined. In one embodiment the weight and multiplier are determined by a user.
In step 602, a product of the weight and the multiplier determined for each parameter is calculated. In one embodiment the product may be calculated by SST 400 and in another embodiment the product may be calculated by computational unit 508.
In step 604, the products of weights and multipliers determined in step 602 are summed to obtain a quality metric. In one embodiment, the products may be summed by SST 400 and in another embodiment the product may be calculated by computational unit 508.
The quality metric or AQM may be defined as:
Complexity metric(AQM)=Σ(weightj×multiplierj) (1)
The quality metric may also be defined as:
Airspace Quality Metric(AQM)=f(weightj,mutiplierj) (2)
where f is a function.
In general, the quality metric may be defined as:
Airspace Quality Metric(AQM)=f(quantified factors) (3)
where f is a function.
It is to be appreciated that example ways of calculating the quality metric of an airspace design or airspace sector design from quantified factors are provided for purposes of illustration, and are not intended to be limiting.
Further ways of estimating the quality metric of an airspace design are also within the scope of the present invention. Such further ways of estimating the quality metric of an airspace design may become apparent to persons skilled in the relevant art(s) from the teachings herein. It is also to be appreciated that the quality metric may be calculated for each sector of an airspace design or the entire airspace design over multiple sectors. The quality metric may be calculated for the entire airspace design as a function of the quality metrics for each individual airspace sector design.
The present invention, or portions thereof, can be implemented in hardware, firmware, software, and/or combinations thereof.
The following description of a general purpose computer system is provided for completeness. The present invention can be implemented in hardware, or as a combination of software and hardware. Consequently, the invention may be implemented in the environment of a computer system or other processing system. An example of such a computer system 700 is shown in
Computer system 700 also includes a main memory 705, preferably random access memory (RAM), and may also include a secondary memory 710. The secondary memory 710 may include, for example, a hard disk drive 712, and/or a RAID array 716, and/or a removable storage drive 714, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. The removable storage drive 714 reads from and/or writes to a removable storage unit 718 in a well known manner. Removable storage unit 718, represents a floppy disk, magnetic tape, optical disk, etc. As will be appreciated, the removable storage unit 718 includes a computer usable storage medium having stored therein computer software and/or data.
In alternative implementations, secondary memory 710 may include other similar means for allowing computer programs or other instructions to be loaded into computer system 700. Such means may include, for example, a removable storage unit 722 and an interface 720. Examples of such means may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM, or PROM) and associated socket, and other removable storage units 722 and interfaces 720 which allow software and data to be transferred from the removable storage unit 722 to computer system 700.
Computer system 700 may also include a communications interface 724. Communications interface 724 allows software and data to be transferred between computer system 700 and external devices. Examples of communications interface 724 may include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, etc. Software and data transferred via communications interface 724 are in the form of signals 728 which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface 724. These signals 728 are provided to communications interface 724 via a communications path 726. Communications path 726 carries signals 728 and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link and other communications channels.
The terms “computer program medium” and “computer usable medium” are used herein to generally refer to media such as removable storage drive 714, a hard disk installed in hard disk drive 712, and signals 728. These computer program products are means for providing software to computer system 700.
Computer programs (also called computer control logic) are stored in main memory 708 and/or secondary memory 710. Computer programs may also be received via communications interface 724. Such computer programs, when executed, enable the computer system 700 to implement the present invention as discussed herein. In particular, the computer programs, when executed, enable the processor 704 to implement the processes of the present invention. Where the invention is implemented using software, the software may be stored in a computer program product and loaded into computer system 700 using raid array 716, removable storage drive 714, hard drive 712 or communications interface 724.
In other embodiments, features of the invention are implemented primarily in hardware using, for example, hardware components such as Application Specific Integrated Circuits (ASICs) and gate arrays. Implementation of a hardware state machine so as to perform the functions described herein will also be apparent to persons skilled in the relevant art(s).
Embodiments of the invention may be implemented in hardware, firmware, software, or any combination thereof. Embodiments of the invention may also be implemented as instructions stored on a machine-readable medium, which may be read and executed by one or more processors. A machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computing device). For example, a machine-readable medium may include read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.), and others. Further, firmware, software, routines, instructions may be described herein as performing certain actions. However, it should be appreciated that such descriptions are merely for convenience and that such actions in fact result from computing devices, processors, controllers, or other devices executing the firmware, software, routines, instructions, etc.
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in form and detail can be made therein without departing from the spirit and scope of the invention.
The present invention has been described above with the aid of functional building blocks and method steps illustrating the performance of specified functions and relationships thereof. The boundaries of these functional building blocks and method steps have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed. Any such alternate boundaries are thus within the scope and spirit of the claimed invention. One skilled in the art will recognize that these functional building blocks can be implemented by discrete components, application specific integrated circuits, processors executing appropriate software and the like or any combination thereof. Thus, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
The U.S. government has a paid-up license in this invention and the right in limited circumstances to require the patent owner to license others on reasonable terms as provided for by the terms of 02044206-PW, awarded by The Federal Aviation Administration (FAA).