1. Field of the Invention
The invention described herein relates to data networks, and more particularly, to the use of ethernet over a fiber optic network.
2. Related Art
One of the current trends in data networking is the use of fiber optic media. Moreover, use of ethernet technology is a practical choice for such networks, given that ethernet is well understood and can be supported by available components. The application of ethernet fiber technology to relatively long distance access networks creates problems, however. Among the unresolved problems is how to share bandwidth efficiently and cost-effectively among multiple users in such an environment. A reasonable quality of service for all users is also desirable. Hence there is a need for a system, method, and computer program product by which bandwidth can be managed in an ethernet-based fiber access network, and service can be kept affordable and user-friendly to end users.
This invention addresses management of bandwidth and operational efficiency in a fiber optic, ethernet-based, TDMA communications system. A request/grant process is used to control the use of upstream bandwidth. A sense of time must therefore be shared by a headend and remote end-user devices. The invention provides for a gigabit media-independent interface in a media access controller to detect start-of-frame delimiters in incoming data. This allows for synchronization of a headend and end-user devices. The invention also allows for phase locking a transmit bit rate, at a headend, to the headend's clock. Transmitted data can the be used downstream to derive a local clock. Synchronization can also be maintained by the use of synchronization bytes in MPEG frames and/or variable length frames. Efficient bandwidth usage can also be facilitated by the use of maximum data units in allocating bandwidth in unsolicited grants, and by allowing flexible fragmentation and/or prioritization of internet protocol (IP) packets.
A preferred embodiment of the present invention is now described with reference to the figures, where like reference numbers indicate identical or functionally similar elements. Also in the figures, the left-most digit of each reference number corresponds to the figure in which the reference number is first used. While specific configurations and arrangements are discussed, it should be understood that this is done for illustrative purposes only. A person skilled in the relevant art will recognize that other configurations and arrangements can be used without departing from the spirit and scope of the invention. It will be apparent to a person skilled in the relevant art that this invention can also be employed in a variety of other devices and applications.
In the invention described herein, the use of a time division multiple access (TDMA) architecture allows the sharing of bandwidth among multiple users. The Data Over Cable System Interface Specification (DOCSIS) describes a process through which bandwidth management and other requirements can be achieved in a TDMA setting. The present invention provides means for addressing management of bandwidth, cost control, quality of service, and operational efficiency in a fiber optic, ethernet-based, TDMA communications system.
In general, DOCSIS can be used in communication systems that include a set of remote communications devices connected to a headend device, such that the headend is responsible for the management of communications both to and from the remotes. The headend is responsible for the distribution of information content to the remotes (the so-called “downstream” direction); in addition, the headend is responsible for management of communications in the other direction, from the remotes to the headend (the “upstream” direction). Generally, in addition to sending content to remotes, the headend issues downstream map messages that instruct each remote as to when it can transmit upstream, and what kind of information it can send. In effect, the upstream bandwidth is controlled and allocated by the headend. Any given remote can transmit upstream only after requesting bandwidth and receiving a grant of the bandwidth from the headend. In a time division multiple access (TDMA) environment, bandwidth corresponds to one or more intervals of time. Moreover, the upstream can be organized into a number of channels, with several remotes assigned to each channel. This arrangement allows the headend to manage each upstream communications channel. In this manner, upstream communications are managed so as to maintain order and efficiency and, consequently, an adequate level of service.
In the realm of cable communications, DOCSIS specifies the requirements for interactions between a cable headend and associated remote cable modems. A cable headend is also known as a cable modem termination system (CMTS). DOCSIS consists of a group of specifications that cover operations support systems, management, and data interfaces, as well as network layer, data link layer, and physical layer transport. Note that DOCSIS does not specify an application layer. The DOCSIS specification includes extensive media access layer and physical (PHY) layer upstream parameter control for robustness and adaptability. DOCSIS also provides link layer security with authentication. This prevents theft of service and some assurance of traffic integrity.
The current version of DOCSIS (DOCSIS 1.1) uses a request/grant mechanism for allowing remote devices (such as cable modems) to access upstream bandwidth. DOCSIS 1.1 also allows the provision of different services to different parties who may be tied to a single modem. With respect to the processing of packets, DOCSIS 1.1 allows segmentation of large packets, which simplifies bandwidth allocation. DOCSIS 1.1 also allows for the combining of multiple small packets to increase throughput as necessary. Security features are present through the specification of 56-bit Data Encryption Standard (DES) encryption and decryption, to secure the privacy of a connection. DOCSIS 1.1 also provides for payload header suppression, whereby repetitive ethernet/IP header information can be suppressed for improved bandwidth utilization. DOCSIS 1.1 also supports dynamic channel change. Either or both of the downstream and upstream channels can be changed on the fly. This allows for load balancing of channels, which can improve robustness.
While the present invention is described herein in the context of DOCSIS, it should be understood that the systems and methods discussed below are also applicable in other contexts as well. Generally, these systems and methods are applicable to any fiber access system.
Note that in the discussion below, techniques are organized generally according to their benefit, i.e., cost control, bandwidth management, user-friendliness, and operational efficiency. This does not necessarily represent a limitation on the utility or scope of any of the techniques. A bandwidth management technique may, for example, have benefits with respect to a system's operational efficiency or user-friendliness. The categorization below should therefore not be viewed as any sort of limitation of applicability.
A. Hardware architecture
1. Detection of Reference Point at GMII
This aspect of the invention allows the use of existing, commercially available ethernet physical layer devices in a fiber optic TDMA network operating under DOCSIS. DOCSIS includes a process whereby a headend and associated remote devices become synchronized so that they all share the same sense of time with respect to upstream communications. This synchronization is known in DOCSIS as ranging. Ranging requires that remotes each send a burst of information at a time prescribed by the headend. The headend must then detect whether the burst arrived too soon or too late, relative to the prescribed arrival time. Typically, a specific reference point in the preamble of the burst is used to gauge the burst's arrival. When this point is detected, the burst is considered to have arrived. The start of frame delimiter (SFD) byte in a DOCSIS burst can be used for this purpose.
Commercially available ethernet physical layer devices, however, do not typically have the functionality that allows detection of a burst's reference point. In this invention, the reference point is observed not at the PHY device per se, but rather at the interface of the physical layer device to the media access controller. Because the delay through an ethernet physical layer device is nearly constant, however, it is not necessary for this device to detect the reference point.
In an embodiment of the invention, illustrated in
2. Active PON
Another issue in the use of a fiber access network is the management and allocation of costs in topologies involving relatively long distances (e.g., 20 kilometers or more). One way to address this is to use an active architecture, instead of a passive optical network (PON) approach.
Traditionally, in a PON, transmission of information between a central office and end users, e.g., in their homes, is done through a passive splitter. While this is a workable architecture for relatively short distances, longer distances, up to 20 kilometers and beyond, are problematic. Longer distances require more powerful (and more expensive) light sources.
Instead, an optical node acting as an aggregation device can be used to handle transmissions over longer distances. An embodiment of such a system is shown in
The relatively high cost of the long distance laser can now be shared among users 230. The distribution path from ON 220 to users 230 is relatively cheap, since less power is required for shorter distances. The costs of using a remote device can therefore be lowered by this approach.
Moreover, in an embodiment of the invention, an optical node can accommodate multiple topologies on the user side. This is illustrated in
An embodiment of an ON is shown in
Moreover, in an embodiment of the invention, ON 400 has other interfaces (not shown), to support different kinds of traffic, such as voice, and/or to support circuit emulation.
B. Operational Efficiency
1. Cancellation of Laser Humming
In any optical access system, the light sources (e.g., lasers) may not operate continually. Rather, they can cycle as necessary between a powered operational state and an idle state. In the latter, a laser is not completely powered down. The laser emits light at a low level during idle, and is said to “hum.” Humming adds noise, affecting the signal-to-noise ratio (SNR) of other signals in the system.
This noise can be ameliorated by using an adaptive equalizer. As is known in the art, an adaptive equalizer can be used to cancel noise on a communications channel. Such an equalizer can cancel the humming of a laser during idle, thereby improving the SNR of information-bearing signals. In an embodiment of the invention, an adaptive equalizer is used as illustrated in
2. Spectral Slicing
Spectral slicing is a technique by which multiple users can use different frequency bands of the same broadband laser source for communication. This is illustrated generally in
In such a system there is a tradeoff between the number of subscribers, the bandwidth of the filters required, and the transmit power from each subscriber. There is also a cost tradeoff based on the Q of the filters required. A technique is used in which each subscriber unit has multiple light emitting diodes (LEDs). In an embodiment of the invention, four LEDs are used by subscribers, red, blue, green and yellow. A subscriber can use any one of them for communication with the hub/ON. Since LEDs are very cheap, they will not add significant cost to the subscriber unit. Each unit uses lower Q filtering (representing lower cost) and, as a result, gets to use higher transmit power. The receiver in the ON can split the four different wavelengths using devices like Briggs grating and can demultiplex different subscribers in each wavelength using filters. This enhances the efficiency of bandwidth usage and increases the number of subscribers per port at hub/ON. In addition, this reduces the cost of the overall system.
The split ratio of the PONs can be increased by using signal processing techniques. By using forward error correction (FEC), coding gains on the order of 3-6 dB can be achieved. This can easily double or quadruple the number of subscribers on a single PON. A further improvement of 3 dB can be achieved using adaptive equalization, which can double the subscribers. Since these signal processing techniques can be adding at very little additional cost, the overall cost of the system per subscriber drops significantly.
3. Allocation of Functionality Between Hub and Optical Node
An ON, like any other communications component, has limits as to the functionality that it can incorporate. Factors such as chip size and power dissipation must be considered during system design. DOCSIS, however, requires certain functionality at a headend. This includes timing and sequencing functions, such as ranging. DOCSIS also requires bandwidth allocation processing, such as the generation of map messages. It also requires subscriber service functions, such as authentication and billing.
Because all this functionality can be difficult to put in a single component, a better approach is the dispersal of the functionality. In the context of an optical network such as that of
C. Bandwidth Management
1. Timebase Synchronization
TDMA systems require the maintenance of a time base which is used to determine time slot boundaries, communicate the time base to all the equipment in the system, and chronologically lock equipment to the time base. The current state of the art is exemplified by the DOCSIS specification. In such systems, the headend generates a time base in the form of a time stamp counter driven by a very precise reference oscillator. The headend communicates the time base to one or more remote devices (e.g., cable modems) via periodic synchronization messages. These messages contain the current time stamp counter value. There are several problems with such a system. Among them, time stamps must be sent relatively often, and the time, as maintained at a remote, can drift slowly so that it can move several counts away from the headend's count. Recovering from such a variation can take a long period of time.
One method of maintaining synchronization in a TDMA system is the use of synchronous rate locking to keep the rates of the time stamp counts at the headend and each remote device locked to each other. One embodiment uses ethernet PHY devices at both ends. The transmitting PHY at the headend can be viewed as the master. This method is illustrated in
Other techniques by which time base synchronization can be maintained in a TDMA optical system include an increased frequency of synchronization messages to deal with jitter. This imposes a requirement of the time base generator at the headend to be accurate within 100 picoseconds. This also requires the remote to have tight control on its jitter.
Another option is to use physical layer in-band synchronization using MPEG framing. An MPEG frame has a synchronization byte at the start of the frame. This byte has a specific predetermined synchronization pattern. A remote latches to the periodic synchronization byte to synchronize to the downstream rate. This process is illustrated in
A similar technique can be implemented with variable length packets with the synchronization byte followed by a pointer to the next synchronization byte. This is illustrated in
2. Wavelength Allocation, Video and Data
In the communications systems described herein, bandwidth limitations can be problematic. Given one gigabit per second of downstream bandwidth, for example, 600 megabits could be required for digital video, leaving only 400 megabits for other data traffic. Typically, video and data signals share the bandwidth through a multiplexing arrangement.
An alternative is to allocate different wavelengths to different requirements. For example, one wavelength could be allocated to downstream digital video, while another wavelength would be allocated to downstream non-video data. A third could be allocated to upstream data. This increases the available bandwidth for each requirement, and represents a way to upgrade a traditional PON architecture in light of the need for greater capacity. This is illustrated in
Note that a video transmission from central office 1110 can be a broadcast, so that multiple optical nodes may receive the 81 transmission. Allocation of wavelengths for downstream non-video transmissions (in
3. Hybrid PON: Broadcast Downstream, Point-to-Point Upstream
Another architectural solution to the bandwidth constraint issue is to hybridize broadcast and point-to-point concepts. This is illustrated in
Upstream transmissions take place over multiple wavelengths, one per user, shown here as 8u1 through 8un. Hence the upstream is a point-to-point architecture using wavelength division multiplexing (WDM).
Here, the need for a high-powered laser is limited to the CO 1305, as is the need for wavelength detection functionality. Remote devices, such as CPE 1310, require a high bandwidth receiver (e.g., gigabit), but can operate with a lower bandwidth transmitter (e.g., 10/100 megabit).
4. Subcarrier Multiplexing
Where upstream bandwidth is problematic, each user can be assigned his or her own frequency, such that all user frequencies are associated with a single narrowly defined wavelength range. Frequencies can be offset, for example, by 100 MHz in an embodiment of the invention. This allows autonomous communication for each user, without interference. This is illustrated in
5. PON Protocol Architecture: Reservation Ethernet
One possibility for a protocol architecture for PON is the use of a reservation ethernet approach. Here, a gating transmission is used, based on a request grant mechanism on top of ethernet. This approach is illustrated in
This gating mechanism based on grant messages from the CO (via, e.g., an OLT) to the ON (e.g., ONL) defines a basic communication between the two. Once the CO recognizes the ON, this mechanism assigns a minimum amount of bandwidth to each ON. Additionally, the ON can request more bandwidth as needed. Hence, this mechanism has a contention approach only when the ON is recognized in the system. After this, the access of recognized ONs is contention free. The amount of bandwidth assigned to a recognized ON can be set at a fixed level when the ON is recognized. This amount can be different for each ON depending on the service agreement given to the ON. In addition, the ability to modify this agreement can be defined in order to allow modification of services more dynamically than just during registration time.
Another option for the PON protocol architecture is the use of reservation aloha (request grant mechanism) as the underlying transmission mechanism. The protocol can be defined as a simple version of DOCSIS with the minimum features in it. For example, fragmentation, payload header suppression, and downstream MPEG transport can be eliminated.
Possible relationships between PON arbitration and the 802.3 protocol are illustrated in
6. Limiting PDU Size and Controlling Fragmentation
Under DOCSIS, when a remote receives a grant, it transmits packets in its queue. In DOCSIS there is a one-to-one mapping between the grant and the request. Hence the transmitted packets correspond to the granted bandwidth except for a small amount of bandwidth due to the minislot-to-grant granularity.
This one-to-one mapping is not available if more smart mechanisms are available in the system. For example, the headend may generate additional unsolicited grants. If a flexible use of grants is implemented, any “flow” can use any grant independently of which flow generated the request. In this case, the granted bandwidth can be filled up with packets until no more packets fit. At the end of the burst it will leave a space that may not fit the next packet to be transmitted.
There are generally two options. First, the space can be left unused. This is inefficient. Second, the next packet could be fragmented. Therefore, a system with no fragmentation may be inefficient if the burst lengths are not large enough. On average there is a waste of half of a packet of average size, per burst. Depending on the burst and average packet sizes, this can be a significant waste.
An alternative to the customary fragmentation approach is to coordinate the packetization at a higher protocol level and specify the sizes of unsolicited grants. In other words a maximum data unit (MDU) can be imposed to break the transmitted data into units that can be better handled in the system. This process is illustrated in
Another alternative is to perform fragmentation in a more flexible manner, depending on the bandwidth available. Again, what is typically done at the media access layer is now done at the IP layer. In this alternative, an arriving grant is examined to identify its size. An IP packet is then fragmented so as to fit the grant, and the IP header is modified as necessary. This is illustrated in
7. Using Video Bandwidth for Data
As is apparent from the above discussion, the proper allocation of bandwidth is required to service a set of users that have a variety of needs. Ideally, allocation of bandwidth is flexible to allow servicing of different needs as they arise.
Digital video represents a large amount of data transmitted in a continual stream, and therefore requires significant bandwidth. Accordingly, digital transmissions are generally allocated large amounts of bandwidth by default. But, under some circumstances, requirements for non-video data may be great enough to exceed the default allocations for such data. In this case, bandwidth can be taken from transmissions such as video, and reallocated to data channels that require more bandwidth. This requires monitoring of the demand for non-video data. If a predefined demand threshold is exceeded for non-video data, reallocation takes place. If and when such demand returns to a predefined lower level, the system can return to its default bandwidth allocations. In an embodiment of the invention, the reallocation of video bandwidth for other data transmissions can also depend on whether the demand for video is sufficiently low. This process is illustrated in
8. Allocating Bandwidth with Requests and Grants
In an embodiment of the invention, bandwidth can be allocated flexibly by using a request/grant mechanism. Such an arrangement is currently defined in the DOCSIS 1.1 standard, but the concept can be adapted to a non-DOCSIS system as well. In such an arrangement, a remote device seeking to transmit does so after requesting bandwidth from a central authority, such as a headend or similar module. If bandwidth is available, a grant is made by the central authority to the remote, specifying the bandwidth to be used by the remote (e.g., a specific time interval). This process is illustrated generally in
In an embodiment of the invention, some or all grants can be unsolicited. During registration, bandwidth is allocated according to a fixed assignment policy. As such, the headend can make unsolicited, fixed bandwidth allocations based on state for each remote device. When additional remote devices register, the headend assigns the bandwidth allocation based on availability. In embodiments, the headend dynamically adjusts the bandwidth allocations as the system conditions change, such as remote devices terminating or initiating sessions. The CO keeps the state of the ON bandwidth needs based on the established sessions. In embodiments, the headend dynamically adjusts the bandwidth allocations in response to requests. The adjustment can be in accordance with established dynamic service level agreements with the remote devices.
Contention among remotes for granted bandwidth can be resolved through a priority system or other mechanism. Note that in a TDMA context, the remote and headend must share the same sense of time. This allows a remote's sense of a granted timeslot (starting and ending points) to match that of the headend. Hence a synchronization process may be required prior to any actual request/grant processing.
9. Re-Prioritization of Packets to Use Available Bandwidth
In some communications systems, a priority system is in place to resolve contention for available bandwidth. A packet having the highest priority will generally be allowed to use the bandwidth, instead of other lower priority packets that may need to be sent. In some situations, however, this can be an inefficient arrangement. The highest priority packet may be larger than the amount of available bandwidth. The priority logic dictates that only the highest priority packet can be sent, yet this packet cannot be sent because of its size. In this case, the available bandwidth may go wasted.
To address this, an exception can be made to the normal priority rules. If a lower priority packet will fit the available bandwidth, this packet will be sent instead of the higher priority packet, rather than wasting the bandwidth. In an embodiment of the invention, the packet to be sent can be identified by choosing the highest priority packet among those that fit the available bandwidth. This is illustrated in
A. Video Switching at Optical Node
Users typically desire the ability to readily control what information they access. In the context of downstream digital video, this includes the ability to select a channel for viewing. Current architectures provide for switching at a hub, such as hub 305 of
This creates latency in system response to the user's commands, however, given that the command must go all the way to the hub 305, which must then react. Alternatively, the link 315 carries broadcast video of all transmissions to ON 310. Switching is then performed there, instead of at hub 305. While this requires greater bandwidth between hub 305 and ON 310, the latency of the response to user input is reduced. Moreover, this switching function can also be performed at a central office if, for example, the system does not include an optical node.
B. MPEG Buffering at Optical Node
When MPEG-formatted video is transmitted, a sequence of individual frames is organized into a “group of pictures” (GOP). A GOP begins with an I frame, and is followed by B frames (or T frames, depending on the method of coding). Generally, if a user switches to a transmission at a time when a GOP has already started, i.e., after the I frame, the entire GOP associated with that I frame is inaccessible.
This can be remedied if GOPs are buffered. This is illustrated in
This concept can also be applied in contexts other than optical networks. In general, buffering of video frames at an intermediate node, as described above, can take place in any access network having switched video service. Moreover, buffering can also take place at a central office when, for example, the system topology does not include an ON.
C. Channel Surfing and Proactive Streaming
Given the latency that can occur when a user switches among different video transmissions, the practice of scanning multiple transmissions in sequence (analogous to “channel surfing”) becomes difficult. This can be addressed by making the switching functionality more intelligent. If, for example, switching is done at the ON (as described above), the ON can be made to sense when channel surfing is taking place.
This is illustrated in
This concept can also be applied in contexts other than optical networks. In general, detection of sequential switches and anticipation of future switching at an intermediate node, as described above, can take place in any access network having switched video service. Moreover, this functionality can also be placed in a central office when, for example, the system does not include an ON.
B. Other DOCSIS Variations
Other variations on DOCSIS 1.1 can be used for the sake of economy and computational simplicity. In particular, DOCSIS can be implemented without one or more of the features specified by the standard. For example, packet fragmentation/reconstruction and payload header suppression can be omitted, since these functions can be computationally intensive. Likewise, the packet classification function can be limited. These omissions can make processing faster and can in some circumstances increase available bandwidth.
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in detail can be made therein without departing from the spirit and scope of the invention. Thus the present invention should not be limited by any of the above-described exemplary embodiments.
This application is a divisional of U.S. patent application Ser. No. 10/188,964 filed Jul. 5, 2002, entitled System And Method For Bandwidth Management In Ethernet-Based Fiber Optic TDMA Networks, which claims priority to U.S. Provisional Patent Application No. 60/302,674, filed Jul. 5, 2001, both of which are incorporated herein by reference in their entireties. The following United States and PCT utility patent applications have a common assignee and contain some common disclosure: “System for Communications in Ethernet-Based Fiber Optic TDMA Networks,” U.S. application Ser. No. TBD (Attorney Docket No. 1875.1440001:BP 1909), by Gummalla et al., filed concurrently herewith, incorporated herein by reference;“System for Spectrum Allocation in Ethernet-Based Fiber Optic TDMA Networks,” U.S. application Ser. No. TBD (Attorney Docket No. 1875.1440002:BP 1909), by Sala et al., filed concurrently herewith, incorporated herein by reference;“System, Method, and Computer Program Product for Optimizing Video Service in Ethernet-Based Fiber Optic TDMA Networks,” U.S. application Ser. No. TBD (Attorney Docket No. 1875.1440004:BP 1909), by Gummalla et al., filed concurrently herewith, incorporated herein by reference; and“System, Method, and Computer Program Product for Managing Communications in Ethernet-Based Fiber Optic TDMA Networks,” PCT Application Serial No. TBD (Attorney Docket No. 1875.144PC01:BP 1909), by Gummalla et al., filed concurrently herewith, incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
60302674 | Jul 2001 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10188964 | Jul 2002 | US |
Child | 12407590 | US |