1. Field of the Invention
The present invention relates generally to storage device controllers, and more particularly, to efficiently managing data flow using a WWN module.
2. Background
Conventional computer systems typically include several functional components. These components may include a central processing unit (CPU), main memory, input/output (“I/O”) devices, and streaming storage devices (for example, tape drives/disks) (referred to herein as “storage device”).
In conventional systems, the main memory is coupled to the CPU via a system bus or a local memory bus. The main memory is used to provide the CPU access to data and/or program information that is stored in main memory at execution time. Typically, the main memory is composed of random access memory (RAM) circuits. A computer system with the CPU and main memory is often referred to as a host system.
The storage device is coupled to the host system via a controller that handles complex details of interfacing the storage device to the host system. Communications between the host system and the controller is usually provided using one of a variety of standard I/O bus interfaces.
Typically, when data is read from a storage device, a host system sends a read command to the controller, which stores the read command into a buffer memory. Data is read from the device and stored in the buffer memory.
Various standard interfaces are used to move data from host systems to storage devices. Fibre channel is one such standard. Fibre channel (incorporated herein by reference in its entirety) is an American National Standard Institute (ANSI) set of standards, which provides a serial transmission protocol for storage and network protocols such as HIPPI, SCSI, IP, ATM and others. Fibre channel provides an input/output interface to meet the requirements of both channel and network users.
Host systems often communicate with storage systems using the standard “PCI” bus interface. PCI stands for Peripheral Component Interconnect, a local bus standard that was developed by Intel Corporation®. The PCI standard is incorporated herein by reference in its entirety. Most modern computing systems include a PCI bus in addition to a more general expansion bus (e.g. the ISA bus). PCI is a 64-bit bus and can run at clock speeds of 33 or 66 MHz.
PCI-X is a standard bus that is compatible with existing PCI cards using the PCI bus. PCI-X improves the data transfer rate of PCI from 132 MBps to as much as 1 GBps. The PCI-X standard (incorporated herein by reference in its entirety) was developed by IBM®, Hewlett Packard Corporation® and Compaq Corporation® to increase performance of high bandwidth devices, such as Gigabit Ethernet standard and Fibre Channel Standard, and processors that are part of a cluster.
The iSCSI standard (incorporated herein by reference in its entirety) is based on Small Computer Systems Interface (“SCSI”), which enables host computer systems to perform block data input/output (“I/O”) operations with a variety of peripheral devices including disk and tape devices, optical storage devices, as well as printers and scanners.
A traditional SCSI connection between a host system and peripheral device is through parallel cabling and is limited by distance and device support constraints. For storage applications, iSCSI was developed to take advantage of network architectures based on Fibre Channel and Gigabit Ethernet standards. iSCSI leverages the SCSI protocol over established networked infrastructures and defines the means for enabling block storage applications over TCP/IP networks. iSCSI defines mapping of the SCSI protocol with TCP/IP. The iSCSI architecture is based on a client/server model. Typically, the client is a host system such as a file server that issues a read or write command. The server may be a disk array that responds to the client request.
Serial ATA (“SATA”) is another standard, incorporated herein by reference in its entirety that has evolved from the parallel ATA interface for storage systems. SATA provides a serial link with a point-to-point connection between devices and data transfer can occur at 150 megabytes per second.
Another standard that has been developed is Serial Attached Small Computer Interface (“SAS”), incorporated herein by reference in its entirety. The SAS standard allows data transfer between a host system and a storage device. SAS provides a disk interface technology that leverages SCSI, SATA, and fibre channel interfaces for data transfer. SAS uses a serial, point-to-point topology to overcome the performance barriers associated with storage systems based on parallel bus or arbitrated loop architectures.
The SAS specification addresses all devices in its domain by using a World Wide Name (WWN) address. The WWN is a unique 64-bit field that is allocated by IEEE to storage devices manufacturers.
In a SAS domain there could be up to 256 active devices. The devices could be of Initiator type or Target type. Initiator device initiates an Input/Output process (I/O) by sending a Command frame. The Target device completes an I/O by sending a Response frame. Any Initiator device may have up to 256 active I/O commands at a given time. Before any frame is sent, a connection is established between two SAS devices. A connection consists of an “Open Address” frame with a WWN field in it. On every Open Address, the receiving device compares the Open Address WWN to open I/O commands. Also, every I/O command may have multiple connections.
Typically, storage controllers use a Micro Controller that is 8-bit wide. The foregoing process of tracking connections using the 64-bit WWN addresses is time consuming. Therefore, there is a need for a system and method for efficiently manage connections and effectively use the WWN addresses.
In one aspect of the present invention, a method for managing frames entering or leaving a storage controller is provided. The method includes, comparing frame elements of incoming frames, including a unique World Wide Name (WWN) address with a WWN module entry; and if there is a match, updating a counter value for a connection between the storage controller and a device sending frames. A WWN index value is provided to a processor of the storage controller. The counter value is increased when a command frame is received and decreased when a command is executed and a response is sent to the device.
In yet another aspect of the present invention, a storage controller for transferring data between a host and a Serial Attached Small Computer Interface (“SAS”) device is provided. The storage controller includes: a World Wide Name (“WWN”) module that includes a table having plural entries, wherein each row includes a WWN address, an initiator tag value field, and an input/output counter value that tracks plural commands for a connection. The WWN module uses the WWN index value that represents an address of a row having plural entries.
The WWN module is a part of a link module that interfaces between a transport module and a physical module for transferring information. The WWN index value is smaller than the WWN address and can be read by a micro-controller or processor of the storage controller.
In yet another aspect of the present invention, a WWN module in a storage controller is provided. The WWN module includes, a table having plural entries, wherein each row includes a WWN address, an initiator tag value field, and an input/output counter value that tracks plural commands for a connection.
This brief summary has been provided so that the nature of the invention may be understood quickly. A more complete understanding of the invention can be obtained by reference to the following detailed description of the preferred embodiments thereof concerning the attached drawings.
The foregoing features and other features of the present invention will now be described with reference to the drawings of a preferred embodiment. In the drawings, the same components have the same reference numerals. The illustrated embodiment is intended to illustrate, but not to limit the invention. The drawings include the following Figures:
To facilitate an understanding of the preferred embodiment, the general architecture and operation of a controller will initially be described. The specific architecture and operation of the preferred embodiment will then be described with reference to the general architecture.
As shown in
Controller 101 can be an integrated circuit (IC) that comprises of various functional modules, which provide for the writing and reading of data stored on storage device 110. Buffer memory 111 is coupled to controller 101 via ports to facilitate transfer of data, timing and address information. Buffer memory 111 may be a double data rate synchronous dynamic random access memory (“DDR-SDRAM”) or synchronous dynamic random access memory (“SDRAM”), or any other type of memory.
Disk formatter 104 is connected to microprocessor bus 107 and to buffer controller 108. A direct memory access (“DMA”) DMA interface (not shown) is connected to microprocessor bus 107 and to data and control port (not shown).
Buffer controller (also referred to as “BC”) 108 connects buffer memory 111, channel one (CH1) logic 105, error correction code (“ECC”) module 106 to bus 107. Buffer controller 108 regulates data movement into and out of buffer memory 111.
CH1 logic 105 is functionally coupled to SAS module 103 that is described below in detail. CH1 Logic 105 interfaces between buffer memory 111 and SAS module 103. SAS module 103 interfaces with host interface 104A to transfer data to and from disk 110.
Data flow between a host and disk passes through buffer memory 111 via channel 0 (CH0) logic 106A. ECC module 106 generates ECC that is saved on disk 110 during a write operation and provides correction mask to BC 108 for disk 110 read operation.
The Channels, CH0106A, CH1105 and Channel 2 (not shown) are granted arbitration turns when they are allowed access to buffer memory 111 in high speed burst write or read operations for a certain number of clocks. The channels use first-in-first out (“FIFO”) type memories to store data that is in transit. Firmware running on processor 100 can access the channels based on bandwidth and other requirements.
To read data from device 110, a host system sends a read command to controller 101, which stores the read commands in buffer memory 111. Microprocessor 100 then reads the command out of buffer memory 111 and initializes the various functional blocks of controller 101. Data is read from device 110 and is passed to buffer controller 108.
To write data, a host system sends a write command to disk controller 101, which is stored in buffer 111. Microprocessor 100 reads the command out of buffer 111 and sets up the appropriate registers. Data is transferred from the host and is first stored in buffer 111, before being written to disk 110. Cyclic redundancy code (“CRC”) values are calculated based on a logical block address (“LBA”) for the sector being written. Data is read out of buffer 111, appended with ECC code and written to disk 110.
Frame Structure:
Also, a frame may be an interlock or non-interlocked, specified by field 129E. For an interlock frame, acknowledgement from a host is required for further processing, after the frame is sent to the host. Non-interlock frames are passed through to a host without host acknowledgement (up to 256 frames per the SAS standard).
SAS Module 103:
PHY Module 112:
PHY module 112 includes a serial/deserializer (“SERDES”) 112A that serializes encoded data for transmission (112D), and de-serializes received data (112C). SERDES 112A also recovers a clock signal from incoming data stream 112C and performs word alignment.
PHY control module 112B controls SERDES 112A and provides the functions required by the SATA standard.
Link Module 113:
Link module 113 opens and closes connections, exchanges identity frames, maintains ACK/NAK (i.e. acknowledged/not acknowledged) balance and provides credit control. As shown in
Receive path 118 includes a converter 118C for converting 10-bit data to 8-bit data, an elasticity buffer/primitive detect segment 118B that transfers data from a receive clock domain to a transmit block domain and decodes primitives. Descrambler module 118A unscrambles data and checks for cyclic redundancy check code (“CRC”).
Transmit path 120 includes a scrambler 120A that generates CRC and scrambles (encodes) outgoing data; and primitive mixer module 120B that generates primitives required by SAS protocol/standard and multiplexes the primitives with the outgoing data. Converter 120C converts 8-bit data to 10-bit format.
Link module 113 uses plural state machines 119 to achieve the various functions of its sub-components. State machines 119 includes a receive state machine for processing receive frames, a transmit state machine for processing transmit frames, a connection state machine for performing various connection related functions and an initialization state machine that becomes active after an initialization request or reset.
Transport Module 114:
Transport module 114 interfaces with CH1105 and link module 113. In transmit mode, TRN module 114 receives data from CH 1105, loads the data (with fibre channel header (FCP) 127) in FIFO 125 and sends data to Link module 113 encapsulated with a header (129B) and a CRC value (129D). In receive mode, TRN MODULE 114 receives data from link module 113 (in FIFO 124), and re-packages data (extracts header 126 and 128) before being sent to CH 1105. CH1105 then writes the data to buffer 111. State machine 123 is used to co-ordinate data transfer in the receive and transmit paths.
WWN Index Module 119A
WWN Index module 119A, as shown in
When an Open Address frame is received, the WWN address 129A (WWN address field) of the received frame is compared with the WWN address field (200) in module 119A. A successful comparison returns a WWN index value 205. This WWN index value 205 is provided to MC 115. Since the WWN index value 205 is an 8-bit field, MC 115 can handle it very efficiently.
It is noteworthy that the present invention is not limited to any particular size of module 119A or any of its entries. For example, WWN index value 205 is not limited to an 8-bit value or any other size.
If a WWN address of an Open Address frame is not recognized by module 119A entries and the first frame is of Command type, then a new entry (or row 206) is created and its I/O count 202 is set to one. The new row 206 is allocated a WWN index value 205, so that when a frame from the same source/connection arrives again, then module 119A can return the proper WWN index value (205) after the comparison.
For each frame crossing link module 113, the frame type is checked. If the frame is of Command type, the I/O counter of the active entry is incremented (increased) (202). If the frame is of Response type, the I/O count of the active entry is decremented (decreased). When the I/O count reaches zero, the valid bit 203 is reset and the entry becomes vacant.
“Get Index by WWN” 213 (or signal 213) allows searching of module 119A by WWN address 200 and/or Initiator Tag value 201. MC 115, MC 102 or MP 100 may use this function. If the “Get Index by WWN” function 213 finds an entry that matches a search term (for example, for an incoming frame), then the WWN index value 205 is returned with a “success” flag. If no match is found then a new entry is allocated and the new value is returned. If the table is full based on signal 213, then a “fail” flag is returned. A successful allocation causes the valid bit 203 to be set. The valid bit 203 is cleared fro an entry when the I/O counter value 202 reaches a certain value, for example, 0.
Signal/command “INC by Index” 212 is used to increment the index value 205. Also, MP 100 (or MC 102 or 115) may load a row (for example, 206) by using an index value 205 (by using “Load by Index” command 211). Using “Clear by Index” signal/command 210 clears entries in a row (206).
In step S402, the process determines if a WWN address entry exists. If yes, the process moves to step S404. If an entry does not exist in step S402, then an entry is created in step S403.
In step S404, a WWN index value is established for the entry (WWN index value 205).
In step S405, a frame is received/transmitted by controller 101.
In step S406, the process determines if a frame is of command type. If yes, then I/O counter value 202 is incremented (202B,
If the frame is not of a response type (in step S410), then the connection is closed in step S410 and in step S411, all the entries are de-allocated with the I/O counter value 202 cleared to zero (202A,
In one aspect of the present invention, a dynamic WWN module is provided that dynamically updates connection information. Also, the WWN module provides an easy to use index value that can be used by MC 115, MC 102 and MP 100.
Although the present invention has been described with reference to specific embodiments, these embodiments are illustrative only and not limiting. Many other applications and embodiments of the present invention will be apparent in light of this disclosure.
Number | Name | Date | Kind |
---|---|---|---|
3800281 | Devore et al. | Mar 1974 | A |
3988716 | Fletcher et al. | Oct 1976 | A |
4001883 | Strout et al. | Jan 1977 | A |
4016368 | Apple, Jr. | Apr 1977 | A |
4050097 | Miu et al. | Sep 1977 | A |
4080649 | Calle et al. | Mar 1978 | A |
4156867 | Bench et al. | May 1979 | A |
4225960 | Masters | Sep 1980 | A |
4275457 | Leighou et al. | Jun 1981 | A |
4390969 | Hayes | Jun 1983 | A |
4451898 | Palermo et al. | May 1984 | A |
4486750 | Aoki | Dec 1984 | A |
4500926 | Yoshimaru et al. | Feb 1985 | A |
4587609 | Boudreau et al. | May 1986 | A |
4603382 | Cole | Jul 1986 | A |
4625321 | Pechar et al. | Nov 1986 | A |
4667286 | Young et al. | May 1987 | A |
4777635 | Glover | Oct 1988 | A |
4805046 | Kuroki et al. | Feb 1989 | A |
4807116 | Katzman et al. | Feb 1989 | A |
4807253 | Hagenauer et al. | Feb 1989 | A |
4809091 | Miyazawa et al. | Feb 1989 | A |
4811282 | Masina | Mar 1989 | A |
4812769 | Agoston | Mar 1989 | A |
4860333 | Bitzinger et al. | Aug 1989 | A |
4866606 | Kopetz | Sep 1989 | A |
4881232 | Sako et al. | Nov 1989 | A |
4920535 | Watanabe et al. | Apr 1990 | A |
4949342 | Shimbo et al. | Aug 1990 | A |
4970418 | Masterson | Nov 1990 | A |
4972417 | Sako et al. | Nov 1990 | A |
4975915 | Sako et al. | Dec 1990 | A |
4989190 | Kuroe et al. | Jan 1991 | A |
5014186 | Chisholm | May 1991 | A |
5023612 | Liu | Jun 1991 | A |
5027357 | Yu et al. | Jun 1991 | A |
5050013 | Holsinger | Sep 1991 | A |
5051998 | Murai et al. | Sep 1991 | A |
5068755 | Hamilton et al. | Nov 1991 | A |
5068857 | Yoshida | Nov 1991 | A |
5072420 | Conley et al. | Dec 1991 | A |
5088093 | Storch et al. | Feb 1992 | A |
5109500 | Iseki et al. | Apr 1992 | A |
5117442 | Hall | May 1992 | A |
5127098 | Rosenthal et al. | Jun 1992 | A |
5133062 | Joshi et al. | Jul 1992 | A |
5136592 | Weng | Aug 1992 | A |
5146585 | Smith, III | Sep 1992 | A |
5157669 | Yu et al. | Oct 1992 | A |
5162954 | Miller et al. | Nov 1992 | A |
5193197 | Thacker | Mar 1993 | A |
5204859 | Paesler et al. | Apr 1993 | A |
5218564 | Haines et al. | Jun 1993 | A |
5220569 | Hartness | Jun 1993 | A |
5237593 | Fisher et al. | Aug 1993 | A |
5243471 | Shinn | Sep 1993 | A |
5249271 | Hopkinson | Sep 1993 | A |
5257143 | Zangenehpour | Oct 1993 | A |
5261081 | White et al. | Nov 1993 | A |
5271018 | Chan | Dec 1993 | A |
5274509 | Buch | Dec 1993 | A |
5276564 | Hessing et al. | Jan 1994 | A |
5276662 | Shaver, Jr. et al. | Jan 1994 | A |
5276807 | Kodama et al. | Jan 1994 | A |
5280488 | Glover et al. | Jan 1994 | A |
5285327 | Hetzler | Feb 1994 | A |
5285451 | Henson et al. | Feb 1994 | A |
5301333 | Lee | Apr 1994 | A |
5307216 | Cook et al. | Apr 1994 | A |
5315708 | Eidler et al. | May 1994 | A |
5339443 | Lockwood | Aug 1994 | A |
5361266 | Kodama et al. | Nov 1994 | A |
5361267 | Godiwala et al. | Nov 1994 | A |
5408644 | Schneider et al. | Apr 1995 | A |
5420984 | Good et al. | May 1995 | A |
5428627 | Gupta | Jun 1995 | A |
5440751 | Santeler et al. | Aug 1995 | A |
5465343 | Henson et al. | Nov 1995 | A |
5487170 | Bass et al. | Jan 1996 | A |
5488688 | Gonzales et al. | Jan 1996 | A |
5491701 | Zook | Feb 1996 | A |
5500848 | Best et al. | Mar 1996 | A |
5506989 | Boldt et al. | Apr 1996 | A |
5507005 | Kojima et al. | Apr 1996 | A |
5519837 | Tran | May 1996 | A |
5523903 | Hetzler et al. | Jun 1996 | A |
5544180 | Gupta | Aug 1996 | A |
5544346 | Amini | Aug 1996 | A |
5546545 | Rich | Aug 1996 | A |
5546548 | Chen et al. | Aug 1996 | A |
5563896 | Nakaguchi | Oct 1996 | A |
5572148 | Lytle et al. | Nov 1996 | A |
5574867 | Khaira | Nov 1996 | A |
5581715 | Verinsky et al. | Dec 1996 | A |
5583999 | Sato et al. | Dec 1996 | A |
5592404 | Zook | Jan 1997 | A |
5600662 | Zook et al. | Feb 1997 | A |
5602857 | Zook et al. | Feb 1997 | A |
5615190 | Best et al. | Mar 1997 | A |
5623672 | Popat | Apr 1997 | A |
5626949 | Blauer et al. | May 1997 | A |
5627695 | Prins et al. | May 1997 | A |
5640602 | Takase | Jun 1997 | A |
5649230 | Lentz | Jul 1997 | A |
5664121 | Cerauskis | Sep 1997 | A |
5689656 | Baden et al. | Nov 1997 | A |
5691994 | Acosta et al. | Nov 1997 | A |
5692135 | Alvarez, II et al. | Nov 1997 | A |
5692165 | Jeddeloh et al. | Nov 1997 | A |
5719516 | Sharpe-Geisler | Feb 1998 | A |
5729718 | Au | Mar 1998 | A |
5740466 | Geldman | Apr 1998 | A |
5745793 | Atsatt et al. | Apr 1998 | A |
5754759 | Clarke et al. | May 1998 | A |
5758188 | Applebaum et al. | May 1998 | A |
5784569 | Miller et al. | Jul 1998 | A |
5794073 | Ramakrishnan et al. | Aug 1998 | A |
5801998 | Choi | Sep 1998 | A |
5818886 | Castle | Oct 1998 | A |
5822142 | Hicken | Oct 1998 | A |
5831922 | Choi | Nov 1998 | A |
5835930 | Dobbek | Nov 1998 | A |
5841722 | Willenz | Nov 1998 | A |
5844844 | Bauer et al. | Dec 1998 | A |
5850422 | Chen | Dec 1998 | A |
5854918 | Baxter | Dec 1998 | A |
5890207 | Sne et al. | Mar 1999 | A |
5890210 | Ishii et al. | Mar 1999 | A |
5907717 | Ellis | May 1999 | A |
5912906 | Wu et al. | Jun 1999 | A |
5925135 | Trieu et al. | Jul 1999 | A |
5937435 | Dobbek et al. | Aug 1999 | A |
5950223 | Chiang et al. | Sep 1999 | A |
5968180 | Baco | Oct 1999 | A |
5983293 | Murakami | Nov 1999 | A |
5991911 | Zook | Nov 1999 | A |
6029226 | Ellis et al. | Feb 2000 | A |
6029250 | Keeth | Feb 2000 | A |
6041417 | Hammond et al. | Mar 2000 | A |
6052797 | Ofek et al. | Apr 2000 | A |
6065053 | Nouri et al. | May 2000 | A |
6067206 | Hull et al. | May 2000 | A |
6070200 | Gates et al. | May 2000 | A |
6078447 | Sim | Jun 2000 | A |
6081849 | Born et al. | Jun 2000 | A |
6092231 | Sze | Jul 2000 | A |
6094320 | Ahn | Jul 2000 | A |
6124994 | Malone, Sr. | Sep 2000 | A |
6134063 | Weston-Lewis et al. | Oct 2000 | A |
6157984 | Fisher | Dec 2000 | A |
6178486 | Gill et al. | Jan 2001 | B1 |
6192499 | Yang | Feb 2001 | B1 |
6201655 | Watanabe et al. | Mar 2001 | B1 |
6223303 | Billings et al. | Apr 2001 | B1 |
6279089 | Schibilla et al. | Aug 2001 | B1 |
6297926 | Ahn | Oct 2001 | B1 |
6330626 | Dennin et al. | Dec 2001 | B1 |
6381659 | Proch et al. | Apr 2002 | B2 |
6401149 | Dennin et al. | Jun 2002 | B1 |
6421711 | Blumenau et al. | Jul 2002 | B1 |
6470461 | Pinvidic et al. | Oct 2002 | B1 |
6487631 | Dickinson et al. | Nov 2002 | B2 |
6490635 | Holmes | Dec 2002 | B1 |
6530000 | Krantz et al. | Mar 2003 | B1 |
6574676 | Megiddo | Jun 2003 | B1 |
6606695 | Kamano et al. | Aug 2003 | B2 |
6662334 | Stenfort | Dec 2003 | B1 |
6826650 | Krantz et al. | Nov 2004 | B1 |
6952743 | Ortega et al. | Oct 2005 | B2 |
6957279 | Odenwald et al. | Oct 2005 | B2 |
7359380 | Maufer et al. | Apr 2008 | B1 |
20010044873 | Wilson et al. | Nov 2001 | A1 |
20020138618 | Szabo | Sep 2002 | A1 |
20020161951 | Allen et al. | Oct 2002 | A1 |
20030004981 | Kaneda et al. | Jan 2003 | A1 |
20030037225 | Deng et al. | Feb 2003 | A1 |
20040085994 | Warren et al. | May 2004 | A1 |
20050097271 | Davies et al. | May 2005 | A1 |
20050111378 | Chen et al. | May 2005 | A1 |
20070016716 | Nemoto et al. | Jan 2007 | A1 |
Number | Date | Country |
---|---|---|
0528273 | Feb 1993 | EP |
0622726 | Nov 1994 | EP |
0718827 | Jun 1996 | EP |
2285166 | Jun 1995 | GB |
63-292462 | Nov 1988 | JP |
01-315071 | Dec 1989 | JP |
03183067 | Aug 1991 | JP |
9814861 | Apr 1998 | WO |
Number | Date | Country | |
---|---|---|---|
20060015654 A1 | Jan 2006 | US |