Patent Grant
7617271
The present invention relates generally to techniques for managing storage, and in particular to techniques for creation, operation and management of network-based storage services.
Conventional network-based value-added services comprises of more than one service components. For example, outsourcing service of enterprise application over Internet involves network access services via the Internet, hosting service of Web servers and database servers and storage management services. Each service component may be provided by different service providers or may be served by one consolidated service provider. While certain advantages to such conventional approaches are perceived, opportunities for further improvement exist. For example, according to conventional network management technology, managing such complicated service systems, to keep the service up and running, can be a challenging task to the service operators.
What is needed are improved techniques for creation, operation and management of network-based storage services.
The present invention provides techniques for creation, operation and management of network-based storage services. Specific embodiments provide improved efficiency of the service management tasks used for designing, operating and accounting the robust and profitable network services, for example. In representative embodiments, techniques for constructing integrated network and storage services are provided. In a specific embodiment, the service comprises of three major service components: virtual private networks (VPN), application servers and storage area networks (SAN). Each of these service components has its own customer identification information, such as VPN identifier for VPN services, process identifier for application servers and logical unit number (LUN) for storage devices.
In some specific embodiments, service customers are connected to the service provider through VPN. The VPN path that connects customer sites and the data center of the service provider are terminated on a VPN termination device or a VPN router. Within the VPN router, multiple routing processing programs or virtual routers (VR) run independently. The VPN router is connected to the application servers via virtual LAN (VLAN) switch. These application servers are then connected to the service provider's SAN.
The integrated service management system collects management information from individual management systems corresponding to each service components (VPN, servers and SAN) and holds mappings or relationship information between resources in each service component and the customer who is allowed to use those resources. For example, VPN management system is responsible for mapping between VPN customer and VPN path used by that customer. Similarly, server management systems assign a number of servers to a certain customer. Integrated service management systems collect this kind of mapping information between customers and resources within service components. An application programming interface (API), enables software developers to implement management applications using the functionality of the integrated service management systems.
In a representative embodiment according to the present invention, a system is provided. The system comprises a connection to a virtual private network, and a router, which is connected to the virtual private network. The router maintains at least one virtual router for a client. The system further comprises at least one server, and a virtual LAN switch, which is connected to the router. The virtual LAN switch provides selectable forwarding for information from the router to the at least one server. The system also includes at least one volume and an FC switch. The FC switch provides selectable interconnection between the at least one server and the at least one volume, so that information received from a plurality of sources via the virtual private network is directed to a particular virtual router for each of the sources by the router. In some specific embodiments, a virtual private network management system controls operation of the router. The information is then directed to a particular server for each of the sources by the virtual LAN switch. In some specific embodiments, a server management system controls operation of the virtual LAN switch. The information is then directed to a particular volume for each of the sources by the FC switch. In some specific embodiments, a storage management system controls operation of the FC switch.
In a representative specific embodiment, in which a virtual private network management system is used to control the router, the virtual private network management system comprises a network interface module, that receives commands from an integrated service management system, a service order processing module, that analyzes and executes the commands, updates a table of virtual private network information, and sends new configuration information to the router through a control module. In some specific embodiments, the virtual service management system further comprises a virtual private network table. The virtual private network table has a VPN ID that identifies a specific VPN, an Address 1 and an Address 2 that hold IP addresses of two end points of the specific VPN, a Protocol that specifies a VPN protocol that is used on the specific VPN, an Internet that indicates whether access to public Internet is permitted, and a VLAN ID that is assigned to packets received over the specific VPN.
In another representative embodiment, an integrated service management system is used to control operation of other management systems. In a specific embodiment, the integrated service management system comprises a network interface module that receives requests to change configuration, a service order processing module that analyzes and executes requests to change configuration received by the network interface module, updates related table cache in a service management database, and sends new configuration information using the network interface module. In some specific embodiments, the integrated service management system further comprises a service configuration table that stores destination information. In select embodiments, the integrated service management system further comprises a server table that stores a server identification, an address, a virtual LAN identification, an application identification, an operating system identifier, and a CPU information, for example. In some specific embodiments, the integrated service management system further comprises a storage table that stores a volume identifier, a port identifier, a server identifier, a capacity identifier, and an access information. The integrated service management system further comprises a service mapping table that stores a customer identifier, a virtual private network identifier, a server identifier, and a volume identifier in some specific embodiments. In some embodiments, the integrated service management system further comprises a service status table that stores a customer identifier, a virtual private network status, a server status, and a volume status.
In some specific embodiments, an operator console application sends a request command to change service configuration to the integrated management system. In select specific embodiments, a customer portal application sends a request command to change service configuration to the integrated management system.
In another representative embodiment, a method for managing storage is provided. The method comprises receiving a request to change a configuration of an integrated storage and networking system; analyzing the request to determine a new configuration; updating configuration tables to reflect the new configuration; and sending new configuration information to at least one of a plurality of subsystem managers.
In another representative embodiment, a method for managing a configuration for a virtual private network is provided. The method comprises receiving at a subsystem manager a request to change to a new configuration for a virtual private network of an integrated storage and networking system; analyzing the request to determine a new configuration for the virtual private network of the integrated storage and networking system; updating configuration tables to reflect the new configuration; and sending commands to a virtual private network router to implement the new configuration.
In another representative embodiment, a method for managing a configuration for at least one of a plurality of servers is provided. The method comprises receiving at a subsystem manager a request to change to a new configuration for at least one of a plurality of servers in an integrated storage and networking system; analyzing the request to determine a new configuration for the at least one of a plurality of servers in the integrated storage and networking system; updating configuration tables to reflect the new configuration; and sending commands to a virtual LAN switch to implement the new configuration.
In another representative embodiment, a method for managing a configuration for at least one of a plurality of storage devices is provided. The method comprises receiving at a subsystem manager a request to change to a new configuration for at least one of a plurality of storage devices of an integrated storage and networking system; analyzing the request to determine a new configuration for the at least one of a plurality of storage devices of the integrated storage and networking system; updating configuration tables to reflect the new configuration; and sending commands to a fibre channel switch to implement the new configuration.
In another representative embodiment, an apparatus is provided. The apparatus comprises a connection to a virtual private network; a router that is connected to the virtual private network. The router maintains at least one virtual router for a client; at least one server. The apparatus further includes a virtual LAN switch, connected to the router. The virtual LAN switch provides selectable forwarding for information from the router to the at least one server; at least one volume. The apparatus also comprises an FC switch. The FC switch provides selectable interconnection between the at least one server and the at least one volume, so that information received from a plurality of sources via the virtual private network is directed to a particular virtual router for each of the sources by the router. The information is then directed to a particular server for each of the sources by the virtual LAN switch. The information is then directed to a particular volume for each of the sources by the FC switch.
Numerous benefits are achieved by way of the present invention over conventional techniques. Specific embodiments according to the present invention provide the capability to integrate and manage customer identification information for each of the service components as a whole by the integrated service management systems. This enables the service operator to configure, monitor and manage the service on per-customer or per-service basis. By selecting a certain customer, the operator can focus on the end-to-end service from the customer site to access network, to application servers and storage devices pertaining to the selected customer.
As customer identification information for each of the service components is automatically mapped by the integrated service management systems, in specific embodiments, it is not necessary for the operator of the service provider to manually configure each service component.
These and other benefits are described throughout the present specification. A further understanding of the nature and advantages of the invention herein may be realized by reference to the remaining portions of the specification and the attached drawings.
The present invention provides techniques for creation, operation and management of network-based storage services. Specific embodiments provide improved efficiency of the service management tasks used for designing, operating and accounting the robust and profitable network services, for example. In representative embodiments, techniques for constructing integrated network and storage services are provided. In a specific embodiment, the service comprises of three major service components: virtual private networks (VPN), application servers and storage area networks (SAN). Each of these service components has its own customer identification information, such as VPN identifier for VPN services, process identifier for application servers and logical unit number (LUN) for storage devices.
In a U.S. Pat. No. 6,205,488, entitled “Internet protocol virtual private network realization using multi-protocol label switching tunnels,” which is incorporated by reference herein in it entirety for all purposes, one method for constructing VPN over a packet-based network using multi-protocol label switching (MPLS) technology is described. There are also several techniques to build a virtual private network over public IP networks. For example, IPsec, point-to-point tunneling protocol (PPTP), and layer 2 tunneling protocol (L2TP) may be used to set up a tunneling path between customer-owned network equipment, such as VPN routers and firewalls. Other forms of VPN is a network-based VPN. An example of this type of VPN is described in RFC2547, “BGP/MPLS VPNs,” which is incorporated by reference herein in its entirety for all purposes.
However, a need still exists to support integration and mapping between VPN and application services. Further, other service components have their own service management systems. For example, storage area network (SAN) can be managed using SAN management software.
According to the present invention, a plurality of services are used to combine virtual private network (VPN) services, application services and storage access services. This service is referred to as “Secure storage access service” (SSAS) in this document.
Virtual private network (VPN) service provides secure network path between the customer site and the data center of the service provider over the shared public network such as the Internet. Traffic that goes through VPN path may or may not be encrypted to prevent eavesdropping in various specific embodiments. Each of the VPN service customers has one or more sites to be connected to the VPN. For example, in
The VPN router 160 in the data center 150 aggregate multiple VPN paths, identify the customer by VPN ID, and direct the traffic received from the customer to the virtual LAN (VLAN) switch 170. Within the VPN router 160, there are multiple virtual router (VR) programs, each serving the different VPN customers. For example, in
When a VR A 165 receives packets from one of VPN path of customer A 130, it then adds to them the VLAN tag for customer A and sends them to the VLAN switch. The VLAN tag is the information added to the LAN frame so that more than two logically independent networks can be overlaid on the same LAN segment. The more detailed specification of VLAN tag is defined in the IEEE 803.1q standard. The VPN service is one of the service components or subsystems that comprise SSAS and is managed by the VPN management system 210, which will be described herein below.
Application service comprises of one or more application servers (“Servers”). Each service customer is assigned to one or more Servers. For a larger service customer who requires a lot of server processing capacity such as CPU time, more than one server can be assigned for load balancing. On the other hand, for a smaller customer who doesn't use much CPU and wants to reduce the service cost, one application server can be shared among more than one service customers. In the latter case, more than one application processes may be run on the shared application server.
In
Each application server has one or more host bus adapters (HBA) that connect the server to a storage area network (SAN). From the SAN point of view, each server is identified by its HBA address or port. In the configuration illustrated by
Storage service comprises of multiple storage devices or volumes. Each storage volume is configured to accept accesses from a specific application server. Application servers and storage volumes are connected via the storage area network (SAN). In
In
Integrated service management system (ISMS) 300 is the management server and programs running on it. Integrated service management system (ISMS) 300 communicates with the subsystem management system (SMS) that controls and manages each service component comprising the SSAS. The ISMS 300 includes application programming interfaces that can be used to develop application programs such as an operator console program. Service provider operators can communicate with ISMS 300 by using operator console application 120. Service customers can communicate with ISMS 300 by using customer portal applications 125. ISMS communicates with other management components such as SMS and applications through management network 115.
The information for mapping between VPN path and VLAN tags associated with the VPN path is stored in a VPN table 500 in a VPN database 210. The contents of the VPN table 500 will be described later with reference to
Service order processing module 240 is responsible for processing service orders received by network interface module 250. When ISMS 300 sends a request command or a service order to VPN SMS 200 in order to change VPN configuration, the command packet is received by the network interface module 250 of VPN SMS 200. Then, the service order processing module 240 analyzes and executes the command request, updates the VPN table 500 and sends the new configuration information to the VPN router 160 through the VPN control module 255. A database access module 245 is used to read data from or write data into VPN database 210 as requested by other modules of VPN SMS 200.
A service order processing module 355 is responsible for processing service orders received by network interface module 365. When operator console application 120 or customer portal application 125 sends a request command or a service order to ISMS 300 in order to change service configuration, the command packet is received by the network interface module 365 of ISMS 300. Then, the service order processing module 355 analyzes and executes the command request, updates related table caches in service management database 310 and sends the new configuration information to the related SMSs through the network interface module 365.
A database access module 360 is used to read data from or write data into the service management database 310 as requested by other modules of the ISMS 300. Stored within the service management database 310 are a number of tables, which ISMS 300 uses to control and manage the SSAS. Service configuration table 315, service mapping table 325, and service status table 335 are described below.
The ISMS 300 comprises a VPN table cache 320, server table cache 330 and storage table cache 340, which are copies of the corresponding tables managed by SMSs respectively. For example, VPN table cache 320 is a copy of a VPN table 500 that is stored in VPN SMS 200 and collected by ISMS 300. The contents of VPN table, server table and storage table are described below.
In this way, ISMS 300 can accept the configuration command on a per-customer basis and translate it into the command request to the subsystems with subsystem specific identification information.
The preceding has been a description of the preferred embodiment of the invention. It will be appreciated that deviations and modifications can be made without departing from the scope of the invention, which is defined by the appended claims.
This is a Continuation of U.S. application Ser. No. 09/841,710 filed Apr. 24, 2001; the entire disclosure of which is hereby incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6487547 | Ellison et al. | Nov 2002 | B1 |
| 6597956 | Aziz et al. | Jul 2003 | B1 |
| 6633571 | Sakamoto et al. | Oct 2003 | B1 |
| 6640278 | Nolan et al. | Oct 2003 | B1 |
| 7085827 | Ishizaki et al. | Aug 2006 | B2 |
| 20030237016 | Johnson et al. | Dec 2003 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20060248142 A1 | Nov 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 09841710 | Apr 2001 | US |
| Child | 11479495 | US |
