The present invention relates to managing information technology (IT) and communication systems, and more particularly to constructing and optimizing deployment patterns.
Deployment patterns are metadata descriptions of IT and communications systems. Deployment patterns are used as instructions by cloud orchestration tools to automate the accurate construction of virtual IT and communications systems including compute, network, and storage systems. To construct a deployment pattern of good quality, a human pattern developer requires significant knowledge of (1) multiple classes of components in the system, including networks, security, directories, storage, applications, databases, and application servers; (2) the relationships among the aforementioned components; and (3) non-functional requirements (NFRs) and target service levels (e.g., target levels for availability and fluctuations in transaction throughput over time) and how to design infrastructure to achieve the NFRs and the target service levels. NFRs are requirements associated with characteristics of the system, including the security, availability, response time, throughput, and latency).
The known approaches to building deployment patterns have the following issues. Few people or teams have the skills to produce a deployment pattern of good quality. Issues with deployment patterns are identified when the system based on the pattern fails during a test phase or in production. A pattern developer can review documentation on precedent implementations to guide the deployment pattern design, but there is no guarantee that the documentation is accurate. Collecting data including metadata descriptions of the components in a system, relationships between the components, performance characteristics of the components, and service level achievement over time is labor-intensive. Because of the aforementioned issues, pattern developers manually build deployment patterns based on incomplete and possibly inaccurate information. A pattern developer can easily overlook key information such as performance data in log files that indicate issues with an existing system. The pattern developer may be replicating a bad design or copying a system that has failed to meet its target service levels.
Another issue with the known approaches to building deployment patterns includes a lack of an automated means of validating that a deployment pattern will meet desired service levels. For example, the pattern developer does not have an automated means to ensure that the deployment pattern will yield a system that has 99.99% availability or 500 millisecond latency. Many production systems achieve service levels by having excess infrastructure, such as more compute capacity or higher bandwidth network connections that is needed. This excess infrastructure means that ongoing infrastructure costs are higher than they need to be. For example, the pattern developer does not have an automated means for determining whether production resources are being used effectively and efficiently.
Yet another issue with the known approaches to building deployment patterns includes the need for a human to manually adjust the deployment pattern in response to the system being modified to meet a different target service level. For example, a deployment pattern that establishes a customer premise environment comprising security, teller machines, and voice services will need less network and compute capacity for a small rural office and greater capacity at a regional center. The pattern developer must manually adjust each deployment pattern to suit the different offices. The required manual adjustment takes a significant amount of labor and is error-prone.
Accordingly, there is a need for a technique that automatically constructs and enhances a deployment pattern at a design phase that precedes any test or production phase, where the deployment pattern is based on complete and accurate information from existing systems, where the information specifies the components in the existing systems, interrelationships between the components, performance characteristics of the components, and service level achievement in the existing systems over time.
In one embodiment, the present invention provides a method of optimizing a deployment pattern. The method includes a computer aggregating event data from a plurality of precedent systems and configuration data specifying infrastructure in the plurality of precedent systems. The method further includes based on the aggregated event data and configuration data, the computer generating a metadata model of the precedent systems. The method further includes the computer identifying components in an initial deployment pattern of a new system. The method further includes the computer determining target non-functional requirements (NFRs) and target service levels of the new system by receiving user-specified target NFRs and user-specified target service levels or automatically identifying the target NFRs and the target service levels of the new system based on the initial deployment pattern. The method further includes based on the metadata model, the computer identifying one or more precedent systems included in the plurality of precedent systems that have components that match or are similar to the components in the initial deployment pattern. The method further includes based on the metadata model, the computer comparing a performance of the one or more precedent systems to the target NFRs and target service levels of the new system. The method further includes in response to the step of comparing, the computer generating a new deployment pattern for the new system. The new deployment pattern includes a modification of the components that were identified in the initial deployment pattern. The method further includes the computer generating a recommendation for deploying the new system using the new deployment pattern.
The aforementioned embodiment provides an automated deployment pattern optimization that advantageously (1) provides an automated discovery and enhancement of new deployment patterns during a design phase which is prior to any test or run phase; (2) avoids the need for a person or a team of people to have the skills needed to manually construct a high quality deployment pattern that will satisfy NFRs and meet target service levels, and (3) avoids a time-consuming, manual collection of data about precedent systems. The aforementioned embodiment also advantageously provides accurate and complete metadata descriptions of components in precedent systems, relationships between the components, performance characteristics of the components, and service level achievement of the precedent systems over time. The aforementioned embodiment also provides automated means for validating that a deployment pattern will meet desired service levels and automated means for adjusting a deployment pattern when the system is to be modified to meet different service levels.
The advantages discussed above also apply to the computer system and computer program product embodiments, which are summarized below.
In one optional aspect of the present invention, the method further includes the computer deploying an instance of the new system using the new deployment pattern. The method may further include the computer iteratively testing and improving the performance of the deployed instance of the new system. The method may further include based on the tested and improved performance of the deployed instance of the new system, the computer validating the new deployment pattern. The aforementioned aspect advantageously provides an automated approach to validating a deployment pattern which ensures that production resources of the new system will be used efficiently and effectively, which avoids known manual validation approaches which are error-prone and costly in terms of required labor.
In another optional aspect of the present invention, the method further includes the computer determining that a performance of the new system does not attain a target service level included in the target service levels. The method may further include based on the performance of the new system not attaining the target service level, the computer modifying the new deployment pattern. The method may further include the computer updating the new system based on the modified new deployment pattern. The method may further include the computer determining that the updated new system based on the modified new deployment pattern attains the target service level. The aforementioned aspect of the present invention advantageously provides an automated approach to adjusting a deployment pattern to satisfy different service levels, which avoids the known manual adjustment approaches which are error-prone and costly in terms of required labor.
In another embodiment, the present invention provides a computer program product including a computer-readable storage medium and a computer-readable program code stored in the computer-readable storage medium. The computer-readable program code includes instructions that are executed by a central processing unit (CPU) of a computer system to implement a method of optimizing a deployment pattern. The method includes a computer system aggregating event data from a plurality of precedent systems and configuration data specifying infrastructure in the plurality of precedent systems. The method further includes based on the aggregated event data and configuration data, the computer system generating a metadata model of the precedent systems. The method further includes the computer system identifying components in an initial deployment pattern of a new system. The method further includes the computer system determining target non-functional requirements (NFRs) and target service levels of the new system by receiving user-specified target NFRs and user-specified target service levels or automatically identifying the target NFRs and the target service levels of the new system based on the initial deployment pattern. The method further includes based on the metadata model, the computer system identifying one or more precedent systems included in the plurality of precedent systems that have components that match or are similar to the components in the initial deployment pattern. The method further includes based on the metadata model, the computer system comparing a performance of the one or more precedent systems to the target NFRs and target service levels of the new system. The method further includes in response to the step of comparing, the computer system generating a new deployment pattern for the new system. The new deployment pattern includes a modification of the components that were identified in the initial deployment pattern. The method further includes the computer system generating a recommendation for deploying the new system using the new deployment pattern.
In another embodiment, the present invention provides a computer system including a central processing unit (CPU); a memory coupled to the CPU; and a computer-readable storage device coupled to the CPU. The storage device includes instructions that are executed by the CPU via the memory to implement a method of optimizing a deployment pattern. The method includes a computer system aggregating event data from a plurality of precedent systems and configuration data specifying infrastructure in the plurality of precedent systems. The method further includes based on the aggregated event data and configuration data, the computer system generating a metadata model of the precedent systems. The method further includes the computer system identifying components in an initial deployment pattern of a new system. The method further includes the computer system determining target non-functional requirements (NFRs) and target service levels of the new system by receiving user-specified target NFRs and user-specified target service levels or automatically identifying the target NFRs and the target service levels of the new system based on the initial deployment pattern. The method further includes based on the metadata model, the computer system identifying one or more precedent systems included in the plurality of precedent systems that have components that match or are similar to the components in the initial deployment pattern. The method further includes based on the metadata model, the computer system comparing a performance of the one or more precedent systems to the target NFRs and target service levels of the new system. The method further includes in response to the step of comparing, the computer system generating a new deployment pattern for the new system. The new deployment pattern includes a modification of the components that were identified in the initial deployment pattern. The method further includes the computer system generating a recommendation for deploying the new system using the new deployment pattern.
Overview
Embodiments of the present invention automatically discover and validate new patterns by (1) aggregating data from existing systems (i.e., precedent systems), including physical and virtual infrastructure, and storing the aggregated data to form a repository of precedents; (2) analyzing the data in the repository to construct a metadata model of the existing systems; and (3) provide automated tools for a pattern developer to (i) identify components in the design of a new system, (ii) specify the target service levels and NFRs of the new system, (iii) identify relevant precedent system implementations and precedent patterns, (iv) generate a new deployment pattern for the new system based on the specified target service levels and NFRs, where the new deployment pattern is generated during a design phase and prior to any test or production phase, (v) model the performance of the new system, (vi) vary the target service levels and NFRs to compare the costs of different options (e.g., confirm the cost of achieving a higher level of availability in the new system), (vii) validate the new deployment pattern over time as the resulting new system passes through a test phase and enters a production phase, and (viii) monitoring the new system to determine how the new deployment pattern can be enhanced.
Known approaches to designing and deploying IT and communications systems using deployment patterns allow quick design and deployment of a system, but without guaranteeing that the system will perform well and without ensuring that the system will include attributes specified in NFRs. A pattern developer manually building a deployment pattern by a known approach may not have access to complete and accurate information about existing systems, and therefore may fail to consider key information such as performance data in log files that indicate issues with an existing system. Furthermore, the pattern developer using a known approach with incomplete and/or inaccurate information about existing systems may construct a deployment pattern by simply replicating a deficient design or copying a system that has failed to meet its target service levels. Embodiments of the present invention overcome the aforementioned deficiencies of the known approaches using deployment patterns by advantageously ensuring a quick design and deployment of an IT system or communications system while also ensuring a performance of the system that meets target service levels and provides desired NFRs.
In a traditional infrastructure lifecycle that includes the sequence of design, build, and run phases, there are multiple iterations that include automatic monitoring and assessing of the physical and virtual infrastructure, followed by a dynamic reconfiguration of the infrastructure to improve the infrastructure at runtime. The multiple iterations in the traditional approaches are costly and time-consuming. Embodiments of the present invention construct and enhance, at the design phase, a deployment pattern whose quality is ensured by target service levels and NFRs of the infrastructure being built being likely to be satisfied based on historical performance data of precedent system(s) whose infrastructure is the same or similar to the infrastructure being built. Because the initial deployment pattern constructed and enhanced by embodiments of the present invention is validated to be of high quality, the number of iterations (and the associated time and cost) of monitoring, assessment, and redesign is minimized.
System for Constructing and Enhancing a Deployment Pattern
Deployment pattern construction and enhancement system 104 generates a metadata model 110 by using the event data and infrastructure configuration data stored in data repository 108.
To construct a new system (i.e., a new IT system or a new communications system), deployment pattern construction and enhancement system 104 receives identifications and attributes of components 112 of the new system and target NFRs and target service levels 114 of the new system. Based on metadata model 110, components 112, and target NFRs and target service levels 114 deployment pattern construction and enhancement system 104 generates a new deployment pattern 116 which is a metadata description of the new system. In one embodiment, after new deployment pattern 116 is validated through a process of testing and improving the new system, an orchestration tool (not shown) instantiates the new deployment pattern 116 as a full virtual system (not shown).
The functionality of the components shown in
Process for Constructing and Enhancing a Deployment Pattern
In step 204, based on the data aggregated and stored in step 202, deployment pattern construction and enhancement system 104 (see
In step 206, deployment pattern construction and enhancement system 104 (see
In step 208, deployment pattern construction and enhancement system 104 (see
In step 210, using metadata model 110 (see
In step 212, based on the comparison of the identified precedent system(s) to the NFRs and target service levels 114 (see
In step 214, deployment pattern construction and enhancement system 104 (see
In step 216, deployment pattern construction and enhancement system 104 (see
In step 218, over time, deployment pattern construction and enhancement system 104 (see
The process of
In one embodiment, after step 212, deployment pattern construction and enhancement system 104 (see
In one embodiment, deployment pattern construction and enhancement system 104 (see
In step (1) in example 300, data on existing system 310 is loaded into design optimization platform 302 on an ongoing basis. The data being loaded includes NFRs, deployment patterns, and key performance indicators that specify an existing system included in precedent systems 106-1, . . . , 106-N (see
In step (2) in example 300, deployment pattern construction and enhancement system 104 (see
In step (3), design optimization platform 302 undertakes analysis of the initial design (i.e., initial deployment pattern) of the new system compared to data in precedents 304 and analytical models 306 to identify issues with the new system. For example, design optimization platform 302 determines that the new system has 99% availability and will not reach the target of 99.99% availability. Step (3) also includes design optimization platform 302 making improvements to the design of the new system to ensure that the new system meets NFRs. Step (3) also includes design optimization platform 302 modeling variations of the design of the new system to determine efficient and effective uses of production resources while meeting various NFRs and target service levels. For example, design optimization platform 302 models variations in the design of the new system to identify how the number of servers can be decreased if the availability target is relaxed.
In step (4) of example 300, design optimization platform 302 exports the improved design for the new system 314, which is used to construct a new system 316 in a cloud environment.
Computer System
Memory 404 includes a known computer readable storage medium, which is described below. In one embodiment, cache memory elements of memory 404 provide temporary storage of at least some program code (e.g., program code 414) in order to reduce the number of times code must be retrieved from bulk storage while instructions of the program code are executed. Moreover, similar to CPU 402, memory 404 may reside at a single physical location, including one or more types of data storage, or be distributed across a plurality of physical systems in various forms. Further, memory 404 can include data distributed across, for example, a local area network (LAN) or a wide area network (WAN).
I/O interface 406 includes any system for exchanging information to or from an external source. I/O devices 410 include any known type of external device, including a display, keyboard, etc. Bus 408 provides a communication link between each of the components in computer 102, and may include any type of transmission link, including electrical, optical, wireless, etc.
I/O interface 406 also allows computer 102 to store information (e.g., data or program instructions such as program code 414) on and retrieve the information from computer data storage unit 412 or another computer data storage unit (not shown). Computer data storage unit 412 includes a known computer-readable storage medium, which is described below. In one embodiment, computer data storage unit 412 is a non-volatile data storage device, such as a magnetic disk drive (i.e., hard disk drive) or an optical disc drive (e.g., a CD-ROM drive which receives a CD-ROM disk).
Memory 404 and/or storage unit 412 may store computer program code 414 that includes instructions that are executed by CPU 402 via memory 404 to construct and enhance a deployment pattern. Although
Further, memory 404 may include an operating system (not shown) and may include other systems not shown in
Storage unit 412 and/or one or more other computer data storage units (not shown) that are coupled to computer 102 may store components of new system 112 (see
As will be appreciated by one skilled in the art, in a first embodiment, the present invention may be a method; in a second embodiment, the present invention may be a system; and in a third embodiment, the present invention may be a computer program product.
Any of the components of an embodiment of the present invention can be deployed, managed, serviced, etc. by a service provider that offers to deploy or integrate computing infrastructure with respect to constructing and enhancing a deployment pattern. Thus, an embodiment of the present invention discloses a process for supporting computer infrastructure, where the process includes providing at least one support service for at least one of integrating, hosting, maintaining and deploying computer-readable code (e.g., program code 414) in a computer system (e.g., computer 102) including one or more processors (e.g., CPU 402), wherein the processor(s) carry out instructions contained in the code causing the computer system to construct and enhance a deployment pattern. Another embodiment discloses a process for supporting computer infrastructure, where the process includes integrating computer-readable program code into a computer system including a processor. The step of integrating includes storing the program code in a computer-readable storage device of the computer system through use of the processor. The program code, upon being executed by the processor, implements a method of constructing and enhancing a deployment pattern.
While it is understood that program code 414 for constructing and enhancing a deployment pattern may be deployed by manually loading directly in client, server and proxy computers (not shown) via loading a computer-readable storage medium (e.g., computer data storage unit 412), program code 414 may also be automatically or semi-automatically deployed into computer 102 by sending program code 414 to a central server or a group of central servers. Program code 414 is then downloaded into client computers (e.g., computer 102) that will execute program code 414. Alternatively, program code 414 is sent directly to the client computer via e-mail. Program code 414 is then either detached to a directory on the client computer or loaded into a directory on the client computer by a button on the e-mail that executes a program that detaches program code 414 into a directory. Another alternative is to send program code 414 directly to a directory on the client computer hard drive. In a case in which there are proxy servers, the process selects the proxy server code, determines on which computers to place the proxy servers' code, transmits the proxy server code, and then installs the proxy server code on the proxy computer. Program code 414 is transmitted to the proxy server and then it is stored on the proxy server.
Another embodiment of the invention provides a method that performs the process steps on a subscription, advertising and/or fee basis. That is, a service provider, such as a Solution Integrator, can offer to create, maintain, support, etc. a process of constructing and enhancing a deployment pattern. In this case, the service provider can create, maintain, support, etc. a computer infrastructure that performs the process steps for one or more customers. In return, the service provider can receive payment from the customer(s) under a subscription and/or fee agreement, and/or the service provider can receive payment from the sale of advertising content to one or more third parties.
The present invention may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium or media (i.e., memory 404 and computer data storage unit 412) having computer readable program instructions 414 thereon for causing a processor (e.g., CPU 402) to carry out aspects of the present invention.
The computer readable storage medium can be a tangible device that can retain and store instructions (e.g., program code 414) for use by an instruction execution device (e.g., computer 102). The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions (e.g., program code 414) described herein can be downloaded to respective computing/processing devices (e.g., computer 102) from a computer readable storage medium or to an external computer or external storage device (e.g., computer data storage unit 412) via a network (not shown), for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card (not shown) or network interface (not shown) in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions (e.g., program code 414) for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
Aspects of the present invention are described herein with reference to flowchart illustrations (e.g.,
These computer readable program instructions may be provided to a processor (e.g., CPU 402) of a general purpose computer, special purpose computer, or other programmable data processing apparatus (e.g., computer 102) to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium (e.g., computer data storage unit 412) that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions (e.g., program code 414) may also be loaded onto a computer (e.g. computer 102), other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
While embodiments of the present invention have been described herein for purposes of illustration, many modifications and changes will become apparent to those skilled in the art. Accordingly, the appended claims are intended to encompass all such modifications and changes as fall within the true spirit and scope of this invention.
Number | Name | Date | Kind |
---|---|---|---|
8010938 | Elaasar | Aug 2011 | B2 |
8291378 | Arnold | Oct 2012 | B2 |
8417658 | Arnold et al. | Apr 2013 | B2 |
8683028 | Davison | Mar 2014 | B2 |
8745577 | Reech | Jun 2014 | B2 |
8751620 | Anderson | Jun 2014 | B2 |
9116767 | Arif | Aug 2015 | B1 |
9189224 | Ravi | Nov 2015 | B2 |
9264315 | Fukui | Feb 2016 | B2 |
9626271 | Karpuram | Apr 2017 | B2 |
9686150 | Gesmann | Jun 2017 | B2 |
20100042659 | Rose | Feb 2010 | A1 |
20110099139 | Coldicott | Apr 2011 | A1 |
20110296372 | Bird | Dec 2011 | A1 |
20140068546 | Balasubramanian | Mar 2014 | A1 |
20150058459 | Amendjian | Feb 2015 | A1 |
20160255095 | Maes | Sep 2016 | A1 |
Entry |
---|
Eilam, Tamar et al.; Pattern-based composite application deployment; 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops; May 23-27, 2011; pp. 217-224. |
Arnold, William, et al.; Pattern Based SOA Deployment; Aug. 2007; retrieved from the Internet Mar. 4, 2016; URL: https://www.researchgate.net/publication/225227220_Pattern_based_SOA_deployment; 13 pages. |
Breitenbucher, Uwe et al.; A Method to Automate Cloud Application Management Patterns; ADVCOMP 2014: the Eight International Conference on Advanced Engineering Computing and Applications in Sciences; Aug. 24-28, 2014; pp. 140-145. |
IBM Software Group; Zoom Catalyst—Recover First, Resolve Next; Retrieved from the Internet Dec. 13, 2016; URL: http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=WH&infotype=SA&htmlfid=MSL03007USEN&attachment=MSL03007USEN.PDF; 4 pages. |
Number | Date | Country | |
---|---|---|---|
20180165385 A1 | Jun 2018 | US |