Patent Application
20240345725
Enterprise organizations often store and utilize vast amounts of data that are stored in different storage platforms. For each storage platform, each user storage group may be given an amount of storage capacity available based on a storage tier assigned to the user storage group. The tier assigned to each user storage group may determine the IOPS (input/output operations per second) for each group. The assigned limits are not flexible and user storage group throughput may be throttled to ensure that the limits are not exceeded. For instance, a user storage group may request a particular storage tier such as a medium storage tier to handle all of their application storage requirements. Based on a medium storage tier designation, the user storage group may be allowed a peak IOPS of less than or equal to 8K. The user storage group may not exceed its given IOPS which may lead to numerous problems for user storage groups not having appropriate limits. In addition, as data continues to grow overtime, surges by individual users or user storage groups of user may become more difficult to handle. In addition, these high demand throughput surges create noise in the system that may affect other user storage groups connected to the storage platform.
A system that eliminates noisy neighbors, prevents slow drain conditions resulting from link utilization, and allows for efficient workload placement is needed. Such a system should be elastic, flexible, and capable of handling the storage needs of critical applications or workloads when performance capacity is available while providing user storage groups consistent response times.
The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosure. The summary is not an extensive overview of the disclosure. It is neither intended to identify key or critical elements of the disclosure nor to delineate the scope of the disclosure. The following summary merely presents some concepts of the disclosure in a simplified form as a prelude to the description below.
One or more aspects of the disclosure generally relate to computing devices, computing systems, and computer software. In particular, one or more aspects of the disclosure generally relate to computing devices, computing systems, and computer software that may be used to configure one or more configurable storage limits for applications needing real time additional storage requirements.
Some aspects as disclosed herein are directed to, for example, a system and method of providing flexible surge volume management to applications when performance capacity is available. The system and method may comprise determining when a data surge is occurring and in response determining available performance capacity and automatically allocating, the available performance capacity, to storage group applications performing data operations.
The present disclosure is illustrated by way of example and not limited in the accompanying figures in which like reference numerals indicate similar elements and in which:
In the following description of various illustrative embodiments, reference is made to the accompanying drawings, which form a part hereof, and in which is shown, by way of illustration, various embodiments in which the claimed subject matter may be practiced. It is to be understood that other embodiments may be utilized, and that structural and functional modifications may be made, without departing from the scope of the present claimed subject matter.
I/O module 109 may include, e.g., a microphone, mouse, keypad, touch screen, scanner, optical reader, and/or stylus (or other input device(s)) through which a user of computing device 101 may provide input, and may also include one or more of a speaker for providing audio output and a video display device for providing textual, audiovisual, and/or graphical output. Software may be stored within memory 115 and/or other storage to provide instructions to processor 103 for enabling computing device 101 to perform various functions. For example, memory 115 may store software used by the computing device 101, such as an operating system 117, application programs 119, and an associated database 121. Additionally or alternatively, some or all of the computer executable instructions for computing device 101 may be embodied in hardware or firmware (not shown).
The computing device 101 may operate in a networked environment supporting connections to one or more remote computers, such as terminals 141 and 151. The terminals 141 and 151 may be personal computers or servers that include any or all of the elements described above with respect to the computing device 101. The network connections depicted in
Computer network 203 may be any suitable computer network including the Internet, an intranet, a wide-area network (WAN), a local-area network (LAN), a wireless network, a digital subscriber line (DSL) network, a frame relay network, an asynchronous transfer mode (ATM) network, a virtual private network (VPN), or any combination of any of the same. Communications links 202 and 205 may be any communications links suitable for communicating between workstations 201 and server 204, such as network links, dial-up links, wireless links, hard-wired links, and the like.
In an aspect of the disclosure, surge management computing platform 310 may be configured to perform intelligent, dynamic and efficient data surge functions, as described more fully herein. For instance, surge management computing platform 310 may receive data storage requests from numerous users or user storage groups each requesting different levels of support and requiring different levels of storage resources for their storage needs.
In an aspect of the disclosure, users and/or user storage groups access and store vast amounts of data at various throughputs stored on enterprise data storage devices. For example, numerous users or user storage groups may be trying to simultaneously access or store data such as bulk backups, video files, documents, or other types and forms of data. The simultaneously accessing and/or storing of data by numerous users or user storage groups may put a strain on an enterprise's available bandwidth. This limitation of total bandwidth may result in a noisy neighbor situation where a user performing database bulk copy processes is causing transaction slowness to users preforming application transactions. In an embodiment, elastic IO system 314 provides surge volume management capabilities to distribute performance improvements to consistently handle user storage group storage throughput needs.
In an aspect of the disclosure, elastic IO control system 314 may provide performance capacity to the most critical applications when needed. In an embodiment, each application may be categorized into different tier levels depending upon the criticality of the application or process. For instance, a payroll application may be given a Tier 0 designation identifying the payroll application as a critical enterprise business application.
In contrast, a video retrieval application may be give Tier 5 designation identifying it as an application that may not be as critical to the enterprise under normal operations.
In an embodiment, each application may also be given variable tier level designations depending on different definable criteria such as day of week, time of day, specific dates, or different seasons of year. Those skilled in the art will realize that other definable criteria may be utilized such as criteria based on frequency or duration. For instance, a payroll application may be given a Tier 0 designation on the fifteenth and thirtieth of a month and Tier 2 designation on the remaining days of the month. During these specific days of the month, payroll application transactions may be designated as critical to ensure the payroll application it is able to complete is data storage transactions smoothly without any system performance delays.
In another aspect of the disclosure, multiple time bound pre-checks may be performed by elastic IO control system 314 to check the health, availability, and storage capacity of the storage devices along with their available bandwidth capability. The pre-checks may ensure no failures or degraded conditions exist in any IO paths. Any failure of a precheck may prevent the elastic IO control system 314 from performing surge volume management performance improvements.
An additional pre-check may include analyzing applications to determine if the applications are either Tier 0 or Tier 1 applications. For Tier 0 and Tier 1 applications, elastic IO control system 314 may increase system resources for these applications, if needed. In some embodiments, it may be determined that additional resources are available to accommodate additional lower tier ranked applications. In these embodiments, elastic IO control system 314 may automatically accommodate those additional lower ranked tier applications based on available resources.
In an embodiment, elastic IO control system 314 may only be able to adjust or change limits or throughputs during trading hours or regular business hours. In another embodiment, elastic IO control system 314 may not be able to adjust or change limits or throughputs during periods in which no change conditions are instituted. These no change conditions may be implemented during execution of mission critical applications or during periods of important business transactional volumes.
In an embodiment, additional prechecks may include determining that the storage array has available storage capacity to handle increasing application performance capacity and that link utilizations do not exceed guidelines for preventing slow drains. In addition, a precheck may also include determining if the storage array or an associated switch or device such as drives or power supplies has any degraded conditions or failures.
In yet another embodiment, elastic IO control system 314 may precheck that frequent users of the elastic IO control system 314 have been notified and may be removed from utilizing this automation. As those skilled in the art will realize, additional prechecks may be added or existing prechecks removed based on performance criteria or feedback.
In an aspect of the disclosure, if the elastic IO limit % time metric has been exceeded for a user storage group it may be increased. The increase may occur if the metric exceeds seventy-five percent of the thresholds agreed to level. Those skilled in the art will realize that the limit may higher or lower based on storage group requirements and historical use of storage system resources.
In step 414, elastic control IO system 314 determines if performance capacity is available. In an embodiment, available performance capacity may include a determination and analysis of many indicators and their results as compared to performance thresholds. Some exemplary indicators that may be used to determine performance capacity include:
Those skilled in the art will realize that additional indicators may be added or removed from the above exemplary listing of performance capacity indicators. In addition, different ranges of threshold values may be used for each indicator depending upon enterprise performance criteria.
If performance capacity is available and in steps 416 and 418 both the storage components and link utilization status are found to be healthy, the elastic control IO system 314 increases the IO limits/controls in step 420 for the user storage group. In an embodiment, if the elastic control IO system 314 determines that there is no performance capacity available or if either of the storage components and link utilization status are found not be healthy the surge management process ends.
In an aspect of the disclosure, user storage groups may have their limits including IOPS and throughput limits increased in increments of twenty-five percent. In an embodiment, if the numbers remain high and the checks all continue to be successful, the IOPS and throughput can be increased another twenty-five percent. In one embodiment, user storage groups may be allowed up to four increases to its limits at which time further increases may not be allowed.
In an embodiment of the disclosure, each time the resources are increased, a notification may be sent to the user storage group responsible parties and storage operation control entities detailing the increase in service. The notification may list all relative data including any new limits.
In an aspect of the disclosure, as shown in step 422 when the Elastic IO Limit % Time exceeded remains less than twenty percent for thirty minutes, then the IOPS and throughput levels may be decreased to the previous level as illustrated in step 424. This may be repeated until the original levels are reached. Any decrease changes should include notifications to the user storage group responsible parties and storage operation control entities.
In an aspect of the disclosure, surge management computing platform 310 may generate daily reports listing all user storage groups with their associated properties for which IO limits/controls have been temporarily increased or decreased. Surge management computing platform 310 may also generate weekly reports for storage performance governance. The weekly report may list the top users or user storage groups broken down by business unit or other identifying criteria. The reports may be used to determine if different service levels should be discussed with business group owners to improve overall efficiency of system. In an embodiment, persistent top users of surge management computing services without changes in service level agreements may be removed from surge management services.
In an embodiment, a dashboard may be generated to display real-time increases or decreases for all users or user storage groups. In an embodiment, specific user storage group may be searched and their status details displayed.
Various aspects described herein may be embodied as a method, an apparatus, or as computer-executable instructions stored on one or more non-transitory and/or tangible computer-readable media. Accordingly, those aspects may take the form of an entirely hardware embodiment, an entirely software embodiment (which may or may not include firmware) stored on one or more non-transitory and/or tangible computer-readable media, or an embodiment combining software and hardware aspects. Any and/or all of the method steps described herein may be embodied in computer-executable instructions stored on a computer-readable medium, such as a non-transitory and/or tangible computer readable medium and/or a computer readable storage medium. In addition, various signals representing data or events as described herein may be transferred between a source and a destination in the form of light and/or electromagnetic waves traveling through signal-conducting media such as metal wires, optical fibers, and/or wireless transmission media (e.g., air and/or space).
Aspects of the disclosure have been described in terms of illustrative embodiments thereof. Numerous other embodiments, modifications, and variations within the scope and spirit of the appended claims will occur to persons of ordinary skill in the art from a review of this disclosure. For example, one of ordinary skill in the art will appreciate that the steps illustrated in the illustrative figures may be performed in other than the recited order, and that one or more steps illustrated may be optional in accordance with aspects of the disclosure.
This application is a continuation of and claims priority to U.S. application Ser. No. 17/831,942 entitled Surge Volume Management filed on Jun. 3, 2022, which is incorporated by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17831942 | Jun 2022 | US |
| Child | 18755991 | US |
