The present invention relates to smart grid technologies as it pertains to energy usage, and, more particularly, to a model for generating incentive mechanisms for energy consumers at multiple network levels for determining a lowest cost aggregate energy demand reduction.
The advent of Smart Grid technologies such as digital communication devices and advanced metering infrastructures (AMI) has facilitated a better environment for sharing information and data more readily between customers and utilities in a timely fashion. This has focused attention on distributed customer demand response mechanisms such as dynamic pricing or incentive schemes as an effective control signal that improves the efficiency of energy usage. Energy markets share several key characteristics with standard revenue management models: demand is highly variable over both the time-axis and the price-axis, while supply or generation capacity is relatively inflexible over short time horizons. Energy retailing utilities or generating companies may suffer a shortfall in committed supply during peak periods of usage, and this imbalance currently leads to high operating costs due to procurement from secondary spot market sources.
Dynamic pricing offers customers' time-varying electricity prices on a day-ahead or real-time basis, which includes critical peak pricing (CPP) programs, real-time pricing programs (RTP), and peak time rebates (PTR). A review of 17 recent dynamic pricing models can be found in the reference to A. Faruqui and S. Sergici entitled “Household response to dynamic pricing of electricity a survey of seventeen pricing experiments,” Journal Vol, vol. 20, no. 8, pp. 68-77, 2007.
The incentive design problem determines rebates provided to end-users over a fixed tariff to induce a reduction in energy usage. Demand response is modeled as a version of utility or benefit functions, and aggregate demand reduction results from each customer maximizing their utility function. In a reference to Faruqui and Alvarado entitled “Designing incentive compatible contracts for effective demand management,” IEEE Transactions on Power Systems, vol. 15, no. 4, pp. 1255-1260, 2000, there is described how a quadratic benefit function is applied to design a group of incentive contracts that customers can voluntarily choose from.
However, it would be highly desirable to provide an optimal rebate plan for a utility to realize load reduction when the need arises and, further, that generates a plan that is customized for each end user.
In one aspect there is provided a system, method and computer program product that computes a customized, time varying rebate plan for each of plurality of users, e.g., each customers, to minimize a utility operating cost.
The energy utility dispatches these virtual generators based on their unique characteristics through rebate incentives. This rebate rate mechanism is optimal in that the utility can achieve the minimal total operating cost, which includes both rebates paid to all the customers and the cost paid on the spot market in case of shortfalls.
According to one aspect, there is provided a system, method and computer program product for estimating a price for determining an aggregate energy demand reduction for plurality of end-users of an entity supplying power to the end-users, the method comprising: a) receiving, at a processor device, data including a plurality of energy users i including, for each energy user, their demand level for energy usage, and an incentive rebate cost per unit of demand reduction; b) generating a customized time-varying incentive plan for each individual user i, in a defined time period, by minimizing the total incentive rebate amounts that the entity pays to each end-user i for load reduction, and a total purchasing cost in case of a load shortage; c) communicating signals from the entity to each respective user i, the signals carrying data representing an incentive plan calculated to reduce the user i's energy demand for the time period, wherein a cost expenditure of the entity is minimized.
Further to this aspect, the objective function OBJ is formulated as:
d
i
*=d
i−ƒi(ai,ri)
Alternatively, the system and method includes adjusting the above objective function to also allow the selling of generation capacity to the spot market in addition to purchasing energy therefrom.
In a further aspect, the generating a customized time-varying incentive plan for each user is calculated for multiple time periods, wherein the objective function OBJ is formulated as:
d
i,t
*=d
i,t′−ƒi,t(ai,t,ri,t), i=1, . . . , K, t=1, . . . , T
Alternatively, the system and method includes adjusting the above objective function to also allow the selling of generation capacity to the spot market in addition to purchasing energy therefrom.
A computer program product is provided for performing operations. The computer program product includes a storage medium readable by a processing circuit and storing instructions run by the processing circuit for running a method. The method is the same as listed above.
The objects, features and advantages of the present invention will become apparent to one skilled in the art, in view of the following detailed description taken in combination with the attached drawings, in which:
FIG. 4A,B depict example plots of an example rebate
for example linear load reduction functions ƒ according to one embodiment;
FIG. 5A,B depict example plots of an example rebate
for example nonlinear load reduction functions according to one embodiment;
In view of
As described herein, the system and method employed by the invention at different levels of the smart grid includes modeling a dynamic pricing problem, e.g., for both single-period and multiple-period formulations, both with the objective of minimizing the utility's total operating costs. This includes incentive compensation to end-users for load reduction as well as spot market prices paid to purchase additional units to cover any remaining load shortage.
The ability of each customer to shift or reduce demand is governed by various factors such as price-demand elasticity, demand variability and flexibility over time. A load reduction function is used that maps a customer's load reduction amount as a (noisy) function of the rebate rate offered. Both linear and nonlinear load reduction functions are considered.
The method further includes modeling a case where end-users have been customers of the utility long enough for the utility to possess a reasonable forecast of each end-user's elasticity (e.g., from their energy demand/usage history).
In one embodiment, a set of algorithms are employed for estimating the minimum cost for different levels of demand reduction (using demand response) and communicate to utilities and/or customers optimal pricing or rebate offerings.
In one embodiment, an example of hierarchical control is the ability to match supply to demand using various information or price signals. Given the price elasticity of demand for different end users (along with associated uncertainty in the response) there is estimated price signals for each end user “i” that minimizes the expected cost of reducing the demand by a required amount. In one embodiment, a set of algorithms are employed for estimating the minimum cost for different levels of demand reduction (using customers' demand response curves 26 shown in
In the embodiment shown in
More particularly, one example scenario for an ISO/utility 15/20 is where the ISO 15 requests of the utility 20 for a given time period an estimate of its anticipated (demand reduction) response via wired or wireless communicated signals 21 that specify the desired levels of load reduction imposed upon the utility. These request signals from the ISO are routed to a routing dispatch controller 40 at the utility 20 that processes the respective request signals, employs a gradient descent algorithm solver to solve an objective function and calculate the incentives, and communicates appropriate incentive signals 23 to the customers including, but not limited to information such as price options, price signals and dispatch signals that specify the rebate incentives offered to different customers for various levels of load reduction.
For example, the calculated incentive or rebate signals 23 communicated to customers in a single-period problem may indicate: a 5% rebate for customers 1, . . . , j; a 6.5% rebate for customers j+1, . . . , k; etc., with the expectation that customers will reduce their respective energy demands in response to these rebate signals. With respect to the calculated incentive or rebate signals 23 for customers in a multi-period problem an example result may be: a 5% rebate for customers 1, . . . , j in period 1 for example, a 3% reduction in period 2, and so on; 6.5% rebate for customers j+1, . . . , k in period 1, 8% rebate in period 2, and so on etc. Corresponding to this, example signals 28 communicated by customers to the utility for customers in single-period problem may indicate, for example: a 2% reduction by customer 1; 3% reduction by customer 2; 8% reduction by customer 3; etc.; while example results of signals 28 for customers in multi-period problem may indicate, for example: 2% reduction by customer 1 in period 1, 4% reduction in period 2, and so on; 3% reduction by customer 2 in period 1, 1% reduction in period 2, and so on; 8% reduction by customer 3 in period 1, 4% reduction in period 2, and so on, etc.
The utility responds by providing back to the ISO an aggregated response estimate via wired or wireless communicated signals 35 that specify the estimated anticipated levels of demand reduction from customers and a plan for any additional energy required from the spot market. Against this estimate, the utility 20 dispatches prices, e.g., via wired or wireless communicated signals 23 to its customers. ISO 15 and utility 20 further supply energy or power (including for example, wind, photovoltaic, storage, gas, electric, etc.) 90 from or to the spot market 12, for example, to various end-user customers as shown in
Thus, as shown in
While the example provided herein with respect to
Further, while the energy distribution system of
In one embodiment, the cost tradeoff is modeled as a corresponding dynamic pricing problem formulated as a stochastic optimization problem whose solution minimizes the total virtual generation cost to an energy utility. That is, the ISO calculates estimated price signals for each end user that minimizes the expected cost of reducing the demand by a required amount. This problem may be formulated for both single-period and multi-period cases.
In one embodiment, a gradient descent algorithm is provided to solve different formulations of the stochastic optimization problem.
Various structural results on the optimal rebate scheme are further derived. This includes: identifying a threshold that segments customers for whom no dynamic pricing adjustments should be given. These results motivate a heuristic policy for the single-period problem that segments the customers according to their willingness and likelihood to reduce load. In a multi-period instance of the problem, results show that customers with higher load flexibility over time receive the larger dynamic pricing adjustments, and vice versa. Moreover, for the same supply shortfall, incentives offered after peak periods are higher than those before peak periods. The smart-grid demand response framework considered provides significant benefits to energy customers and utilities as well as to higher levels of the energy distribution hierarchy. In addition, the results of the demand response optimization can be used as input to or in conjunction with other smart-grid applications, such as the orthogonal problem of risk management of multiple sources of electric generation including renewables.
Single Period Problem
In a single period formulation/solution there is omitted constraints on the length of this period. A formulation, and numerical experiments and theoretical results for the single period problem is now provided.
The single-period formulation includes the following parameters (with subscripts i=1, . . . , K representing various end-users):
K Total number of end-users;
G Total generation capacity;
di Demand level for user i before rebate;
D Total demand before rebate, where
where is Forecast demand level before rebate (this represents the level below which user i's usage qualifies for the rebate);
di* is Demand level after rebate;
ri Rebate per unit of demand reduction;
ƒi(ai, ri) General load demand reduction function;
ai End-user i's rebate-demand elasticity;
Load Reduction LR (−di*)+ only positive value applicable (zero if value is negative);
Load Reduction LREQ=load reduction under the assumption that all rebates ri are the same for all i (equal-rebate plan);
Obj denotes the optimal objective value under the discriminatory rebate plan of the present invention;
ObjEQ denotes the optimal value obtained for the equal-rebate plan;
c is the Spot market price;
The following objective is sought to be optimized:
The first term in the objective function (2) sums up the total rebate amount that the utility pays to each end-user for load reduction from the (pre-announced) forecast level , and the second part of (2) is the total purchasing cost from the spot market in case of load shortage. Let Obj denote the objective function (2).
Assume {di} has a normal distribution N(μi, σi), where μi (mean of distribution) and σi (standard deviation) are known to the utility from historical data. The formulation (2), in one embodiment, is solved using a steepest descent method. For general ƒi, the derivative has the form
In one embodiment, the load reduction functions ƒi satisfy a condition that
Two cases of ƒi (ai, ri) are considered where condition (5) is satisfied. In one, the load reduced linearly increases in the rebate rate ri until it reaches an upper bound dmax,
In one case:
ƒi(ai,ri)=min {airi,dmax}, i=1, . . . , K. (6)
The other case is where ƒi (ai, ri) is nonlinear and converges to dmax as
In practical applications, the load reduction is expected to have an increasing marginal cost, and concave load reduction functions are implemented in the model. Due to this increasing marginal cost nature of both of the ƒi (ai, ri) considered, the total cost for the utility is convex. In one embodiment, a gradient-descent based algorithm is implemented to obtain solutions to the optimization problem (2), i.e., that provides optimal incentives. The steepest descent method is used in one embodiment with the gradient updated by (4). That is, using Steepest Descent Method such as described in the reference entitled “Nonlinear programming: theory and algorithms” by M. S. Bazaraa, Hanif D. Sherali, C. M. Shetty, an initial vector r0 is first chosen and a convergence criteria. In one embodiment, Assuming di follows N(μi, σi), calculate the steepest descent direction by using equation (4).
Example numerical experiments were performed for a variety of parameter settings. Tables I and II of respective
As an example, two cases for modeling dmax are considered:
In practice, the above exemplary parameters will be obtained from the demand response functions. That is, parameter values of 0.1, 0.6 are not fixed, but rather vary according to a customer's demand response function.
In these examples, the variables half and unif are referenced in Tables I and II of
That is, Tables 110, 112 depicted in respective
ObjImp %=(Objeq−Obj)/Objeg.
Numerical experiments were conducted for both cases of load reduction functions ƒ. FIG. 4A,B depict respective plots 130, 132 showing rebates
for linear ƒ such as set forth in equation (6) with K=100, c=1 for the example case where dmax is half (
for nonlinear ƒ such as set forth in equation (7) with K=100, c=1 for the example case where dmax is half (
is large, r=0, and vice versa. Note that the quantity
is the (dimensionless) coefficient of variation of the end-user's demand. Thus, there exists a threshold for
to “truncate” those end-users who exceed this threshold from being paid which is referred to herein as the
—truncation policy. To calculate a good threshold value, there is considered some properties of the objective function:
Assumptions made include that if the load reduction function ƒ is concave, then the objective function
of equation (4) is convex. This follows from the fact that both forms for ƒ are concave, and the form of the objective function Obj and its derivative in equation (4). A threshold value result for
such that ri=0 is determined. In one embodiment ri=0 iff
after the algorithm converges. That is, it the case that
is a sufficient condition for ri to be 0. Thus, the value of
i=1, . . . , K can be used to segment end-users, and pay no rebates to those whose
value exceeds the threshold c√{square root over (2π)}Φ(β). Thus the utility can exclude those end-users that are of no interest from the perspective of helping to reduce the load.
Consequently, a good “truncation” policy (approximation) is to segment the customers according to
ratios wherein higher rebates are paid to customers with lower
ratio, and vice versa, lower rebates are customers with higher
ratio. Further, no rebates are paid to customers whose
ratio exceeds a certain threshold.
Further, from Tables 110, 112 depicted in respective
Example numerical results such as provided herein show that gradient based Optimal-Rebate Plan (ORP) provides better performance compared to the Equal Rebate Plan (ERP) when the maximum amount of load reduction allowable dmax is uniformly distributed rather than dmax equaling half (e.g., 0.5) of the mean. This is because the uniform-dmax case produces a more heterogenous user population, which in turn implies that the utility has a higher opportunity under the ORP which, in turn, implies that the utility has a higher chance to pay the spot-market penalty cost and is thus more receptive of the ORP. ORP performs better than ERP when there is a larger load shortage to cover. This is due to the fact that ORP can find and induce more total load reduction, resulting in smaller penalty costs. When the spot market price is more expensive, ORP again performs better than ERP. When the penalty cost is cheaper, the utility has a better choice to buy the load elsewhere rather than paying up till the maximum rebate level to obtain dmax from each end-user. As previously noted, ORP provides even greater benefits over ERP when there are statistically distinct classes of customers, which often arise in practice.
The case of the linear load reduction function may have a larger improvement in total load reduced and total cost improvement than the case of the nonlinear function. This is because for the same amount of rebate, the linear case induces more load reduction than the nonlinear case. However, the two cases behave almost the same when the demand for load reduction is not significant. This is because the nonlinear load reduction is approximately equal to the linear one when the rebate amount is small.
Multiple Period Problem
The variables and parameters used by the multi-period formulation are essentially the same as those defined for the single-period formulation with an additional time (or period) index in the subscript, with other additions as described below. Recall that i=1, . . . , K indexes end-users and the new index t=1, . . . , T represents various time-periods.
T Time horizon, e.g., 24 (hours)
K Total number of end-users
Gt Total generation capacity at time t
di,t Demand level before rebate at time t if no load reduction occurs at times 1, . . . , t−1
di,t′ Actual demand level before rebate at time t with positive load reduction at time 1, . . . , t−1, where
wherein the demand reduction function ƒi,t is defined below.
δ,ν Factors that determine the amount of load that is shifted from one period to subsequent periods, with the factors satisfying the following stability condition:
Total actual demand before rebate at time t, where
Forecast for d′i,t, the demand level before rebate;
di,t* is Demand level after rebate (assumed that di,t* are independent over i,t);
di,tref is Reference demand level below which load reduction by i qualifies for rebate at time t;
ri,t Rebate per unit of demand reduction at time t;
σi,t End-user's “rebate elasticity”, or willingness to reduce load at time t;
fi,t (ai,t, ri,t) Demand reduction function for the user with rebate elasticity ai,t and rebate rate offered ri,t;
ct Spot market price at time t;
This formulation defines an additional set of variables di,t′ (i.e., actual demand level before rebate at time t) to capture the flexibility of end-users towards sustaining their demand reduction over time, and is used to model the shifting of load from one period to subsequent periods in an effort towards responding positively to the utility's rebate signals. The objective of the multi-period formulations is to minimize
subject to
d
i,t
*=d
i,t′−ƒi,t(ai,t,ri,t), i=1, . . . , K, t=1, . . . , T. (13)
The first term of the objective function represented in equation (12) represents the total rebate amount that the utility pays to all the customers during the period of time [0,T] for the amount of load reduced from the reference levels. Note that the utility accounts for a customer shifting load to available rebates in previous periods by setting the reference level appropriately, so that the rebate pricing is a reasonable indication of whether the load reduction by an end-user during peak hours is valuable. The second part of (12) is the utility's total cost in the spot market when there is still a shortage of load after rebates are offered.
In one embodiment, the OBJ denotes the objective function such as in equation (12). Assuming {di,t} follows a normal distribution N(μi,t, σi,t), where μi,t and σi,t are inferred by the utility from historical data, then similar to the reduction of the single period problem, with this assumption OBJ is further reduced to:
Letting OBJs be the objective value from period s with
then if a choice is made that di,tref={tilde over (d)}i,t, this results in:
With a choice of di,tref=di,t′, this results in:
The same assumptions are made for the functional form of the load reduction function ƒi,t (ai,t, ri,t) as in the single-period formulation, which again yields a convex optimization problem in (12). In one embodiment, a steepest descent method is then employed with the gradient update obtained from the appropriate form of (18) or (17).
Thus, the numerical experiments show that for each single period, customers with higher rebate-demand elasticity and lower variance should be provided with higher incentive rates; and along multiple periods, customers with smaller likelihood of shifting their load and greater inclination to consume less over the entire horizon should be given higher rebates.
Referring back to
Thus, a utility 20 can take advantage of this by exploiting the method and system of the invention to determine the optimal rebates for the different customers to minimize the various costs incurred by the utility (i.e., optimize the tradeoff between the costs of satisfying demand with existing energy generation and the costs of additional energy through the spot market). Once the utility has determined these rebates, then these rebates are communicated as incentive signals (price options) 23 to the customers to lower their energy demand/usage as a function of these rebates. This can be done at a very coarse level, or it can be done at much finer time scales where these “incentive signals” (rebates available upon lowering energy demand/usage) are sent to and responded to by the smart devices explained above. That is, rebates offered may account for certain user demand reduction devices, e.g., customers that use Smart Appliances, Programmable Thermostats, Energy Management Systems, etc. As an illustrative example, a utility may operate at a time scale of minutes while the ISO operates at a time scale of hours, although the present invention is not limited to such specific time scales.
The methodology described herein accounts for temporal aspects of demand shift in response for rebates wherein the costs can be financial, social, or their combinations, etc. As one example of a social cost, there is a social cost that could be related to reducing energy costs in general, given current global warming concerns, rather than demand shifts in response to rebates in order to reduce utility financial costs. The solution, then might not be the best financial solution for the entity, but rather one that minimizes a combination of financial and social costs. Note that the same formulation and optimization is used, but some of the details (e.g., what the function represents, how it is obtained, etc.) may be different.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with a system, apparatus, or device running an instruction.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with a system, apparatus, or device running an instruction. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may run entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Aspects of the present invention are described below with reference to flowchart illustrations (e.g.,
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which run on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, of portion of code, which comprises one or more operable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be run substantially concurrently, or the blocks may sometimes be run in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
While there has been shown and described what is considered to be preferred embodiments of the invention, it will, of course, be understood that various modifications and changes in form or detail could readily be made without departing from the spirit of the invention. It is therefore intended that the scope of the invention not be limited to the exact forms described and illustrated, but should be construed to cover all modifications that may fall within the scope of the appended claims.