This disclosure relates generally to marketing research, and more specifically to techniques for evaluating the incremental effect of a marketing channel that forms part of a multichannel marketing campaign.
Marketing involves communicating the value of a product or service to consumers for the purpose of selling or otherwise promoting the product or service. A marketing campaign can therefore be understood as comprising various communications which are directed to the public at large or to a smaller target audience. These communications are delivered via one or more marketing channels. A simple marketing campaign might use only one or two channels, such as pamphlet distribution and/or direct mail solicitation. However, evolving technology has resulted in increasingly sophisticated multichannel marketing campaigns. For example, the advent of radio and television has allowed marketers to develop creative audio and/or visual messages that can be delivered to consumers in the privacy of their own homes. The emergence of the Internet has enabled marketers to deliver interactive and personalized campaign messages via multiple platforms, thus making it easier for marketers to craft messages that are specifically tailored to a particular audience or even a particular consumer. Internet-based marketing channels also facilitate the process of tracking consumer response, if any, to specific marketing communications. In particular, digital marketing techniques have made it possible for a marketer to record and evaluate a wide range of interactions that occur between marketers and consumers, thereby providing data upon which the overall efficacy of a marketing campaign can be evaluated.
The increasing sophistication of multichannel marketing campaigns has resulted in a corresponding increase in the complexity involved in understanding how different marketing activities influence consumer behavior. For example, a consumer may encounter multiple advertisements for the same product, each delivered via a different marketing channel, before finally deciding to make a purchase from a marketer. These encounters may be spread out over a period of days, weeks, or longer. Adding to this complexity, the consumer may also interact with the marketer in ways not specifically associated with the marketing campaign, such as by having made a prior purchase or by making an unsolicited phone inquiry. Each of these marketer-consumer interactions, regardless of whether specifically associated with the marketing campaign, has the potential to affect the consumer's behavior in a particular way. Even where interactions can be individually tracked in a straightforward manner, such as in the realm of digital marketing, the marketer will still find it difficult to efficiently allocate resources without a clear understanding of how the observed interactions influence consumer behavior.
A number of analytical techniques have been applied to better understand how interactions between a marketer and a consumer affect the consumer's behavior. One such technique, referred to as marketing mix modeling (MMM), applies multivariate regression to sales and marketing time series data to estimate how various marketing tactics influence sales. MMM attempts to define the effectiveness of a marketing tactic in terms of its contribution to sales volume and efficiency. However, because it is limited to a temporal analysis, MMM cannot provide causation inferences that are based on particular users, particular market segments, or particular marketing tactics that may have been applied simultaneously with other marketing tactics. MMM also tends to confuse correlation with causation.
Another analytical technique that has been applied in this regard is attribution modeling. In general, the process of allocating credit among marketer-consumer interactions for a particular outcome, such as for a purchase, is referred to as attribution. Attribution modeling can therefore be understood as the process of measuring, quantifying, and assigning credit to a plurality of interactions in a way that reflects the influence that each interaction has on a particular outcome. While attribution modeling represents an improvement over MMM in that it allows user- and channel-based inferences to be drawn, existing attribution modeling techniques still suffer from a number of shortcomings. Perhaps most significantly, many existing attribution models are based on arbitrary rules that, while simple to apply, ignore the nuances of a multichannel marketing campaign. For example, the last-touch attribution (LTA) model attributes an observed behavior to the marketer-consumer interaction—also referred to as a “touch”—that immediately preceded the observed behavior. Multi-touch attribution (MTA) models acknowledge that multiple interactions can each share a fraction of the credit for a particular outcome, but still tend to rely on arbitrary rules with respect to how to allocate such credit amongst the multiple interactions. Moreover, existing LTA and MTA models do not provide quantifiable outcomes, such as specific predictions with respect to order placement or revenue generation that can be attributed to individual marketing channels. The shortcomings associated with existing MMM and attribution modeling techniques therefore represent a substantial impediment to marketing analysts who seek to quantify the incremental effect of a marketing channel that forms part of a multichannel marketing campaign.
Thus, and in accordance with certain of the embodiments disclosed herein, techniques are disclosed for evaluating the incremental effect of a marketing channel that forms part of a multichannel marketing campaign. Such techniques could be used as part of a marketer's overarching strategy of optimizing resource allocation across a marketing campaign. For example, in one implementation data characterizing observed marketing interactions and outcomes is collected, wherein the marketing outcomes are expressed in terms of a binary conversion parameter. A conversion probability is estimated as a function of the observed interactions using logistic regression techniques, wherein converting and non-converting consumers comprise two classes upon which the regression is based. As a result, marketing interactions that are relatively more commonplace amongst converting consumers (as compared to non-converting consumers) receive greater attribution for observed conversions. It will be appreciated that any other suitable statistical model that estimates probability of a given outcome across different populations can be used in this regard. The estimated conversion probability is then used to predict an incremental quantity of conversions that can be attributed to a kth marketing channel based on the average treatment effect. Based on these predictions, it is possible to evaluate the extent to which market segment variables influence how attribution is distributed amongst various marketing channels. Numerous configurations and variations of this example implementation will be apparent in light of this disclosure.
A number of advantages are associated with one or more of the disclosed embodiments. For example, unlike MMM techniques and existing attribution modeling techniques, certain of the disclosed embodiments use an econometric model that is capable of estimating an incremental quantity of conversions that can be attributed to a given marketing channel. This model can be extended to estimate other desired outcomes, such as revenue generation, orders fulfilled, or votes won. As a result, such embodiments generate causal interpretations which are tied to measurable estimates in terms of metrics that are important to marketers, such as orders and revenue. This approach also captures interaction effects between multiple channels, which is particularly important where combining marketing tactics have a synergistic effect that produces results which are greater than the sum their individual contributions. In addition, certain of the disclosed embodiments improve upon existing attribution modeling techniques by eliminating biases that are inherent to the rule-based approach that such techniques rely upon. For example, LTA models tend to attribute excess importance to a “direct” marketing channel associated with consumers who directly navigate to a marketer's website. However, because the conversion rate is largely unaffected by whether or not a consumer directly navigates to the marketer's webpage, the econometric models disclosed herein attribute a lesser importance to the direct channel and instead attribute greater importance to interactions which may have preceded a direct navigation event.
As used herein, the term “data structure” refers broadly, in addition to its ordinary meaning, to a way of storing and organizing data in a computer accessible memory so that data can be used by an application or software module. A data structure in its simplest form can be, for example, a set of one or more memory locations. In some cases, a data structure may be implemented as a so-called record, sometimes referred to as a struct or tuple, and may have any appropriate number of fields, elements, or storage locations. As will be further appreciated, a data structure may include data of interest or a pointer that refers to a memory location where the data of interest can be found. A data structure may have any appropriate format such as, for example, a lookup table or index format; an array format; a hash table format; a graph, tree, or hierarchal format having a number of nodes; an object format that includes data fields, for instance similar to a record; or a combination of the foregoing. A data structure may include executable code for accessing and modifying the underlying structure and format of the data stored therein. In a more general sense, the data structure may be implemented as a data set that can store specific values without being constrained to any particular order or format. In one embodiment, a data structure comprises a table or graph correlating marketing channels with attribution parameters. In another embodiment a data structure comprises a table or graph correlating market segment identifiers with an importance quantifier that provides a measure of the extent to which attribution models differ for the identified market segment. Numerous other data structure formats and applications will be apparent in light of this disclosure.
As used herein, the terms “marketer” and “consumer” refer broadly, in addition to their ordinary meanings, to an originator and a recipient, respectively, of a marketing communication. Examples of marketers include a person or a company selling products and/or services; a government official encouraging citizens to volunteer for military service; and a politician stumping for votes. Corresponding examples of consumers include potential customers who are considering making a purchase from the person or company selling the product and/or service; a citizen considering enlisting in the armed forces; and a voter deciding how to cast a ballot. It will be appreciated that both marketers and consumers may refer to individual people, groups of people, or legal organizations. For example, in some cases the term marketer may refer generally to both a seller and a person or organization that the seller has designated to organize and manage a marketing campaign on the seller's behalf.
As used herein, the term “marketing channel” refers broadly, in addition to its ordinary meaning, to a way in which a marketer can interact and/or communicate with a consumer. Examples of conventional marketing channels include broadcast television advertising, direct mail solicitation, door-to-door campaigns, and display advertising. In the context of digital marketing, examples of marketing channels include search engine optimization, banner advertisements, electronic mail communications, and social networking. However, the term marketing channel encompasses not only the way in which a marketer interacts—or “touches”—a consumer, but also the marketer's communication as well. Thus, for example, while direct mail can be understood as a marketing channel in a general sense, a particular direct mail communication distributed to a particular demographic can also be understood as a marketing channel. Thus a marketing campaign that uses only direct mail solicitation, but that sends ten different communications to ten different target audiences can still be considered to be a multichannel marketing campaign. A marketing channel may also be referred to as a “consumer touch channel”.
As used herein, the term “conversion” refers broadly, in addition to its ordinary meaning, to achievement of a result that is considered to be the goal of a marketing campaign. For example, in the context of a sales campaign, conversion may refer to a desired endpoint such as executing a sale or receiving an order. Or, in the context of a military recruitment campaign, conversion may refer to enlistment of a new recruit. In general, conversion can be understood as referring to an observed event, the occurrence of which can be attributed to one or more marketing activities. A “conversion probability” can therefore be understood as representing the likelihood that a particular consumer will act in a particular way. In certain of the embodiments disclosed herein conversion probability can be used as the basis for estimating an incremental quantity of conversions that are attributed to a particular marketing channel.
System Architecture
In one embodiment campaign management server 300 comprises one or more enterprise class devices configured to provide a range of services that may be invoked in the management of one or more marketing campaigns. Examples of such services include the capacity to host marketing assets, respond to requests to deliver the hosted assets to consumers 100 via designated marketing channels 200a, 200b, 200c, and provide ecommerce services to consumers 100. For example, in one implementation campaign management server 300 includes an asset delivery module 310 that is capable of managing the delivery of marketing assets to consumers 100 via marketing channels 200a, 200b, 200c. The marketing assets may be retained in a marketing asset store 330 that is local to campaign management server 300, may be retained in one or more networked storage repositories, or may be retained using a combination of local and remote storage resources. Although one campaign management server is illustrated in
Still referring to
In embodiments wherein the goal of the marketing campaign is to motivate consumers 100 to complete a financial transaction, such as by making a purchase, campaign management server 300 is optionally configured to provide ecommerce services to consumers 100 via an ecommerce portal 320. In such embodiments, one or more of the marketing assets distributed to consumers 100 may include a hyperlink that enables consumers 100 to easily access the services provided by ecommerce portal 320. In alternative embodiments wherein the goal of the marketing campaign is to motivate consumers to take action that is not directly related to a financial transaction, such as enlisting in the armed forces, volunteering time for a charitable cause, or voting for a political candidate, ecommerce portal 320 can be replaced with an appropriate consumer interaction portal that helps consumers compete the desired action. It will be appreciated that in alternative embodiments the services provided by ecommerce portal 320 can instead be provided by a separate networked ecommerce server or consumer interaction server that is distinct from campaign management server 300.
Regardless of the context in which it is implemented, ecommerce portal 320 (or an alternate consumer interaction portal) can be configured to operate in conjunction with a consumer response log 350 that maintains a data structure that indexes results of the observed marketer-consumer interactions. For example, in one embodiment consumer response log 350 is configured to work in conjunction with ecommerce portal 320 to record consumer purchase events. In such case, purchase events are recorded regardless of whether the purchasing consumer interacted with the marketer before the purchase event. Consumer response log 350 can also be configured to record other parameters that further characterize the consumer response, such as revenue generated as the result of a purchase, date and time of a purchase, and user profile information. In particular, recording the date and time of a purchase allows the purchase point to be compared to dates and times at which the purchasing consumer may have received marketing communications. In embodiments implemented using one or more remotely-located ecommerce portals, consumer response log 350 can be configured to index marketing outcomes from such multiple portals 320. Likewise, in alternative embodiments wherein the goal of the marketing campaign is to motivate consumers to take action that is not directly related to a financial transaction, consumer response log 350 can be configured to record data characterizing the consumer response, such as whether the consumer decided to serve as a volunteer for a charitable cause or who the consumer voted for in an election. In general, it will be appreciated that consumer response log 350 can use a wide range of existing and subsequently-developed data tracking and monitoring techniques to collect information from diverse sources that characterize consumer behavior.
Referring again to the example embodiment illustrated in
Processor 410 can be implemented using any suitable processor, and may include one or more coprocessors or controllers, such as an audio processor or a graphics processing unit, to assist in processing operations of campaign analysis server 400. Likewise, memory 420 can be implemented using any suitable type of digital storage, such as one or more of a disk drive, a universal serial bus (USB) drive, flash memory, random access memory (RAM), or any suitable combination of the foregoing. Memory 420 can be used, for example, to store analytical results generated by campaign analysis server 400. Memory 420 can also be used, for example to store data hosted by marketing asset store 330, consumer touch log 340, and/or consumer response log 350. Operating system 430 may comprise any suitable operating system, such as Google Android (Google Inc., Mountain View, Calif.), Microsoft Windows (Microsoft Corp., Redmond, Wash.), or Apple OS X (Apple Inc., Cupertino, Calif.). As will be appreciated in light of this disclosure, the techniques provided herein can be implemented without regard to the particular operating system provided in conjunction with campaign analysis server 400, and therefore may also be implemented using any suitable existing or subsequently-developed platform. Communications adaptor 440 can be implemented using any appropriate network chip or chipset which allows for wired or wireless connection to network 500 and/or other computing devices and/or resources.
Campaign analysis server 400 is coupled to network 500 to allow for communications with other computing devices and resources, such as campaign management server 300. Network 500 may be a local area network (such as a home-based or office network), a wide area network (such as the Internet), or a combination of such networks, whether public, private, or both. In some cases access to resources on a given network or computing system may require credentials such as usernames, passwords, or any other suitable security mechanism. In general, other componentry and functionality not reflected in the schematic block diagram of
Still referring to the example embodiment illustrated in
The embodiments disclosed herein can be implemented in various forms of hardware, software, firmware, or special purpose processors. For example, in one embodiment a non-transitory computer readable medium has instructions encoded thereon that, when executed by one or more processors, cause one or more of the marketing research methodologies disclosed herein to be implemented. The instructions can be encoded using one or more suitable programming languages, such as C, C++, object-oriented C, JavaScript, Visual Basic .NET, BASIC, or alternatively, using custom or proprietary instruction sets. Such instructions can be provided in the form of one or more computer software applications or applets that are tangibly embodied on a memory device, and that can be executed by a computer having any suitable architecture. In one embodiment the system can be hosted on a given website and implemented using JavaScript or another suitable browser-based technology.
The functionalities disclosed herein can optionally be incorporated into a variety of different software applications, such as campaign management applications, or can optionally leverage services provided by other software applications, such as statistical analysis and modeling applications. The computer software applications disclosed herein may include a number of different modules, sub-modules, or other components of distinct functionality, and can provide information to, or receive information from, still other components and/or services. These modules can be used, for example, to communicate with input and/or output devices such as a display screen, a touch sensitive surface, a printer, and/or any other suitable input/output device. Other components and functionality not reflected in the illustrations will be apparent in light of this disclosure, and it will be appreciated that the claimed invention is not intended to be limited to any particular hardware or software configuration. Thus in other embodiments the various components of networked computer system may comprise additional, fewer, or alternative subcomponents as compared to those included in the example embodiment illustrated in
The aforementioned non-transitory computer readable medium may be any suitable medium for storing digital information, such as a hard drive, a server, a flash memory, and/or RAM. In alternative embodiments, the components and/or modules disclosed herein can be implemented with hardware, including gate level logic such as a field-programmable gate array (FPGA), or alternatively, a purpose-built semiconductor such as an application-specific integrated circuit (ASIC). Still other embodiments may be implemented with a microcontroller having a number of input/output ports for receiving and outputting data, and a number of embedded routines for carrying out the various functionalities disclosed herein. It will be apparent that any suitable combination of hardware, software, and firmware can be used in this regard, and that the present invention is not intended to be limited to any particular system architecture.
Methodology and Results
As illustrated in
As illustrated in
Once consumer touch and response data is gathered and provided to campaign analysis server 400, channel attribution module 450 can be configured to build a statistical model that is capable of determining conversion probabilities based on the received data. For example, in one embodiment conversion probability is estimated as a function of the observed interactions using logistic regression techniques, wherein converting and non-converting consumers comprise two distinct classes upon which the regression is based. Other statistical models that are capable of estimating the probability of a given outcome across different populations can also be used in this regard, including the random forests ensemble learning method (which advantageously captures interaction effects) and the Cox proportional hazards model (which advantageously maintains awareness of the time sequence of the observed interactions). In general, P(Yi=1|Xi=xi) can be understood a representing the probability that an event Yi involving an ith consumer results in a conversion given a vector of interactions Xi=xi that is experienced by the ith consumer. For example, the vector Xi may include both the number and type of interactions experienced by the ith individual, as well as the date and time of each observed interaction. Where logistic regression is applied to determine this probability,
where β0, β1, . . . βk are regression coefficients indicating the relative effect of the kth marketing channel. In alternative embodiments the extent to which a marketing tactic influences consumer behavior over time can be modeled by incorporating survival models and/or decay parameters into the logistic regression techniques disclosed herein. Thus in certain embodiments method 2200 further comprises building a statistical model that uses logistic regression to determine a conversion probability for an ith consumer as a function of a vector of interactions between the ith consumer and a marketer using Equation (1). See reference numeral 2230 in
Once the conversion probabilities have been modeled, the resulting probability models can then be used to define an attribution model that predicts the extent to which a consumer's response can be attributed to an observed marketing channel, as quantified by an attribution parameter. This can be accomplished by recognizing that even if a particular marketing channel were terminated, conversions will still occur, even if at a reduced frequency. This incremental effect of terminating a kth marketing channel can therefore be quantified as
δk=Nk−N*k (2)
where Nk represents the number of consumers who converted after interacting with channel k, and N*k represents the number of consumers who would have converted even without interacting with channel k. Since N*k cannot be measured directly, statistical models can be used to provide an estimate. In particular, if Ok represents the number of conversions that can be attributed to the kth marketing channel, and Sk denotes the set of consumers who interacted with the kth channel, then
The vector X*i denotes the vector Xi with the kth channel reduced to zero. Thus in certain embodiments method 2200 further comprises using the statistical model defined by Equation (1) to calculate a difference between a first conversion probability predicated on inclusion of the kth marketing channel in the ith consumer's vector of interactions (that is, P(Yi=1|Xi)) and a second conversion probability predicated on exclusion of the kth marketing channel from the vector (that is, P(Yi=1|Xi). See reference numeral 2240 in
In the ecommerce context, wherein a conversion correlates to a purchase, the revenue Rk attributed to the kth channel can be computed as
where ri is the revenue resulting from the ith consumer's conversion, if any. Thus the attribution parameter Rk is based on a difference between a first conversion probability predicated on inclusion of the kth marketing channel in the ith consumer's vector of interactions (that is, P(Yi=1|Xi) and a second conversion probability predicated on exclusion of the kth marketing channel from the vector (that is, P(Yi=1|Xi). Equations (3) and (4) can be understood as representing the average treatment effect, additional details of which are disclosed in Wooldridge, Introductory Econometrics: A Modern Approach, Cengage Learning, 5th Ed., Section 13.2, pp. 454-459 (2013). The attribution parameters Ok and Rk are optionally normalized such that conversion or revenue attribution can be expressed as a percentage.
Equations (3) and (4) can be used to evaluate the incremental effect, respectively in terms of conversion and revenue, of a marketing channel that forms part of a multichannel marketing campaign. These equations are based on an algorithmically developed probability model that attributes greater significance to marketing interactions that are observed with greater frequency amongst converting consumers (as compared to non-converting consumers). As such, the evaluation provided using this technique may be referred to as a “data driven” attribution model, which distinguishes, for example, an LTA model which is based on an arbitrary allocation rule that is uniformly applied without regard to the observed data. As a result of this distinction, data driven attribution models tend to provide more accurate attribution estimates.
The conversion and revenue attribution models represented by Equations (3) and (4) can be applied to consumer touch and response data collected during a multichannel marketing campaign, thereby resulting in conversion and revenue attribution parameters for each of the channels comprising the campaign. For example, in one implementation a multichannel marketing campaign directed at over 26 million unique consumers in the travel and entertainment experience industry was analyzed. Using Adobe® Analytics (Adobe Systems Incorporated, San Jose, Calif.), approximately 3.6 terabytes of data was collected corresponding to about 2 billion page views. This raw data was subjected to an optional stratification process to reduce subsequent processing times. The stratification, which was based on a time window selected from the overall data collection period, resulted in a smaller training dataset comprising a row for each marketer-consumer interaction, wherein a unique visitor identifier, a date and time, an interaction type, a binary (yes/no) conversion parameter, and a revenue value (if any) were recorded for each interaction. This training dataset consisted of approximately five million rows. Order and revenue attribution was evaluated for each of the following nine marketing channels which formed part of the overall marketing campaign: display advertising (“display_ad”), social media (“social_media”), email advertising (“email”), referrals from websites not affiliated with the marketer (“other_websites”), search engine advertising (“search_ad”), referrals form travel agents (“travelagents”), referrals from websites affiliated with the marketer (“other_owned”), direct navigation to the marketer's website (“direct”), and organic search engine referrals (“search”).
Likewise,
Referring again to
To perform segment detection, a more general version of Equation (1) is invoked, wherein xijk is the number of interactions of the ith individual, who is a member of the jth market segment, with the kth marketing channel. In this case, the likelihood L(β; x, y) that all members of the market segment respond in the same way to the xijkth interaction is given by
where the outcome vector y includes a yith result. If the likelihood L(β; x, y) is to be calculated using different intercept and slope terms in the logistic regression for each market segment j, where J is a variable defining market segment j, the likelihood is given by
The market segment variable J can be used to define a particular market segment j. For example, the market segment variable “country” (J) defines a particular market segment “users from Latin America” (j), among others. The market segment variables can be ordered based on the Akaike information criterion (AIC) for each variable, which is defined as
AICj=2l−2 ln [L(β,J;x,y)], (7)
where l is the number of parameters that are estimated in Equation (6). See reference numeral 2250 in
The AIC parameter provided by Equation (7) can be calculated based on consumer touch and response data collected during a multichannel marketing campaign. This results in an indication of which types of marketing segments respond particularly well (or poorly) to different marketing channels. For example, in one embodiment the aforementioned multichannel marketing campaign data which was used as the basis for the attribution data illustrated in
For example,
As would be expected from the relatively low AICJ value for the marketing variable “mobileos”,
Numerous variations and configurations will be apparent in light of this disclosure. For instance, one example embodiment provides a method for evaluating the incremental effect of a marketing channel. The method comprises receiving consumer touch data that characterizes interactions between at least one marketer and a plurality of consumers. Each of the interactions is associated with at least one of a plurality of marketing channels. The method further comprises receiving consumer response data that characterizes an outcome of each of the interactions in terms of a conversion parameter. The method further comprises generating a statistical model that is configured to determine a conversion probability as a function of a vector of a subset of the interactions. The statistical model is based on the consumer touch data and the consumer response data. The method further comprises, for a particular one of the plurality of marketing channels, determining an attribution parameter based on a first conversion probability predicated on inclusion of the particular marketing channel in the vector and a second conversion probability predicated on exclusion of the particular marketing channel from the vector. The first and second conversion probabilities are calculated based on the statistical model. In some cases the consumer touch data and the consumer response data are received from a campaign management server configured to deliver marketing assets to the plurality of consumers via the plurality of marketing channels. In some cases the consumer touch data and the consumer response data are received concurrently. In some cases (a) the outcome of each of the interactions is further characterized by a revenue value; and (b) the statistical model is further configured to determine an expected revenue as a function of the vector. In some cases (a) the conversion parameter is a binary parameter that indicates whether a particular consumer placed an order; and (b) the outcome of each of the interactions is further characterized by a revenue value. In some cases the statistical model is selected from a group consisting of logistic regression, random forests ensemble learning, and Cox proportional hazards model. In some cases (a) the attribution parameter is expressed in terms of an attribution percentage; and (b) the attribution parameter is determined for each one of the plurality of marketing channels. In some cases the method further comprises (a) determining the attribution parameter for each of the plurality of marketing channels; and (b) generating a bar chart illustrating the attribution parameters for each of the plurality of marketing channels. In some cases (a) the outcome of each of the interactions is further characterized by a revenue value; (b) the statistical model is further configured to determine an expected revenue as a function of the vector of a subset of the interactions; and (c) the method further comprises, for a particular one of the plurality of marketing channels, determining a revenue attribution parameter based on a difference between a first expected revenue predicated on inclusion of the particular marketing channel in the vector and a second expected revenue predicated on exclusion of the particular marketing channel from the vector, wherein the first and second expected revenues are calculated based on the statistical model. In some cases (a) each of the consumers belongs to at least one of a plurality of market segments; (b) the plurality of market segments are collectively defined by a market segment variable; (c) a collection of attribution parameters are determined for each of the market segments; and (d) the method further comprises determining a Akaike information criterion coefficient that correlates the market segment variable with an extent to which the collection of attribution parameters varies for the different market segments defined by the market segment variable.
Another example embodiment of the present invention provides a system for attributing consumer behavior to a marketing channel. The system comprises a channel attribution module. The channel attribution module is configured to generate a statistical model that is configured to determine a conversion probability as a function of a vector of marketer-consumer interactions, wherein the vector is associated with a plurality of marketing channels through which the interactions are communicated. The channel attribution module is further configured to determine a plurality of attribution parameters, each of which is based on a difference between a first conversion probability predicated on inclusion of a particular marketing channel in the vector and a second conversion probability predicated on exclusion of the particular marketing channel from the vector. The system further comprises a segment detection module configured to determine a coefficient that correlates a market segment variable with fluctuations in the determined attribution parameters amongst market segments that are defined by the market segment variable. In some cases the statistical model is further configured to determine an expected revenue as a function of the vector of marketer-consumer interactions. In some cases the channel attribution module and the segment detection module form part of a campaign analysis server that is configured to receive consumer touch data that characterizes the marketer-consumer interactions. In some cases the system further comprises a user interface module configured to generate a bar chart illustrating the coefficient for a plurality of marketing segment variables. In some cases the system further comprises a user interface module configured to receive a user query that identifies a plurality of marketing segment variables for which the coefficients are to be determined. In some cases the coefficient is an Akaike information criterion coefficient.
Another example embodiment of the present invention provides a computer program product encoded with instructions that, when executed by one or more processors, cause a segment detection process to be carried out. The process comprises receiving consumer touch data that characterizes interactions between a marketer and a plurality of consumers. Each of the interactions is associated with at least one of a plurality of marketing channels. Each of the consumers belongs to at least one of a plurality of market segments. The plurality of market segments are collectively defined by a market segment variable. The process further comprises receiving consumer response data that characterizes an outcome associated with each of the interactions in terms of a conversion parameter. The process further comprises, for each of the market segments, determining a collection of attribution parameters. Each of the attribution parameters represents an extent to which the outcome is attributed to each of the marketing channels. The process further comprises determining a coefficient that correlates the market segment variable with an extent to which the collection of attribution parameters varies for the market segments defined by the market segment variable. In some cases (a) the consumer response data further characterizes the outcome associated with each of the interactions in terms of revenue generated; and (b) for each of the market segments, determining a second collection of attribution parameters, wherein each of the attribution parameters in the second collection represents an extent to which the revenue generated is attributed to each of the marketing channels. In some cases the consumer touch data characterizes interactions between a plurality of marketers and a plurality of consumers. In some cases the marketing segment detection process further comprises (a) generating a first bar chart illustrating the coefficient for a plurality of market segment variables; and (b) generating a second bar chart illustrating the collection of attribution parameters for a particular market segment that is defined by one of the plurality of market segment variables. In some cases (a) the collection of attribution parameters are expressed in terms of a percentage; and (b) a sum of the attribution parameters for the plurality of marketing channels used to interact with consumers in a particular market segment is 100%.
The foregoing detailed description has been presented for illustration. It is not intended to be exhaustive or to limit the disclosure to the precise form described. Many modifications and variations are possible in light of this disclosure. Therefore it is intended that the scope of this application be limited not by this detailed description, but rather by the claims appended hereto. Future filed applications claiming priority to this application may claim the disclosed subject matter in a different manner, and may generally include any set of one or more limitations as variously disclosed or otherwise demonstrated herein.