A content provider may provide one or more content items for display on a website or other online resource. The content providers may provide the content items by providing and winning bids on keywords. A keyword may be a specific term or phrase, and the content provider may bid on the keyword to provide a content item that is related to the keyword. If the content provider wins the bid for the keyword, the content provider may then provide the related content item for display on the resource.
A content provider may have a budget to spend on keyword bids over a fixed length of time. The content provider may wish to spend all of the fixed budget on keyword bids. The content provider may wish to spread the budget across all keywords such that the conversion value (e.g., a return on investment or gain on investment) on the entire budget is maximized for the content provider. For example, different content items provided for different keywords may have different values to the content provider. The return or gain on investment for the content provider may be represented as one or more of a number of user actions associated with the content item, transaction revenue associated with the content item (e.g., when a product or service is sold to a user through the content item), a number of views or impressions of the content item, or otherwise.
One implementation of the present disclosure relates to a method for maximizing a conversion value for content provided by a content provider based on a fixed budget. The conversion value may relate to a gain on investment to the content provider. The content may be provided to a user device accessing a resource. The method includes receiving a total budget from the content provider and receiving a set of keywords for bidding on by the content provider. The method further includes determining a conversion value for each keyword; wherein the conversion value is based on a conversion ratio, number of conversions, and value of each conversion. The method further includes determining a cost for each keyword, wherein the cost is based on a cost per click metric and a number of clicks. The method further includes calculating a bid for each keyword based on a comparison of the conversion value for each keyword and the cost for each keyword.
Another implementation of the present disclosure relates to a system for providing content to a user device accessing a resource by maximizing conversion value of the content based on a fixed budget. The system includes a processing circuit. The processing circuit is configured to receive a total budget from a content provider and a set of keywords for bidding on by the content provider. The processing circuit is further configured to determine a conversion value for each keyword, wherein the conversion value is based on a conversion ratio, number of conversions, and value of each conversion. The processing circuit is further configured to determine a cost for each keyword, wherein the cost at least partially includes a keyword bid. The processing circuit is further configured to calculate a bid for each keyword based on a comparison of the conversion value for each keyword and the cost for each keyword.
Another implementation of the present disclosure relates to a computer readable storage medium having instructions stored therein, the instructions being executable by one or more processors to cause the one or more processors to perform operations. The instructions include receiving a total budget from a content provider and receiving a set of keywords for bidding on by the content provider. The instructions further include determining a conversion value for each keyword, wherein the conversion value is based on a conversion ratio, number of conversions, and value of each conversion. The instructions further include determining a cost for each keyword, wherein the cost at least partially includes a keyword bid. The instructions further include calculate a bid for each keyword based on a comparison of the conversion value for each keyword and the cost for each keyword.
These implementations are mentioned not to limit or define the scope of the disclosure, but to provide an example of an implementation of the disclosure to aid in understanding thereof. Particular implementations may be developed to realize one or more of the following advantages.
The details of one or more implementations of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages of the subject matter will become apparent from the description, the drawings, and the claims.
Referring generally to the figures, systems and methods for maximizing conversion value for content provided by a content provider are shown and described. The content provider may specify a fixed budget to spend on content keyword bids. The systems and methods described herein may determine a bid for each keyword such that the total budget is spent and the total conversion value for all provided content is maximized. The conversion value may be any metric representative of a gain on the content provider's investment (e.g., the content provider's budget) such as a number of views or impressions of the content, transaction revenue resulting from displaying the content, or otherwise.
The systems and methods described herein may be applied for a fixed budget of the content provider. Instead of determining bid amounts for each keyword independent of the content provider's budget, the total budget may be used as one factor in determining an optimal bid for each individual keyword. After determining an initial bid value for each keyword, the bids may be adjusted via a feedback control loop such that the total amount spent on each keyword bid does not exceed the total budget. This allows the content provider to maximize a conversion value of the content without exceeding a fixed amount.
Further, the systems and methods of the present disclosure allow a content provider to determine keyword bids for individual keywords instead of a group of keywords (e.g., a content group). For example, instead of providing a bid for a group of keywords that are related to one another, bids may be provided to each individual keyword of one or more groups. Therefore, if content for one keyword is better performing for the content provider than content for another keyword, the budget of the content provider may be allocated appropriately.
In one implementation of the present disclosure, conversion value may be represented as a number of conversions (e.g., a number of actions or transactions as a result of the content provided to user devices). In such a case, the conversion value may be represented as a number of conversions multiplied by the value of each conversion (assuming the content provider wishes to treat each action or transaction equally). For example, if there are ten conversions and the content provider sets a cost per action (CPA) of $5 (e.g., an amount the content provider pays per action), the conversion value is $50.
In one implementation of the present disclosure, conversion value may be represented as transaction revenue. In such a case, the conversion value may be represented as the sum of revenue from all transactions. Each transaction may have a different value based on the revenue associated with each particular content. It should be understood that the conversion value may be any other type of value such that the implicit value of each conversion is the same.
Referring to
Still referring to
Referring still to
Since the derivative of the average return ratio may be hard to calculate due to the dynamics of an online auction, the average return ratio itself may be used as an approximation. While the present disclosure refers to the average return ratio being equal for each keyword, it should be understood that the systems and method herein may be applied for a derivative value of the average return ratio as well.
The conversion value for a keyword may be based on a conversion ratio, number of conversions of the keyword, and the value of each conversion. The cost of each keyword may be based on a cost per click metric and a number of clicks of the content associated with the keyword. Therefore, the average return ratio for a single keyword may be represented as follows:
where CVR is the conversion ratio of the keyword, V is the value of each conversion, and CPC is the cost per click metric. Therefore, since the value of each conversion is fixed, if the cost per click and conversion ratio are kept proportional across each keyword, the bids across each keyword are optimized. For a single keyword, a bid for the keyword may then be calculated as:
B
i
=μ*CVR
i
where μ is a control feedback loop parameter. This control parameter is used to limit the amount of each bid for a keyword to ensure that the total of all bids does not exceed the budget. The control parameter μ is based on the content provider's budget, a time period for which the budget is to be spent during, a daily spend rate for the keyword, and an expected spend rate for the keyword. The calculation of μ and the bids for each keyword based on the average return ratio is shown in greater detail in
Referring now to
Still referring to
Still referring to
Still referring to
Still referring to
Still referring to
According to various implementations, content sources 206 may provide resource data that includes one or more content tags to client devices 208. In general, a content tag may be any piece of resource code associated with including content with a resource. According to various implementations, a content tag may define a slot on a resource for additional content, a slot for out of page content (e.g., an interstitial slot), whether content should be loaded asynchronously or synchronously, whether the loading of content should be disabled on the resource, whether content that loaded unsuccessfully should be refreshed, the network location of a content source that provides the content (e.g., content sources 206, content management system 204, etc.), a network location (e.g., a URL) associated with clicking on the content, how the content is to be rendered on a display, one or more keywords used to retrieve the content, and other functions associated with providing additional content with a resource. For example, content sources 206 may provide resource data that causes client devices 208 to retrieve content from content management system 204. In another implementation, the content may be selected by content management system 204 and provided by a content source 206 as part of the resource data sent to client device 208.
Still referring to
Content selected by content management system 204 may be provided to a client device 208 by content sources 206 or content management system 204. For example, content management system 204 may select content from content sources 206 to be included with a resource served by a content source 206. In another example, content management system 204 may provide the selected content to a client device 208. In some implementations, content management system 204 may select content stored in memory 212 of a client device 208. The content may be selected based on an interest profile of the user, in one implementation. For example, content management system 204 may select content such that the topic or subject of the content is a match with a topic or subject associated with the interest profile.
An identifier associated with client device 208 and/or a user of client device 208 may be used to help select content. For example, the identifier may be used to identify an interest profile, and the interest profile may be used to select content. The identifier may refer to any form of data that may be used to represent a user that has chosen to receive relevant content selected by content management system 204. In some implementations, an identifier may be associated with one or more client identifier that identifies a client device (e.g., mobile device, desktop computer, laptop computer, PDA, smart phone, computer network, etc.) to content management system 204 or may itself be the client identifier.
For situations in which the systems and method discussed herein collect personal information about users, or may make use of personal information, the users may be provided with an opportunity to control whether programs or features may collect personal information (e.g., information about a user's social network, social actions or activities, a user's preferences, or a user's current location), or to control whether and/or how to receive content from the content management system that may be more relevant to the user. In addition, certain data may be anonymized in one or more ways before it is stored or used by content management system 204, so that personally identifiable information is removed when generating monetizable parameters (e.g., monetizable demographic parameters). For example, a user's identity may be anonymized so that no personally identifiable information can be determined for the user, or a user's geographic location may be generalized where location information is obtained (such as to a city, ZIP code, or state level), so that a particular location of the user cannot be determined. Thus, the user may have control over how information is collected about him or her and used by content management system 204.
The content provided by content sources 206 may be advertisements. The advertisements may be image advertisements, flash advertisements, video advertisements, text-based advertisements, or any combination thereof. It should be understood that while the present disclosure is implemented for advertisements, the type of advertisement or other content displayed via a client device 208 may vary according to various implementations.
System 200 is illustrated as an example environment for use with the systems and methods of the present disclosure; in various implementations, system 200 may include more or less systems and modules for use with the systems and methods of the present disclosure.
Referring now to
Bid management system 302 may receive a set of keywords 304 and provide a set of keyword bids 306 to content management system 204. Content source 206 may include an interface 308 for sending and receiving information from content management system 204 and other components of system 200. Interface 308 may be configured to facilitate communications, either via a wired connection or wirelessly, with the components of system 200.
Referring now to
Referring still to
Still referring to
B
i
=μ*CVR
i
where CVR is the predicted conversion ratio received from keyword data 312 and where μ is a control feedback loop parameter as described above.
Keyword bid module 314 may further be configured to calculate the control parameter μ as part of the keyword bid calculation. The control parameter μ may be calculated based on budget information 310 and a previous control parameter value. In one implementation, the control parameter μ may be calculated based on the total budget of content source 206, a period of time in which to spend the budget (e.g., one month), and a portion of the total budget to spend for a specified portion of the period of time (e.g., for a time period of 20 days, spend 5% of the total remaining budget for the next day). The budget information may generally be used to calculate a run rate that is representative of a difference between an amount of the budget the content source is willing to spend against an expected amount the content provider expects to pay for keyword bids based on the current keyword bid values of the content provider. This run rate may then be used to adjust the control parameter μ. An example calculation of the control parameter μ and keyword bid using the budget information is shown in greater detail in
The bid management system of
Referring now to
Still referring to
Referring still to
Referring still to
Referring now to
Referring still to
Referring still to
Referring still to
if run rate>1,then μ=μ(1−ε)
if run rate<1,then μ=μ(1+ε).
If the run rate is greater than one, then the actual daily spend is greater than the expected daily spend; therefore μ should be decreased in order to decrease the amount spent on a keyword bid. If the run rate is greater than one, then the expected daily spend is greater than the actual daily spend; therefore μ should be increased since there is room in the budget to increase keyword bids. ε may be a small fixed value selected by the content provider and represent a small incremental increase in a keyword bid relative to the budget. For example, ε may be assigned a value of 5% (e.g., for each calculation of the control parameter μ, it is increased or decreased by 5%).
In another implementation, the control parameter calculated at block 512 may be the control feedback loop output used in block 410 of
μ=μ(1+p(1−run rate)).
Referring still to
B
i
=μ*CVR
i
where Bi is the keyword bid for the ith keyword in the set of keywords and CVR, is a predicted conversion ratio for the keyword. At block 516, the control parameter μ may be stored for use in the next calculation of the control parameter.
Referring generally to the process of
Referring now to
The calculation of the initial value of the control parameter μ may include solving the following equation:
projected CPCi=μ*pCVRi
where the projected CPC is the projected cost per click for the keyword and pCVR is the predicted conversion ratio for the keyword. The predicted conversion ratio for the keyword may be provided at, for example, block 504 of process 500. For the projected cost per click, the following equation holds:
Σprojected CPCi*projected clicksi=budget.
In other words, the total spent on an individual keyword i is the projected clicks associated with the keyword times the projected cost per click associated with the keyword, and the sum of spend on each keyword should equal the total budget. Estimating the projected clicks for a keyword can result in calculating a projected cost per click for each keyword, and therefore calculating the control parameter.
Referring still to
In another implementation, a linear interpolation method may be used in block 602. If there are two or more sets of data points, then an upper set of data points and a lower set of data points (e.g., a first click and bid (ci1 and bi1) and a second click and bid (ci2 and bi2)) may be selected. Each set of data points may include a number of clicks and a bid amount for a given keyword for a given time frame. The upper and lower set of data points may represent a highest and lowest number of clicks and bids associated with the keyword. Linear interpolation may then be used as a curve fitting method that takes a bid amount and corresponds it with a projected click amount (see block 606 for further mathematical representation of the calculation).
Referring still to
In one implementation, if a linear extrapolation method is used as described above, the calculation of the control parameter μ may be represented as:
In another embodiment, if a linear interpolation method is used as described above, the calculation of the control parameter μ may be represented as:
where ci1 and bi1 are data points for a first click and first bid and ci2 and bi2 are data points for a second click and second bid.
The process of
If a keyword is “new” and there is insufficient statistics for the keyword, a trial run may be used for the keyword. If, for example, 50% of keywords in a particular content group were “created” in the last seven days or another specified timeframe, then a trial run may be used to collect a first set of data points for the new keywords. In the trial run, for the new keywords, a default target position or value may be assigned to the keywords.
In the implementations of
In one implementation of the present disclosure, the systems and methods of
In one implementation, in addition to using the total budget constraint as described in
In one implementation, a content provider may place a different weight or value on each conversion. In such an implementation, the content provider may place a higher weight or value on a conversion related to one particular keyword or keyword group compared to other keywords or keyword groups. In such an implementation, the average return ratio may be represented as:
In other words, for a first portion of the total number of conversions
and a second portion of the total number of conversions
a weight is assigned for each such conversion by the content provider. The weight for a particular keyword i may be represented as:
Further, the content provider may use the weights to create a mixture of number of conversions and transaction revenue to use as the conversion value for the algorithms described herein. For example, a weight for a particular keyword may be calculated as follows:
The weight for keyword i is calculated by taking a first portion of the total conversions
multiplied by a cost per action for those conversions plus a second portion of the total conversions
times a revenue associated with those conversions.
The systems and methods of the present disclosure are described with reference to maximizing conversion value. In an alternative implementation, the systems and methods herein may be used to maximize transaction revenue. As described with reference to
Therefore, if the cost per click is kept proportional to the conversion ratio times the average revenue for each keyword, the systems and methods herein can be used to determine optimal keyword bids. Therefore, a bid bi for a keyword i may be represented as:
B
i
=μ*CVR
i*average revenue,
wherein the average revenue for the keyword in the previous evaluation period (e.g., one day) is used.
Referring now to
Referring still to
Referring still to
Referring still to
Computing system 700 may be coupled via bus 702 to a display 714, such as a liquid crystal display, or active matrix display, for displaying information to a user. An input device 712, such as a keyboard including alphanumeric and other keys, may be coupled to bus 702 for communicating information and command selections to processor 704. In another implementation, input device 712 has a touch screen display 714. Input device 712 may include a cursor control, such as a mouse, trackball, or cursor direction keys, for communicating direction information and command selections to processor 704 and for controlling cursor movement on display 714.
According to various implementations, the processes described herein can be implemented by computing system 700 in response to processor 704 executing an arrangement of instructions contained in main memory 706. Such instructions can be read into main memory 706 from another computer-readable medium, such as storage device 710. Execution of the arrangement of instructions contained in main memory 706 causes computing system 700 to perform the illustrative processes described herein. One or more processors in a multi-processing arrangement may also be employed to execute the instructions contained in main memory 706. In alternative implementations, hardwired circuitry may be used in place of or in combination with software instructions to effect illustrative implementations. Thus, implementations are not limited to any specific combination of hardware circuitry and software.
Although an example computing system has been described with reference to
Implementations of the subject matter and the operations described in this specification may be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on one or more computer storage medium for execution by, or to control the operation of, data processing apparatus. Alternatively or in addition, the program instructions may be encoded on an artificially-generated propagated signal (e.g., a machine-generated electrical, optical, or electromagnetic signal) that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. A computer storage medium may be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them. Moreover, while a computer storage medium is not a propagated signal, a computer storage medium may be a source or destination of computer program instructions encoded in an artificially-generated propagated signal. The computer storage medium may also be, or be included in, one or more separate components or media (e.g., multiple CDs, disks, or other storage devices). Accordingly, the computer storage medium is both tangible and non-transitory.
The operations described in this disclosure may be implemented as operations performed by a data processing apparatus on data stored on one or more computer-readable storage devices or received from other sources.
The term “client or “server” include all kinds of apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, a system on a chip, or multiple ones, or combinations, of the foregoing. The apparatus may include special purpose logic circuitry, e.g., a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). The apparatus may also include, in addition to hardware, code that creates an execution environment for the computer program in question (e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them). The apparatus and execution environment may realize various different computing model infrastructures, such as web services, distributed computing and grid computing infrastructures.
The systems and methods of the present disclosure may be completed by any computer program. A computer program (also known as a program, software, software application, script, or code) may be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and it may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code). A computer program may be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
The processes and logic flows described in this specification may be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows may also be performed by, and apparatus may also be implemented as, special purpose logic circuitry (e.g., an FPGA or an ASIC).
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for performing actions in accordance with instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data (e.g., magnetic, magneto-optical disks, or optical disks). However, a computer need not have such devices. Moreover, a computer may be embedded in another device (e.g., a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), etc.). Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks). The processor and the memory may be supplemented by, or incorporated in, special purpose logic circuitry.
To provide for interaction with a user, implementations of the subject matter described in this specification may be implemented on a computer having a display device (e.g., a CRT (cathode ray tube), LCD (liquid crystal display), OLED (organic light emitting diode), TFT (thin-film transistor), or other flexible configuration, or any other monitor for displaying information to the user and a keyboard, a pointing device, e.g., a mouse, trackball, etc., or a touch screen, touch pad, etc.) by which the user may provide input to the computer. Other kinds of devices may be used to provide for interaction with a user as well; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback), and input from the user may be received in any form, including acoustic, speech, or tactile input. In addition, a computer may interact with a user by sending documents to and receiving documents from a device that is used by the user; for example, by sending web pages to a web browser on a user's client device in response to requests received from the web browser.
Implementations of the subject matter described in this disclosure may be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a client computer) having a graphical user interface or a Web browser through which a user may interact with an implementation of the subject matter described in this disclosure, or any combination of one or more such back-end, middleware, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a LAN and a WAN, an inter-network (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks).
While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any disclosures or of what may be claimed, but rather as descriptions of features specific to particular implementations of particular disclosures. Certain features that are described in this disclosure in the context of separate implementations may also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation may also be implemented in multiple implementations separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination may in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the implementations described above should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems may generally be integrated together in a single software product or packaged into multiple software products.
The features disclosed herein may be implemented on a smart television module (or connected television module, hybrid television module, etc.), which may include a processing circuit configured to integrate internet connectivity with more traditional television programming sources (e.g., received via cable, satellite, over-the-air, or other signals). The smart television module may be physically incorporated into a television set or may include a separate device such as a set-top box, Blu-ray or other digital media player, game console, hotel television system, and other companion device. A smart television module may be configured to allow viewers to search and find videos, movies, photos and other content on the web, on a local cable TV channel, on a satellite TV channel, or stored on a local hard drive. A set-top box (STB) or set-top unit (STU) may include an information appliance device that may contain a tuner and connect to a television set and an external source of signal, turning the signal into content which is then displayed on the television screen or other display device. A smart television module may be configured to provide a home screen or top level screen including icons for a plurality of different applications, such as a web browser and a plurality of streaming media services (e.g., Netflix, Vudu, Hulu, etc.), a connected cable or satellite media source, other web “channels”, etc. The smart television module may further be configured to provide an electronic programming guide to the user. A companion application to the smart television module may be operable on a mobile computing device to provide additional information about available programs to a user, to allow the user to control the smart television module, etc. In alternate implementations, the features may be implemented on a laptop computer or other personal computer, a smartphone, other mobile phone, handheld computer, a tablet PC, or other computing device.
Thus, particular implementations of the subject matter have been described. Other implementations are within the scope of the following claims. In some cases, the actions recited in the claims may be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.