INFORMATION PROCESSING DEVICE

Abstract

In order to enable derivation of useful subsets X1, X2, . . . , XT also for an online submodular optimization problem for which a fixed strategy is not effective, an information processing apparatus (1) includes: an objective function setting unit (11) that sets, as an objective function ft in each round t∈[T], a submodular function on a power set 2S of a set S consisting of n elements; and a subset sequence derivation unit (12) that derives a subset sequence X1, X2, . . . , XT∈2S in which an expected value of regret Σt∈[T]ft(Xt)−Σt∈[T]ft(Xt*) with respect to any benchmark X1*, X2*, . . . , Xt*∈2S satisfying Σt∈[T−1]dH(Xt*, Xt+1*) is not more than an upper limit Max (n,T,V).

Description

TECHNICAL FIELD

The present invention relates to an information processing apparatus that solves an online submodular optimization problem.

BACKGROUND ART

Use of online submodular optimization is being considered in order to determine advertisements to be presented to a user regarding web advertising and to determine a product to be sold at a discount in web sales. Online submodular optimization refers to selecting a subset of a given set in each round in order to minimize or maximize a cumulative value of an objective function.

Examples of a known document related to online submodular minimization include Non-patent Literature 1. Patent Literature 1 discloses an algorithm for deriving subsets X₁, X₂, . . . , X_T that minimize an expected value of regret Σ_t∈[T]f_t(X_t)−min_X∈S{Σ_t∈[T]f_t(X)} to not more than O((nT)^1/2). Note here that f_t represents an objective function in a round t.

CITATION LIST

Non-Patent Literature

[Non-patent Literature 1]

E. Hazan and S. Kale, “Online Submodular Minimization”, Journal of Machine Learning Research 13 (2012) 2903-2922

SUMMARY OF INVENTION

Technical Problem

In a method disclosed in Non-patent Literature 1, subsets X₁, X₂, . . . , X_T are derived in which an expected value of regret Σ_t∈[T]f_t(X_t)−min_X∈S{Σ_t∈[T]f_t(X)} is minimized to not more than O((nT)^1/2). This causes the following problem. Specifically, useful subsets X₁, X₂, . . . , X_T can be derived for an online submodular minimization problem for which a fixed strategy to select the same subset in all rounds is effective, whereas useful subsets X₁, X₂, . . . , X_T cannot be derived for online submodular minimization problem for which a fixed strategy is not effective. An online submodular maximization problem also has a similar problem.

An example aspect of the present invention has been made in view of the above problem, and an example object thereof is to provide an information processing apparatus that makes it possible to derive useful subsets X₁, X₂, . . . , X_T also for an online submodular optimization problem for which a fixed strategy is not effective.

Solution to Problem

An information processing apparatus in accordance with an aspect of the present invention includes: an objective function setting means that sets, as an objective function f t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T∈2^S in which an expected value of regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*, X_t+1*)≤V is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,

where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t∪X_t+1*|−|X_t*∩X_t+1*|.

An information processing apparatus in accordance with an aspect of the present invention includes: an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T satisfying the following condition β1 or β2:

the condition β1 being that each subset X_t satisfies |X_t|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying |X_t*|≤k and Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0,

the condition β2 being that the asymptotic behavior of the expected value of the α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t−1*) coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,

where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Advantageous Effects of Invention

An example aspect of the present invention makes it possible to provide an information processing apparatus that makes it possible to derive useful subsets X₁, X₂, . . . , X_T also for an online submodular optimization problem for which a fixed strategy is not effective.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of an information processing apparatus in accordance with a first example embodiment.

FIG. 2 is a flow diagram showing a flow of an information processing method in accordance with the first example embodiment.

FIG. 3 is a flow diagram showing a first specific example of a subset sequence derivation process included in the information processing method shown in FIG. 2.

FIG. 4 is a flow diagram showing the first specific example of the subset sequence derivation process included in the information processing method shown in FIG. 2.

FIG. 5 is a block diagram illustrating a configuration of an information processing apparatus in accordance with a second example embodiment.

FIG. 6 is a flow diagram showing a flow of an information processing method in accordance with the second example embodiment.

FIG. 7 is a flow diagram showing a first specific example of a subset sequence derivation process included in the information processing method shown in FIG. 6.

FIG. 8 is a flow diagram showing the first specific example of the subset sequence derivation process included in the information processing method shown in FIG. 6.

FIG. 9 is a block diagram illustrating a configuration of a computer functioning as the information processing apparatus in accordance with the first example embodiment or the second example embodiment.

BRIEF DESCRIPTION OF DRAWINGS

First Example Embodiment

A first example embodiment of the present invention will be described in detail with reference to the drawings.

Online Submodular Minimization Problem

Considered are (i) a set S consisting of n elements and (ii) an objective function f_t: 2^S→I defined for each round t∈[T]. Note here that n and T each represent any natural number. [T] represents a set of natural numbers not less than 1 and not more than T. 2^S represents a power set of the set S, that is, a set consisting of all subsets of the set S. I represents a closed interval on a real number R. In the first example embodiment, it is assumed that I=[−1,1]. This assumption may affect expressions and values to be described below, but the present invention is not limited to the first example embodiment, and is therefore not limited by the assumption.

It is assumed that each objective function f_t is a submodular function. That is, it is assumed that an inequality f_t(X∪{i})−f_t(X)≥ft(Y∪{i})−f_t(Y) is satisfied for (i) any subset X,Y∈2^S satisfying X□Y and (ii) any element i∈S.

Among problems of selecting a subset sequence X₁, X₂, . . . , X_T∈2^S, a problem whose target is minimization of a cumulative value Σ_t∈Tf_t(X_t) of the objective function f_t is referred to as an “online submodular minimization problem”. In the first example embodiment, the online submodular minimization problem is studied under the following full-information setting or bandit feedback setting.

Full-information setting: After selecting a subset X_t in a round t, it is possible to refer to a value f_t(X) of the objective function f_t with respect to any subset X∈2^S.

Bandit feedback setting: After selecting the subset X_t in the round t, it is (1) possible to refer to a value f_t(X_t) of the objective function f_t with respect to the selected subset X_t and (2) impossible to refer to a value f_t(X) of the objective function f_t with respect to a subset X∈2^S that is different from the selected subset.

Configuration of Information Processing Apparatus

A configuration of an information processing apparatus 1 in accordance with the first example embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram illustrating a configuration of the information processing apparatus 1.

The information processing apparatus 1 is an apparatus for solving the online submodular minimization problem related to the set S consisting of the n elements. As illustrated in FIG. 1, the information processing apparatus 1 includes an objective function setting unit 11 and a subset sequence derivation unit 12.

The objective function setting unit 11 is a means that sets, as the objective function f_t in each round t, a submodular function on the power set 2^S of the set S. The objective function setting unit 11 is an example of an “objective function setting means” in the claims. The submodular function that the objective function setting unit 11 sets as the objective function f_t may be (i) predetermined, (ii) input by a user via a keyboard or the like, or (iii) input by another apparatus via a communication network or the like. The submodular function that the objective function setting unit 11 sets as the objective function f_t may be generated in various processes carried out inside the information processing apparatus 1.

The subset sequence derivation unit 12 is a means that derives a subset sequence X₁, X₂, . . . , X_T satisfying a condition α below. The subset sequence derivation unit 12 is an example of a “subset sequence derivation means” in the claims. The subset sequence X₁, X₂, . . . , X_T that is derived by the subset sequence derivation unit 12 may be provided to a user via a display or the like, or may be provided to another apparatus via a communication network or the like. The subset sequence X₁, X₂, . . . , X_T that is derived by the subset sequence derivation unit 12 may be used in various processes carried out inside the information processing apparatus 1.

The condition α is that an expected value of regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to any benchmark X₁*,X₂*, . . . ,X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*) is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0, where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Flow of Information Processing Method

A flow of an information processing method S1 in accordance with the first example embodiment will be described with reference to FIG. 2. FIG. 2 is a flow diagram showing the flow of the information processing method S1.

The information processing method S1 is a method for solving the online submodular minimization problem related to the set S consisting of the n elements. As illustrated in FIG. 2, the information processing method S1 includes an objective function setting process S11 and a subset sequence derivation process S12. The information processing method S1 is carried out by, for example, the information processing apparatus 1.

The objective function setting process S1 is a process for setting, as the objective function f_t in the each round t, the submodular function on the power set 2^S of the set S. The objective function setting process S11 is carried out by, for example, the objective function setting unit 11 of the information processing apparatus 1. The subset sequence derivation process S12 is a process for deriving the subset sequence X₁, X₂, . . . , X_T satisfying the condition α shown in the previous section. The subset sequence derivation process S12 is carried out by, for example, the subset sequence derivation unit 12 of the information processing apparatus 1.

Effect of Information Processing Apparatus and Information Processing Method

In the method disclosed in Non-patent Literature 1, subsets X₁, X₂, . . . , X_T that cause an expected value of regret Σ_t∈[T]f_t(X_t)−min_X∈S{Σ_t∈[T]f_t(X)} to be not more than an upper limit Max (n,T) determined in accordance with n,T. Thus, useful subsets X₁, X₂, . . . , X_T can be derived for the online submodular minimization problem for which a fixed strategy to select the same subset in all rounds is effective, whereas the useful subsets X₁, X₂, . . . , X_T cannot be derived for the online submodular minimization problem for which a fixed strategy is not effective.

In contrast, in the information processing apparatus 1 and the information processing method S1 in accordance with the first example embodiment, the subsets X₁, X₂, . . . , X_T are derived in which the expected value of the regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) is not more than the upper limit Max (n,T,V) determined from n,T,V. In this case, a benchmark X₁*, X₂*, . . . , X_t* need only satisfy Σ_t∈[T−]d_H(X_t*,X_t+1*)≤V and need not be constant. It is therefore possible to derive the useful subsets X₁, X₂, . . . , X_T also for the online submodular minimization problem for which the fixed strategy is not effective.

First Specific Example of Subset Sequence Derivation Process

The inventors of the present invention have succeeded in proving, regarding the online submodular minimization problem in full-information setting, the following theorem A.

Theorem A: If a subset sequence X₁, X₂, . . . , X_T∈2^[n] is a subset sequence derived by an algorithm shown in Table 1 below, the following inequality (1) holds true for the any benchmark X₁*, X₂*, . . . , X_t*∈2^[n]. This causes an asymptotic behavior of the expected value of the regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) to coincide with an asymptotic behavior of {T(n+Σ_t∈[T−1]d_H(X_t*,X_t+1*))}^1/2. Note that the asymptotic behaviors are compared here in disregard of a polynomial of logT and a polynomial of logn.

$\begin{array}{cc}E\left[\sum _{t=1}^T{f}_t\left(X_t\right)-\sum _{t=1}^T{f}_t\left(X_t^{*}\right)\right]\le 4\sqrt{T\left(n+2\sum _{t=1}^{T-1}{d}_H\left(X_i^{*},X_{i+1}^{*}\right)\right)}+\sqrt{32T\log \left(\lceil \log T\rceil +4\right)}& \left(1\right)\end{array}$

where E[·] represents an expected value for internal randomness of the algorithm. Furthermore, ┌⋅┐ represents the smallest natural number not less than ⋅.

TABLE 1
Algorithm 1 An algorithm for online submodular minimization with full-information
Require: The number T of rounds and the size n of the ground set.
1:  Set                                ⁢                                                                d                                                                                          =                                                                                                                                    [                                                                          log                                      ⁢                                                                            T                                                                        ]                                                                    +                                                                      4                                    ⁢                                                                        and                                    ⁢                                                                        let                                    ⁢                                                                                                              p                                      1                                                                                                                                      =                                                                                                                                                                                    1                                        d                                                                            ⁢                                      1                                                                                                            ∈                                                                                                                                                                                                Δ                                          d                                                                                .                                                                                Set                                                                            ⁢                                                                            η                                                                                                        =                                                                                                                                                                                                                                                                                        log                                              ⁢                                              d                                                                                                                                      ?                                                                                                                                                                      .                                                                                For                                                                            ⁢                                                                            each                                      ⁢                                                                            j                                                                        ∈                                                                          [                                      d                                      ]                                                                                                                                                                                            ,                                                          initialize                              ⁢                                                                                                                                                          ⁢                                                              x                                t                                                                  (                                  j                                  )                                                                                            ⁢                                                            by                                                                                                                                                                                                                                      x                              t                                                              (                                j                                )                                                                                      =                                                          0                              ∈                                                                                                                              a                                                                .                                                                                                                                                                          
2:  for t = 1, 2, . . . , T do
3:  Set xi = Σj=1d ptjxi(j).
4:  Pick ui from a uniform distribution over [0, 1] and output Xi = Hui (xi) = {i ∈ [n] | xu ≥ ut}.
5:  Get feedback of ft and compute gi, a subgradient of ft at xi.
6:  for j = 1, 2, . . . , d do
7:  Compute⁢xt+1(j)⁢as⁢xt+1(j)∈arg⁢min?⁢x-yi+1(j)22,where⁢yt+1(j)=xt(j)-η(j)⁢gi⁢with⁢η(j)=η?.
8:  end for
9:  Compute⁢pi+1⁢as⁢pt+1=wiwt⁢t⁢with⁢wij=exp⁢(-η⁢∑t-1tgrγ⁢xγ(j))⁢(j∈[d]).
10: end for
?                                        indicates text missing or illegible when filed

The following description will discuss, with reference to FIG. 3, a specific example of the subset sequence derivation process S12 which specific example is obtained by embodying the above theorem. Note that the following description identifies the set S consisting of the n elements with a set [n] of natural numbers={1,2, . . . , n}. Since elements of the set S and elements of the set [n] are in one-to-one correspondence, generality is not lost by such identification. The above theorem merely provides an example of the first example embodiment. The first example embodiment should not be construed as being limited to the theorem.

FIG. 3 is a flow diagram showing a flow of the subset sequence derivation process S12 in accordance with a specific example of the present invention. As shown in FIG. 3, the subset sequence derivation process S12 includes an initial setting step S121, a subset derivation step S122, a subgradient derivation step S123, and a vector update step S124. The subset derivation step S122, the subgradient derivation step S123, and the vector update step S124 are carried out for the each round t∈[T]. That is, these steps are repeatedly carried out T times.

In the subset sequence derivation process S12 in accordance with a specific example of the present invention, a natural number d, a real number η, and d real numbers η⁽¹⁾,η⁽²⁾, . . . , η^(d) are used as constants. Furthermore, a d-dimensional vector p_t∈[0,1]^d satisfying ∥p_t∥=1 an n-dimensional vector x_t∈Rⁿ, and d n-dimensional vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d)∈Rⁿ are used as variables. Moreover, T real numbers u₁, u₂, . . . , u_T are used as respective random variables that are uniformly distributed on an interval [0,1].

The initial setting step S121 is a step of setting the constants d, η⁽¹⁾,η⁽²⁾, . . . , and η^(d) and initializing the vectors p_t, x_t⁽¹⁾,x_t⁽²⁾, . . . , and x_t^(d). In the initial setting step S121, the subset sequence derivation unit 12 sets the constant d to, for example, a number obtained by adding 4 to the smallest natural number not less than logT. The subset sequence derivation unit 12 sets the constant η to, for example, η={logd/(8T)}^1/2. For each j∈[d], the subset sequence derivation unit 12 sets a constant η^(j) to, for example, η^(j)=(n/2^j)^1/2. The subset sequence derivation unit 12 initializes the vector p_t to, for example, p₁=(1/d,1/d, . . . , 1/d). For the each j∈[d], the subset sequence derivation unit 12 initializes a vector x_t^(j) to, for example, x_t^(j)=(0,0, . . . , 0).

The subset derivation step S122 is a step of deriving the subset X_t. In the subset derivation step S122, the subset sequence derivation unit 12 sets the vector x_t first to, for example, x_t=Σ_j∈[d]p_tjx_t^(j). Note here that p_tj represents a jth component of the vector p_t. Next, the subset sequence derivation unit 12 randomly sets a value of a random variable u_t. Subsequently, the subset sequence derivation unit 12 derives the subset X_t defined by X_t={i∈[n]|x_ti≥u_t}. Note here that x_ti represents an ith component of the vector x_t.

The subgradient derivation step S123 is a step of deriving a subgradient g_t at x_t of the objective function f_t. In the subgradient derivation step S123, it is possible to refer to the value f_t(X) of the objective function f_t with respect to any subset X∈[n]. In the subgradient derivation step S123, the subset sequence derivation unit 12 derives, for example, the subgradient g_t defined by the following expression (2). In the following expression (2), o represents a permutation on the set [n] satisfying x_tσ(1)≥x_tσ(2)≥. . . ≥x_tσ(n). S_σ(i) represents a subset of the set [n] which subset is defined by S_σ(i)={σ(j)|j∈[i]}. x(i)∈{0,1}ⁿ represents an indicator vector in which the ith component is 1 and a component that is different from the ith component is 0.

$\begin{array}{cc}{g}_t\left(\sigma \right)=\sum _{i=1}^{n-1}{f}_t\left(S_{\sigma }\left(i\right)\right)\left(\chi \left(\sigma \left(i\right)\right)-\chi \left(\sigma \left(i+1\right)\right)\right)+f_t\left(\left[n\right]\right)\chi \left(\sigma \left(n\right)\right)& \left(2\right)\end{array}$

The vector update step S124 is a step of updating the vectors p_t and X_t⁽¹⁾,x_t⁽²⁾, . . . , x_t^(d). In the vector update step S124, the subset sequence derivation unit 12 updates the vector x_t(j) in accordance with, for example, the following expression (3). The subset sequence derivation unit 12 updates the vector p_t in accordance with, for example, the following expression (4).

$\begin{array}{cc}{y}_{t+1}^{\left(j\right)}=x_t^{\left(j\right)}-{\eta }^{\left(j\right)}{g}_t,x_t^{\left(j\right)}\in \arg \underset{x\in {\left[0,1\right]}^n}{\min }{x-y_{t+1}^{\left(j\right)}}_2^2& \left(3\right)\end{array}$ $\begin{array}{cc}{w}_{\mathrm{tj}}=\exp \left(-\eta \sum _{\tau \in \left[t\right]}{g}_{\tau }^T{x}_{\tau }^{\left(j\right)}\right)\left(j\in \left[d\right]\right),p_{t+1}=\frac{w_t}{{w_t}_1}& \left(4\right)\end{array}$

As is clear from the theorem A, use of the subset sequence derivation process S12 in accordance with a specific example of the present invention enables the expected value of the regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to the any benchmark X₁*, X₂*, . . . , X_t* satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V to be not more than the upper limit Max (n,T,V) defined by the following expression (5):

Max(n,T,V)=4√{square root over (T(n+2V))}+√{square root over (32Tlog(┌log T┐+4))}  (5)

Second Specific Example of Subset Sequence Derivation Process

The inventors of the present invention have succeeded in proving, regarding the online submodular minimization problem in bandit feedback setting, the following theorem B.

Theorem B: If the subset sequence X₁, X₂, . . . , X_T∈2^[n] is a subset sequence derived by an algorithm shown in Table 2 below, the following inequality (6) holds true for the any benchmark X₁*, X₂*, . . . , X_t*∈2^[n]. This causes the asymptotic behavior of the expected value of the regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) to coincide with an asymptotic behavior of nT^2/3{(loglogT/n)^1/2+(1+Σ_t∈[T−1]d_H(X_t*,X_t+1*)/n)}.

$\begin{array}{cc}E\left[\sum _{t=1}^T{f}_t\left(X_t\right)-\sum _{t=1}^T{f}_t\left(X_t^{*}\right)\right]\le \gamma T+4\left(n+1\right)\sqrt{\frac{T}{\gamma }}\left(2\sqrt{\log \log T}+\sqrt{n+\sum _{t=1}^{T-1}{d}_H\left(X_t^{*},X_{t+1}^{*}\right)}\right)& \left(6\right)\end{array}$

where γ represents a predetermined constant not less than 0 and not more than 1, the predetermined constant being called a search parameter.

TABLE 2
Algorithm 2 An algorithm for online submodular minimization with bandit feedback
Require: The number T of rounds, the size n of the base set, and the exploration parameter γ ∈ [0, 1].
1:  Set                                ⁢                                                                d                                                                                          =                                                                                                                                    4                                    [                                                                          log                                      ⁢                                                                            T                                                                        ]                                                                    ⁢                                                                    and                                  ⁢                                                                    let                                  ⁢                                                                                                        p                                    1                                                                                                  =                                                                                                                                                                                    1                                        d                                                                            ⁢                                      1                                                                                                            ∈                                                                                                                                                                                                Δ                                          d                                                                                .                                                                                Set                                                                            ⁢                                                                            η                                                                                                        =                                                                                                                                                                                                                                                                                        log                                              ⁢                                                                                            d                                                                                                                                      ?                                                                                                                                                                      .                                                                                For                                                                            ⁢                                                                            each                                      ⁢                                                                            j                                                                        ∈                                                                          [                                      d                                      ]                                                                                                                                                                                            ,                                                          initialize                              ⁢                                                                                                                                                          ⁢                                                              x                                t                                                                  (                                  j                                  )                                                                                            ⁢                                                            by                                                                                                                                                                                                                                      x                              t                                                              (                                j                                )                                                                                      =                                                          0                              ∈                                                                                                                              a                                                                .                                                                                                                                                                          
2:  for t = 1, 2, . . . , T do
3:  Set xt = Σj=1d ptjxt(j).
4:  Output⁢Xt⁢given⁢byXi={Hut(xt)(ut~Unif⁡([0,1]))with⁢probability⁢(1-γ)Sσ(st)(si~Unif⁡({0,1,…,n}))with⁢probability⁢γ.
    where Sσ(i) = {σ(j) | j ∈ [i]}.
5:  Observe ft(Xt)
6:  Compute⁢q^t⁢given⁢byq^t=1q?⁢ft(Xt)⁢(χ⁡(σ⁡(it))-χ⁡(σ⁡(it+1))).whereq?=γ·1n+1+(1-γ)·(x?-xt,σ⁡(i+1))
7:  for j = 1, 2, . . . , d do
8:  Compute⁢xt+1(j)⁢as⁢xt+1(j)∈arg⁢min?⁢x-yi+1(j)22,where⁢yt+1(j)=xt(j)=η(j)⁢g.i⁢with⁢η(j)=η?.
9:  end for
10: Compute⁢pi+1⁢as⁢pi+1=xt?⁢with⁢ωtj=exp⁡(-η⁢∑t⁢u⁢1tg?xt(j))⁢(j∈[d]).
11: end for
?                                        indicates text missing or illegible when filed

The following description will discuss, with reference to FIG. 4, a specific example of the subset sequence derivation process S12 which specific example is obtained by embodying the above theorem. Note that the following description identifies the set S consisting of the n elements with the set [n] of the natural numbers={1,2, . . . , n}. Since the elements of the set S and the elements of the set [n] are in one-to-one correspondence, generality is not lost by such identification. The above theorem merely provides an example of the first example embodiment. The first example embodiment should not be construed as being limited to the theorem.

FIG. 4 is a flow diagram showing a flow of the subset sequence derivation process S12 in accordance with a specific example of the present invention. As shown in FIG. 3, the subset sequence derivation process S12 includes an initial setting step S125, a subset derivation step S126, a subgradient derivation step S127, and a vector update step S128. The subset derivation step S126, the unbiased estimator derivation step S127, and the vector update step S128 are carried out for the each round t∈[T]. That is, these steps are repeatedly carried out T times.

In the subset sequence derivation process S12 in accordance with a specific example of the present invention, the natural number d, the real number η, and the d real numbers η⁽¹⁾, η⁽²⁾, . . . , η^(d) are used as constants. Furthermore, the d-dimensional vector p_t∈[0,1]^d satisfying ∥p_t∥=1, the n-dimensional vector x_t∈Rⁿ, and the d n-dimensional vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d)∈Rⁿ are used as variables. Moreover, the T real numbers u₁, u₂, . . . , u_T are used as respective random variables that are uniformly distributed on the interval [0,1]. Further, T integers s₁, s₂, . . . , s_T are used as respective random variables that are uniformly distributed on {0,1, . . . , n}.

The initial setting step S125 is a step of setting the constants d, η⁽¹⁾,η⁽²⁾, . . . , and η^(d) and initializing the vectors p_t, x_t⁽¹⁾,x_t⁽²⁾, . . . , and x_t^(d). In the initial setting step S125, the subset sequence derivation unit 12 sets the constant d to, for example, a number obtained by quadrupling the smallest natural number not less than logT. The subset sequence derivation unit 12 sets the constant η to, for example, η=[logd/{2(n+1)²T}]^1/2. For the each j∈[d], the subset sequence derivation unit 12 sets the constant η^(j) to, for example, η^(j)=(n/2^j)^1/2. The subset sequence derivation unit 12 initializes the vector p_t to, for example, p₁=(1/d,1/d, . . . ,1/d). For the each j∈[d], the subset sequence derivation unit 12 initializes the vector x_t(j) to, for example, x_t^(j)=(0,0, . . . , 0).

The subset derivation step S126 is a step of deriving the subset X_t. In the subset derivation step S126, the subset sequence derivation unit 12 sets the vector x_t first to, for example, x_t=Σ_j∈[d]p_tjx_t^(j). Note here that p_tj represents the jth component of the vector p_t. Next, the subset sequence derivation unit 12 randomly sets respective values of random variables u_t,s_t. Subsequently, the subset sequence derivation unit 12 derives the subset X_t defined by (1) X_t={i∈[n]|x_ti≥u_t} or derives the subset X_t defined by X_t={σ(j)|j∈[s_t]}. Note here that x_ti represents the ith component of the vector x_t. Note also that σ represents the permutation on the set [n] satisfying x_tσ(1)≥x_tσ(2)≥. . . ≥x_tσ(n). A probability with which a subset X_t={i∈[n]|x_ti≥u_t} is derived in the subset derivation step S126 is set to 1−γ. In other words, a probability with which X_t={σ(j)|j∈[s_t]} is derived in the subset derivation step S126 is set to γ.

The unbiased estimator derivation step S127 is a step of deriving an unbiased estimator {circumflex over ( )}g_t (with a symbol ∧ above g_t) of the subgradient g_t at x_t of the objective function f_t. In the unbiased estimator derivation step S127, it is possible to refer to only the value f_t(X_t) of the objective function f_t with respect to a subset X_t∈[n] derived in the subset derivation step S126. In the unbiased estimator derivation step S127, the subset sequence derivation unit 12 derives, for example, the unbiased estimator {circumflex over ( )}g_t defined by the following expression (7). In the following expression (7), σ represents the permutation on the set [n] satisfying x_tσ(1)≥x_tσ(2)≥. . . ≥x_tσ(n). q_t represents a vector in which the ith component q_ti is defined by q_ti=γ/(1+n)+(1−γ)(x_tσ(i)−x_tσ(i+1)). i_t represents a natural number satisfying X_t=S_σ(i_t).

$\begin{array}{cc}{\hat{g}}_t=\frac{1}{q_{{\mathrm{ti}}_t}}{f}_t\left(X_t\right)\left(\chi \left(\sigma \left(i_t\right)\right)-\chi \left(\sigma \left(i_t+1\right)\right)\right)& \left(7\right)\end{array}$

The vector update step S128 is a step of updating the vectors p_t and x_t⁽¹⁾,x_t⁽²⁾, . . . ,x_t^(d). In the vector update step S128, the subset sequence derivation unit 12 updates the vector x_t(j) in accordance with, for example, the following expression (8). The subset sequence derivation unit 12 updates the vector p_t in accordance with, for example, the following expression (9).

$\begin{array}{cc}{y}_{t+1}^{\left(j\right)}=x_t^{\left(j\right)}-{\eta }^{\left(j\right)}{\hat{g}}_t,x_t^{\left(j\right)}\in \arg \underset{x\in {\left[0,1\right]}^n}{\min }{x-y_{t+1}^{\left(j\right)}}_2^2& \left(8\right)\end{array}$ $\begin{array}{cc}{w}_{\mathrm{tj}}=\exp \left(-\eta \sum _{\tau \in \left[t\right]}{\hat{g}}_t^T{x}_{\tau }^{\left(j\right)}\right)\left(j\in \left[d\right]\right),p_{t+1}=\frac{w_t}{{w_t}_1}& \left(9\right)\end{array}$

As is clear from the theorem B, use of the subset sequence derivation process S12 in accordance with a specific example of the present invention enables the expected value of the regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to the any benchmark X₁*, X₂*, . . . , X_t* satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V to be not more than the upper limit Max (n,T,V) defined by the following expression (10):

$\begin{array}{cc}\mathrm{Max}\left(n,T,V\right)=\gamma T+4\left(n+1\right)\sqrt{\frac{T}{\gamma }}\left(2\sqrt{\log \log T}+\sqrt{n+V}\right)& \left(10\right)\end{array}$

Second Example Embodiment

A second example embodiment of the present invention will be described in detail with reference to the drawings.

Online Submodular Maximization Problem

Considered are (i) a set S consisting of n elements and (ii) an objective function f_t:2^S→R_≥0 defined for each round t∈[T]. Note here that n and T each represent any natural number. [T] represents a set of natural numbers not less than 1 and not more than T. 2^S represents a power set of a set S, that is, a set consisting of all subsets of the set S. R_≥0 represents nonnegative real numbers as a whole. It is assumed that each objective function f_t is a normalized submodular function.

Among problems of selecting a subset sequence X₁, X₂, . . . , X_T∈2^S, a problem whose target is maximization of a cumulative value Σ_t∈Tf_t(X_t) of the objective function f_t is referred to as an “online submodular maximization problem”. In the second example embodiment, the online submodular maximization problem is studied under full-information setting (described earlier).

Configuration of Information Processing Apparatus

A configuration of an information processing apparatus 2 in accordance with the second example embodiment will be described with reference to FIG. 5. FIG. 5 is a block diagram illustrating a configuration of the information processing apparatus 2.

The information processing apparatus 2 is an apparatus for solving the online submodular maximization problem related to the set S consisting of the n elements. As illustrated in FIG. 5, the information processing apparatus 2 includes an objective function setting unit 21 and a subset sequence derivation unit 22.

The objective function setting unit 21 is a means that sets, as the objective function f_t in the each round t, a submodular function on the power set 2^S of the set S. The objective function setting unit 21 is an example of the “objective function setting means” in the claims. The submodular function that the objective function setting unit 21 sets as the objective function f_t may be (i) predetermined, (ii) input by a user via a keyboard or the like, or (iii) input by another apparatus via a communication network or the like. The submodular function that the objective function setting unit 21 sets as the objective function f_t may be generated in various processes carried out inside the information processing apparatus 2.

The subset sequence derivation unit 22 is a means that derives a subset sequence X₁, X₂, . . . , X_T satisfying a condition β1 or β2 below. The subset sequence derivation unit 22 is an example of the “subset sequence derivation means” in the claims. The subset sequence X₁, X₂, . . . , X_T that is derived by the subset sequence derivation unit 22 may be provided to a user via a display or the like, or may be provided to another apparatus via a communication network or the like. The subset sequence X₁,X₂, . . . , X_T that is derived by the subset sequence derivation unit 22 may be used in various processes carried out inside the information processing apparatus 2.

The condition β1 is that each subset X_t satisfies |X_t|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying |X_t*|≤k and Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0.

The condition β2 is that the asymptotic behavior of the expected value of the α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*,X₂*, . . . ,X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0.

Information Processing Method

A flow of an information processing method S2 in accordance with the second example embodiment will be described with reference to FIG. 6. FIG. 6 is a flow diagram showing the flow of the information processing method S2.

The information processing method S2 is a method for solving the online submodular maximization problem related to the set S consisting of the n elements. As illustrated in FIG. 6, the information processing method S2 includes an objective function setting process S21 and a subset sequence derivation process S22. The information processing method S2 is carried out by, for example, the information processing apparatus 2.

The objective function setting process S21 is a process for setting, as the objective function f_t in the each round t, the submodular function on the power set 2^S of the set S. The objective function setting process S21 is carried out by, for example, the objective function setting unit 21 of the information processing apparatus 2. The subset sequence derivation process S22 is a process for deriving the subset sequence X₁, X₂, . . . , X_T satisfying the condition β1 or β2 shown in the previous section. The subset sequence derivation process S22 is carried out by, for example, the subset sequence derivation unit 22 of the information processing apparatus 2.

Effect of Information Processing Apparatus and Information Processing Method

In the information processing apparatus 2 and the information processing method S2 in accordance with the second example embodiment, subsets X₁, X₂, . . . , X_T in which the expected value of the α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) is not more than an upper limit Max (k,T,V) or an upper limit Max (n,T,V) is derived. In this case, the benchmark X₁*, X₂*, . . . , X_t* need not be constant. It is therefore possible to derive useful subsets X₁, X₂, . . . , X_T also for online submodular maximization for which a fixed strategy is not effective.

First Specific Example of Subset Sequence Derivation Process

The inventors of the present invention have succeeded in proving, regarding the online submodular maximization problem in full-information setting in which the number of elements of the subset X_t is fixed, the following theorem C.

Theorem C: If each objective function f_t has monotonicity and a subset sequence X₁, X₂, . . . , X_T∈2^[n] constituted by a subset X_t consisting of k or less elements is a subset sequence derived by algorithms shown in Tables 3 and 4 below, the following evaluation formula (11) holds true for any benchmark X₁*, X₂*, . . . , X_t*∈2^[n] constituted by a subset X_t* consisting of k or less elements. Note here that the objective function f_t having monotonicity means that f_t(X)≤f_t(Y) holds true for any subset X,Y∈∈2^[n] satisfying X□Y. Note also that O of Landau with a tilde above represents an asymptotic behavior in disregard of a polynomial of logT and a polynomial of logn.

$\begin{array}{cc}E\left[\left(1-\frac{1}{e}\right)\sum _{t=1}^T{f}_t\left(X_t^{*}\right)-\sum _{t=1}^T{f}_t\left(X_t\right)\right]=\tilde{O}\left(\sqrt{\mathrm{kT}\left(k+\sum _{t=1}^{T-1}{d}_H\left(X_t^{*},X_{t+1}^{*}\right)\right)}\right)& \left(11\right)\end{array}$

TABLE 3
Algorithm 3 Algorithm for     submodular maxi   tion under size constraint
Require: The number     the base set     the size-constrained parameter     such that
1:  Initialize     copies     (Algorithm 4) with parameters T and
2:  for     do
3:  S
4:  for     do
5:  Get the    output
6:  Draw an item
7:
8:  end for
9:  Output
10: for     1   2    do
11: Set     for each
12:
13: end for
14: end for
indicates data missing or illegible when filed

TABLE 4
Algorithm 4 FSF*
Require: The number T of rounds and the number n of actions.
1:  [                                                                      Initialization                                    ⁢                                                                        step                                                                    ]                                                                ⁢                                                                Set                                ⁢                                                                J                                                            =                                                              ⌈                                                                  log                                  ⁢                                  T                                                                ⌉                                                                                      ,                                                          η                              =                                                                                                                                    log                                    ⁢                                    d                                                                    T                                                                                                                      ,                                                                                          and                                ⁢                                                                initialize                                ⁢                                                                                                  w                                  t                                                                                            =                                                                                                                                                                          (                                                                                                                        w                                                                                      t                                            ⁢                                            1                                                                                                                          ,                                                                                  w                                                                                      t                                            ⁢                                            2                                                                                                                          ,                                        …                                                                                ,                                                                                  w                                          td                                                                                                                    )                                                                        T                                                                    ⁢                                                                    by                                  ⁢                                                                                                        w                                                                          1                                      ⁢                                      j                                                                                                                                      =                                1                                                                                                                                                                                                                                                                                                    for                                ⁢                                                                j                                                            =                              1                                                        ,                            2                            ,                            …                                                        ,                                                                                                                            J                                  .                                                                    For                                                                ⁢                                                                j                                                            =                              1                                                        ,                            2                            ,                            …                                                        ,                            J                            ,                                                                                          set                                ⁢                                                                                                  (                                                                                                            η                                                                              (                                        j                                        )                                                                                                              ,                                                                          a                                                                              (                                        j                                        )                                                                                                                                              )                                                                                            =                                                                                                and                                  ⁢                                                                    initialize                                  ⁢                                                                                                        w                                    t                                                                          (                                      j                                      )                                                                                                                                      =                                                                                                                                            (                                                                                                                        w                                                                                      t                                            ⁢                                            1                                                                                                                                (                                            j                                            )                                                                                                                          ,                                                                                  w                                                                                      t                                            ⁢                                            2                                                                                                                                (                                            j                                            )                                                                                                                          ,                                        …                                                                                ,                                                                                  w                                          tn                                                                                      (                                            j                                            )                                                                                                                                                              )                                                                        T                                                                    ⁢                                                                    by                                                                                                                                                                                                                                                                                                                                    w                                                                  1                                  ⁢                                  i                                                                                                  (                                  j                                  )                                                                                            =                                                                                                1                                  ⁢                                                                    for                                  ⁢                                                                    i                                                                =                                1                                                                                      ,                            2                            ,                            …                                                        ,                                                          η                              .                                                                                                                                            
2:  for t = 1, . . . T do
3:  Set⁢qi=wiwi⁢and⁢pi(j)=w?wi(j)⁢for⁢j=1,2,…,J.
4:  [t~th output] Compute pt = Σj=1j qijpt(j) and output pt.
5:  [t~th input] Get feedback of t = (t1, t2, . . . , tn)T.
6:  for j = 1, 2, . . . , J do
7:  Compute vti(j) = wti(j) exp(η(j) ti) for i = 1, 2, . . . , n.
8:  Update⁢wi(j)⁢by⁢wi+1⁢d(j)=α(j)⁢w?n+(1-α(j))⁢vti(j)⁢for⁢i=1,2,…,n⁢where⁢Wi(j)=vtl(j)+…+vtn(j).
9:  Update wij by wi+1,j = wij exp(ηtTpt(j)).
10: end for
11: end for
?                                        indicates text missing or illegible when filed

Note that the algorithm shown in Table 4 includes J fixed share forecaster (FSF) algorithms corresponding to different η^(j). Since each of the FSF algorithms is a publicly-known algorithm, a description thereof is omitted here. In the following description, {i_t1, i_t2, . . . , i_ts} is referred to as X_ts, and {i_t1, i_t2, . . . , i_tk} is referred to as X_t. Furthermore, X_ts∪{i_t,s+1} is referred to X_t,s+1, and f_t(X_ts∪{i})−f_t(X_ts) is referred to as l_ti.

The following description will discuss, with reference to FIG. 7, a specific example of the subset sequence derivation process S22 which specific example is obtained by embodying the above theorem. Note that the following description identifies the set S consisting of the n elements with a set [n] of natural numbers={1,2, . . . , n}. Since elements of the set S and elements of the set [n] are in one-to-one correspondence, generality is not lost by such identification. The above theorem merely provides an example of the second example embodiment. The second example embodiment should not be construed as being limited to the theorem.

FIG. 7 is a flow diagram showing a flow of the subset sequence derivation process S22 in accordance with a specific example of the present invention. As shown in FIG. 7, the subset sequence derivation process S22 includes an FSF algorithm initialization step S221, a subset derivation step S222, and a feed generation step S223. The subset derivation step S222 and the feed generation step S223 are carried out for the each round t∈[T]. That is, these steps are repeatedly carried out T times.

The FSF algorithm initialization step S221 is a step of initializing, in accordance with the number T of rounds, k FSF algorithm execution modules FSF*⁽¹⁾, FSF*⁽²⁾, . . . , FSF*^(k) that execute the FSF algorithms.

The subset derivation step S222 is a step of deriving the subset X_t. In the subset derivation step S222, after setting X_t0 to X_t0=Ø, the subset sequence derivation unit 22 repeatedly carries out the following process for s=1,2, . . . , k. First, the subset sequence derivation unit 22 reads a vector p_t^(s) that is output by an FSF algorithm execution module FSF*^(s). Next, the subset sequence derivation unit 22 derives an element i_ts from the read vector p_t^(s). Subsequently, the subset sequence derivation unit 22 uses the derived element i_ts to generate X_ts=X_t,s−1∪{i_ts}. The subset sequence derivation unit 22 derives a subset X_t=X_tk by repeatedly carrying out the above process for s=1,2, . . . , k.

The feed generation step S223 is a step of generating feeds l_t⁽¹⁾, l_t⁽²⁾, . . . , l_t^(k) to be input to the respective FSF algorithm execution modules FSF*⁽¹⁾, FSF*⁽²⁾, . . . , FSF*^(k). In the feed generation step S223, the subset sequence derivation unit 22 generates, in accordance with l_ti^(s)=f_t(X_t,s−1∪{i})−f_t(X_t,s−1)(i∈[n]), a feed l_t^(s)=(l_t1^(s),l_t2^(s), . . . ,l_tn^(s)) to be input to the FSF algorithm execution module FSF^*(s).

As is clear from the theorem C, use of the subset sequence derivation process S22 in accordance with a specific example of the present invention enables an asymptotic behavior of an expected value of (1−1/e) regret (1−1/e)Σ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*,X₂*, . . . , X_t*∈2^[n] satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V and constituted by the subset X_t* consisting of the k or less elements to coincide with the asymptotic behavior of the function A (k,T,V) represented by the following expression (12):

A(k,T,V)=√{square root over (kT(k+V))}  (12)

Second Specific Example of Subset Sequence Derivation Process

The inventors of the present invention have succeeded in proving, regarding the online submodular maximization problem in full-information setting in which the number of elements of the subset X_t is not fixed, the following theorem D.

Theorem D: If a subset sequence X₁, X₂, . . . , X_T∈2^[n] is a subset sequence derived by an algorithm shown in Table 5 below, the following evaluation formula (13) holds true for the any benchmark X₁*, X₂*, . . . , X_t*∈2^[n].

$\begin{array}{cc}E\left[\frac{1}{2}\sum _{t=1}^T{f}_t\left(X_t^{*}\right)-\sum _{t=1}^T{f}_t\left(X_t\right)\right]=\tilde{O}\left(n\sqrt{T\left(1+\frac{1}{n}\sum _{t=1}^{T-1}{d}_H\left(X_t^{*},X_{t+1}^{*}\right)\right)}\right)& \left(13\right)\end{array}$

TABLE 5
Algorithm 5 Algorithm for     Submodular Max
Require: The number     of rounds, the size     of the
1:  Initialize     copies     (Algorithm 4) with parameters     and 2.
2:  for     = 1    do
3:  Set
4:  for s =     do
5:  Get the     output     from     and set
6:  With probability     set     Otherwise, (with probability
7:  end for
8:  Output     and get feedback of
9:  for     do
10: Set
11: Set
12: as the     input
13: end for
14: end for
indicates data missing or illegible when filed

The following description will discuss, with reference to FIG. 8, a specific example of the subset sequence derivation process S22 which specific example is obtained by embodying the above theorem. Note that the following description identifies the set S consisting of the n elements with the set [n] of the natural numbers={1,2, . . . , n}. Since the elements of the set S and the elements of the set [n] are in one-to-one correspondence, generality is not lost by such identification. The above theorem merely provides an example of the second example embodiment. The second example embodiment should not be construed as being limited to the theorem.

FIG. 8 is a flow diagram showing a flow of the subset sequence derivation process S22 in accordance with a specific example of the present invention. As shown in FIG. 7, the subset sequence derivation process S22 includes an FSF algorithm initialization step S224, a subset derivation step S225, and a feed generation step S226. The subset derivation step S225 and the feed generation step S226 are carried out for the each round t∈[T]. That is, these steps are repeatedly carried out T times.

The FSF algorithm initialization step S224 is a step of initializing, in accordance with the number T of rounds, n FSF algorithm execution modules FSF*⁽¹⁾, FSF*⁽²⁾, . . . , FSF*⁽ⁿ⁾ that execute the FSF algorithms.

The subset derivation step S225 is a step of deriving the subset X_t. In the subset derivation step S225, after setting X_t0 to X_t0=Ø and setting Y_t0 to Y_t0=[n], the subset sequence derivation unit 22 repeatedly carries out the following process for s=1,2, . . . , n. First, the subset sequence derivation unit 22 reads the vector p_t^(s) that is output by the FSF algorithm execution module FSF*^(s) and sets q_t^(s) to q_t^(s)=(1+2p_t1^(s))/4. Next, with a probability q_t^(s), the subset sequence derivation unit 22 sets X_ts to X_ts=X_t,s−1∪{s} and sets Y_ts to Y_ts=Y_t,s−1. Otherwise, the subset sequence derivation unit 22 sets X_ts to X_ts=X_t,s−1 and sets Y_ts to Y_ts=Y_t,s−1\{s}. The subset sequence derivation unit 22 derives the subset X_t=X_tn=Y_tn by repeatedly carrying out the above process for s=1,2, . . . ,k.

The feed generation step S226 is a step of generating the feeds l_t⁽¹⁾,l_t⁽²⁾, . . . ,l_t^(k) to be input to the respective FSF algorithm execution modules FSF*⁽¹⁾,FSF*⁽²⁾, . . . ,FSF*^(k). In the feed generation step S226, the subset sequence derivation unit 22 sets α_ts to α_ts=f_t(X_t,s−1∪{s})−f_t(X_t,s−1) and sets β_ts to α_ts=f_t(Y_t,s−1\{s})−f_t(Y_t,s−1). The subset sequence derivation unit 22 generates, in accordance with l_ti^(s)=(1−q_t^(s))α_ts and l_t2^(s)=q_t^(s)β_ts, a feed l_t^(s)=(l_t1^(s),l_t2^(s)) to be input to the FSF algorithm execution module FSF*^(s).

As is clear from the theorem D, use of the subset sequence derivation process S22 in accordance with a specific example of the present invention enables an asymptotic behavior of an expected value of (½) regret (½)Σ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*, X₂*, . . . , X_t*∈2^[n] satisfying _t∈[T−1]d_H(X_t*,X_t+1*)≤V to coincide with an asymptotic behavior of a function B (k,T,V) represented by the following expression (14):

B(n,T,V)=√{square root over (T(1+V/n))}  (14)

Software Implementation Example

Some or all of functions of the information processing apparatus 1 or 2 can be realized by hardware provided in an integrated circuit (IC chip) or the like or can be alternatively realized by software. In the latter case, the functions of the units of the information processing apparatus 1 or 2 are realized by, for example, a computer that executes instructions of a program that is software.

FIG. 9 illustrates an example of such a computer (hereinafter referred to as a “computer C”). As illustrated in FIG. 9, the computer C includes at least one processor C1 and at least one memory C2. The at least one memory C2 stores a program P for causing the computer C to operate as the information processing apparatus 1 or 2. In the computer C, the at least one processor C1 reads and executes the program P stored in the at least one memory C2, so that the functions of the units of the information processing apparatus 1 or 2 are realized.

Examples of the at least one processor C1 encompass a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, and a combination thereof. Examples of the at least one memory C2 encompass a flash memory, a hard disk drive (HDD), a solid state drive (SSD), and a combination thereof.

Note that the computer C may further include a random access memory (RAM) in which the program P is to be loaded while being executed and in which various kinds of data are to be temporarily stored. The computer C may further include a communication interface through which data is to be transmitted and received between the computer C and at least one other apparatus. The computer C may further include an input/output interface through which (i) an input apparatus(s) such as a keyboard and/or a mouse and/or (ii) an output apparatus(s) such as a display and/or a printer is/are to be connected to the computer C.

The program P can be recorded in a non-transitory, tangible storage medium M capable of being read by the computer C. Examples of such a storage medium M encompass a tape, a disk, a card, a semiconductor memory, and a programmable logic circuit. The computer C can acquire the program P via the storage medium M. The program P can alternatively be transmitted via a transmission medium. Examples of such a transmission medium encompass a communication network and a broadcast wave. The computer C can alternatively acquire the program P via the transmission medium.

Application Example

The information processing apparatus 1 or 2 described earlier is applicable to various problems. An example of this is shown below.

Retail

It is assumed that a measure is to reduce the respective beer prices of companies in a certain store. For example, in a case where an implemented measure X_t=[0,2,1, . . . ], it is assumed that a first element indicates setting of a beer price of a company A to a fixed price, a second element indicates a 10% increase in a beer price of a company B from a fixed price, and a third element indicates a 10% reduction in a beer price of a company C from a fixed price.

The objective function f_t regards the implemented measure X_t as an input and regards, as an output, a result obtained by applying the implemented measure X to the respective beer prices of the companies to carry out sales. In this case, application of the above-described optimization method makes it possible to derive optimum setting of the respective beer prices of the companies in the above store.

Investment Portfolio

The following description will discuss a case of application to an investment activity of, for example, an investor. In this case, it is assumed that the implemented measure X_t is investment (purchase, capital increase) with respect to a plurality of financial products (stock brands, etc.) held or to be held by the investor, or selling or holding of the plurality of financial products. For example, in a case where the implemented measure X_t=[1,0,2, . . . ], it is assumed that the first element indicates additional investment in stocks of a company A, the second element indicates holding (neither purchasing nor selling) receivables of a company B, and the third element indicates selling stocks of a company C. The objective function f_t regards the implemented measure X_t as the input and regards, as the output, a result obtained by applying the implemented measure X_t to the investment activity with respect to financial products of the companies.

In this case, application of the above-described optimization method makes it possible to derive an optimum investment activity of the investor with respect to each brand.

Clinical Trial

The following description will discuss a case of application to an administration activity for a clinical trial of a certain drug of a pharmaceutical company. In this case, it is assumed that the implemented measure X_t is a dose of administration or avoidance of administration. For example, in a case where the implemented measure X_t=[1,0,2, . . . ], it is assumed that the first element indicates that administration in a dose 1 is carried out with respect to a subject A, the second element indicates that administration is not carried out with respect to a subject B, and the third element indicates that administration in a dose 2 is carried out with respect to a subject C. The objective function f_t regards the implemented measure X_t as the input and regards, as the output, a result obtained by applying the implemented measure X_t to the administration activity with respect to each of the subjects.

In this case, application of the above-described optimization method makes it possible to derive an optimum administration activity with respect to each of the subjects in the clinical trial of the pharmaceutical company.

Web Marketing

The following description will discuss a case of application to an advertising activity (marketing measure) in an operating company of a certain electronic commerce site. In this case, it is assumed that the implemented measure X_t is advertising (an online (banner) advertisement, advertising by electronic mail, direct mail, electronic mail transmission of a discount coupon, etc.), with respect to a plurality of customers, for a product or service to be sold by the operating company. For example, in a case where the implemented measure X_t=[1,0,2, . . . ], it is assumed that the first element indicates a banner advertisement with respect to a customer A, the second element indicates that advertising is not carried out with respect to a customer B, and the third element indicates electronic mail transmission of a discount coupon to a customer C. The objective function f_t regards the implemented measure X_t as the input and regards, as the output, a result obtained by applying the implemented measure X_t to the advertising activity with respect to each of the customers. Note here a result of implementation may be whether or not a banner advertisement has been clicked, a purchase amount, a purchase probability, or an expected value of the purchase amount.

In this case, application of the optimization method of the second example embodiment makes it possible to derive an optimum advertising activity of the operating company with respect to each of the customers.

Additional Remark 1

The present invention is not limited to the foregoing example embodiments, but may be altered in various ways by a skilled person within the scope of the claims. For example, the present invention also encompasses, in its technical scope, any example embodiment derived by appropriately combining technical means disclosed in the foregoing example embodiments.

Additional Remark 2

The whole or part of the example embodiments disclosed above can be described as, but not limited to, the following supplementary notes.

Supplementary Note 1

An information processing apparatus including:

• • an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and
  • a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T∈2^S in which an expected value of regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 2

The information processing apparatus according to Supplementary note 1, wherein

• • after deriving a subset X_t in a round t, the subset sequence derivation means is capable of referring to a value f_t(X) of the objective function f_t with respect to any subset X∈2^S, and
  • the upper limit Max (n,T,V) is given by the following expression (a):

Max(n,T,V)=4√{square root over (T(n+2V))}+√{square root over (32Tlog(┌logT┐+4))}  (a)

Supplementary Note 3

The information processing apparatus according to Supplementary note 2, wherein

• • the subset sequence derivation means uses (i) a d-dimensional vector p_t∈[0,1]^d (d is a maximum natural number not exceeding logT+4) satisfying |p_t|=1 and (ii) d n-dimensional vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d)∈Rⁿ to carry out, in each round,
  • a subset derivation step of using a randomly selected u_t∈[0,1] to derive the subset X_t={i∈[n]|x_ti≥u_t}, assuming that p_tj is a jth component of the vector p_t, x_t is an n-dimensional vector defined by x_t=Σ_j∈p_tjx_t^(j), and x_ti is an ith component of the vector x_t,
  • a subgradient derivation step of deriving a subgradient g_t at x_t of the objective function f_t, and
  • a vector update step of updating the vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d) in accordance with the following expression (a1) and updating the vector p_t in accordance with the following expression (a2):

$\begin{array}{cc}{y}_{t+1}^{\left(j\right)}=x_t^{\left(j\right)}-{\eta }^{\left(j\right)}{g}_t,x_t^{\left(j\right)}\in \arg \underset{x\in {\left[0,1\right]}^n}{\min }{x-y_{t+1}^{\left(j\right)}}_2^2& \left(\mathrm{a1}\right)\end{array}$

• • where η(j) is a constant determined in accordance with n,

$\begin{array}{cc}{w}_{\mathrm{tj}}=\exp \left(-\eta \sum _{\tau \in \left[t\right]}{g}_{\tau }^T{x}_{\tau }^{\left(j\right)}\right)\left(j\in \left[d\right]\right),p_{t+1}=\frac{w_t}{{w_t}_1}& \left(\mathrm{a2}\right)\end{array}$

• • where η is a constant determined in accordance with d and T.

Supplementary Note 4

The information processing apparatus according to Supplementary note 1, wherein

• • after selecting a subset X_t in a round t, the subset sequence derivation means is (1) capable of referring to a value f_t(X_t) of the objective function f_t with respect to the selected subset X_t and (2) incapable of referring to a value f_t(X) of the objective function f_t with respect to a subset X∈2^S that is different from the selected subset, and
  • the upper limit Max (n,T,V) is given by the following expression (b):

$\begin{array}{cc}\mathrm{Max}\left(n,T,V\right)=\gamma T+4\left(n+1\right)\sqrt{\frac{T}{\gamma }}\left(2\sqrt{\log \log T}+\sqrt{n+V}\right)& \left(b\right)\end{array}$

• • where γ is a predetermined constant not less than 0 and not more than 1.

Supplementary Note 5

The information processing apparatus according to Supplementary note 4, wherein

• • the subset sequence derivation means uses (i) a d-dimensional vector p_t∈[0,1]^d (d is a maximum natural number not exceeding 4logT) satisfying |p_t|=1 and (ii) d n-dimensional vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d)∈Rⁿ to carry out, in each round,
  • a subset derivation step of (1) using a randomly selected u_t∈[0,1] to derive the subset X_t={i∈[n]|x_ti≥u_t} or (2) using a permutation σ on a set [n] satisfying x_tσ(1)≥x_tσ(2)≥. . . ≥x_tσ(n) and a randomly selected s_t{0,1, . . . , n} to derive the subset X_t={σ(j)|j∈[s_t]}, assuming that p_tj is a jth component of the vector p_t, x_t is an n-dimensional vector defined by x_t=Σ_j∈p_tjx_t^(j), and x_ti is an ith component of a vector tx, the subset X_t={i∈[n]|x_ti≥u_t} being derived with a probability of 1−γ, the subset X_t={σ(j)|j∈[s_t]} being derived with a probability of γ,
  • an unbiased estimator derivation step of deriving an unbiased estimator {circumflex over ( )}g_t ({circumflex over ( )}g is a symbol with ∧ above g) of a subgradient g_t at x_t of the objective function f_t, and
  • a vector update step of updating the vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d) in accordance with the following expression (b1) and updating the vector p_t in accordance with the following expression (b2):

$\begin{array}{cc}{y}_{t+1}^{\left(j\right)}=x_t^{\left(j\right)}-{\eta }^{\left(j\right)}{\hat{g}}_t,x_t^{\left(j\right)}\in \arg \underset{x\in {\left[0,1\right]}^n}{\min }{x-y_{t+1}^{\left(j\right)}}_2^2& \left(b1\right)\end{array}$

• • where η^(j) is a constant determined in accordance with n,

$\begin{array}{cc}{w}_{\mathrm{tj}}=\exp \left(-\eta \sum _{\tau \in \left[t\right]}{\hat{g}}_t^T{x}_{\tau }^{\left(j\right)}\right)\left(j\in \left[d\right]\right),p_{t+1}=\frac{w_t}{{w_t}_1}& \left(\mathrm{b2}\right)\end{array}$

• • where η is a constant determined in accordance with n, d, and T.

Supplementary Note 6

An information processing apparatus including:

• • an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and
  • a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T∈2^S,
  • the subset sequence derivation means using (i) a d-dimensional vector p_t∈[0,1]^d (d is a maximum natural number not exceeding logT+4) satisfying |p_t|=1 and (ii) d n-dimensional vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d)∈Rⁿ to carry out, in each round,
  • a subset derivation step of using a randomly selected u_t∈[0,1] to derive a subset X_t={i∈[n]|x_ti≥u_t}, assuming that p_tj is a jth component of the vector p_t, x_t is an n-dimensional vector defined by x_t=Σ_j∈p_tjx_t^(j), and x_ti is an ith component of the vector x_t,
  • a subgradient derivation step of deriving a subgradient g_t at x_t of the objective function f_t, and
  • a vector update step of updating the vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d) in accordance with the following expression (a1) and updating the vector p_t in accordance with the following expression (a2):

$\begin{array}{cc}{y}_{t+1}^{\left(j\right)}=x_t^{\left(j\right)}-{\eta }^{\left(j\right)}{g}_t,x_t^{\left(j\right)}\in \arg \underset{x\in {\left[0,1\right]}^n}{\min }{x-y_{t+1}^{\left(j\right)}}_2^2& \left(\mathrm{a1}\right)\end{array}$

• • where η^(j) is a constant determined in accordance with n,

$\begin{array}{cc}{w}_{\mathrm{tj}}=\exp \left(-\eta \sum _{\tau \in \left[t\right]}{g}_{\tau }^T{x}_{\tau }^{\left(j\right)}\right)\left(j\in \left[d\right]\right),p_{t+1}=\frac{w_t}{{w_t}_1}& \left(\mathrm{a2}\right)\end{array}$

• • where η is a constant determined in accordance with d and T.

Supplementary Note 7

An information processing apparatus including:

• • an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and
  • a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T∈2^S,
  • the subset sequence derivation means using (i) a d-dimensional vector p_t∈[0,1]^d (d is a maximum natural number not exceeding 4logT) satisfying |p_t|=1 and (ii) d n-dimensional vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d)∈Rⁿ to carry out, in each round,
  • a subset derivation step of (1) using a randomly selected u_t∈[0,1] to derive a subset X_t={i∈[n]|x_ti≥u_t} or (2) using a permutation o on a set [n] satisfying x_tσ(1)≥x_tσ(2)x_tσ(n) and a randomly selected s_t∈{0,1, . . . ,n} to derive the subset X_t={σ(j)|j∈[s_t]}, assuming that p_tj is a jth component of the vector p_t, x_t is an n-dimensional vector defined by x_t=Σ_j∈p_tjx_t^(j), and x_ti is an ith component of a vector tx, the subset X_t={i∈[n]|x_ti≥u_t} being derived with a probability of 1−γ, the subset X_t={σ(j)|j∈[s_t]} being derived with a probability of γ,
  • an unbiased estimator derivation step of deriving an unbiased estimator {circumflex over ( )}g_t ({circumflex over ( )}g is a symbol with ∧ above g) of a subgradient g_t at x_t of the objective function f_t, and
  • a vector update step of updating the vectors x_t⁽¹⁾, x_t⁽²⁾, . . . , x_t^(d) in accordance with the following expression (b1) and updating the vector p_t in accordance with the following expression (b2):

$\begin{array}{cc}{y}_{t+1}^{\left(j\right)}=x_t^{\left(j\right)}-{\eta }^{\left(j\right)}{\hat{g}}_t,x_t^{\left(j\right)}\in \arg \underset{x\in {\left[0,1\right]}^n}{\min }{x-y_{t+1}^{\left(j\right)}}_2^2& \left(\mathrm{b1}\right)\end{array}$

• • where η^(j) is a constant determined in accordance with n,

$\begin{array}{cc}{w}_{\mathrm{tj}}=\exp \left(-\eta \sum _{\tau \in \left[t\right]}{\hat{g}}_{\tau }^T{x}_{\tau }^{\left(j\right)}\right)\left(j\in \left[d\right]\right),p_{t+1}=\frac{w_t}{{w_t}_1}& \left(\mathrm{b2}\right)\end{array}$

• • where η is a constant determined in accordance with n, d, and T.

Supplementary Note 8

An information processing apparatus including:

• • an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and
  • a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T satisfying the following condition β1 or β2:
  • the condition β1 being that each subset X_t satisfies |X_t|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying |X_t*|≤k and Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0,
  • the condition β2 being that the asymptotic behavior of the expected value of the a regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*,X₂*, . . . ,X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 9

The information processing apparatus according to Supplementary note 8, wherein

• • after deriving a subset X_t in a round t, the subset sequence derivation means is capable of referring to a value f_t(X) of the objective function f_t with respect to any subset X∈2^S, and
  • the function A (k,T,V) is given by the following expression (c):

A(k,T,V)=√{square root over (kT(k+V))}  (c)

Supplementary Note 10

The information processing apparatus according to Supplementary note 9, wherein

• • the subset sequence derivation means carries out, in the each round t,
  • a subset derivation step of deriving the subset X_t=X_tk by setting X_t0 to X_t0=Ø and then repeatedly carrying out a process for using an element i ts derived from a vector p_t^(s) output by an FSF algorithm execution module FSF*^(s) to generate X_ts=X_t,s−1∪{i_ts}, and
  • a feed generation step of generating, in accordance with l_ti^(s)=f_t(X_t,s−1∪{i})−f_t(X_t,s−1)(i∈[n]) , a feed l_t^(s)=(l_t1^(s),l_t2^(s), . . . ,l_tn^(s)) to be input to the FSF algorithm execution module FSF*^(s).

Supplementary Note 11

The information processing apparatus according to Supplementary note 8, wherein

• • after deriving a subset X_t in a round t, the subset sequence derivation means is capable of referring to a value f_t(X) of the objective function f_t with respect to any subset X∈2S, and
  • the function B (n,T,V) is given by the following expression (d):

B(n,T,V)=√{square root over (T(1+V/n))}  (d)

Supplementary Note 12

The information processing apparatus according to Supplementary note 11, wherein

• • the subset sequence derivation means carries out, in the each round t,
  • a subset derivation step of deriving the subset X_t=X_tn=Y_tn by repeatedly carrying out a process for (1) setting X_t0 to X_t0=Ø and setting Y_t0 to Y_t0=[n], (2) using a vector p_t^(s) output by an FSF algorithm execution module FSF*^(s) to set q_t^(s) to q_t^(s)=(1+2p_t1^(s))/4, and (3a) with a probability q_t^(s), setting X_ts to X_ts=X_t,s−1∪{s} and setting Y_ts to Y_ts=Y_t,s−1 or (3b) with a probability 1−q_t^(s), setting X_ts to X_ts=X_t,s−1 and setting Y_ts to Y_ts=Y_t,s−1\{s}, and
  • a feed generation step of setting α_ts to α_ts=f_t(X_t,s−1∪{s})−f_t(X_t,s−1) and setting β_ts to α_ts=f_t(Y_t,s−1\{s})−f_t(Y_t,s−1), and then generating, in accordance with l_ti^(s)=(1−q_t^(s))α_ts and l_t2^(s)=q_t^(s)β_ts, a feed l_t^(s)=(l_t1^(s),l_t2^(s)) to be input to the FSF algorithm execution module FSF*^(s).

Supplementary Note 13

An information processing apparatus including:

• • an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and
  • a subset sequence derivation means that derives a subset sequence X₁,X₂, . . . ,X_T∈2^S,
  • the subset sequence derivation means carrying out, in the each round t,
  • a subset derivation step of deriving a subset X_t=X_tk by setting X_t0 to X_t0=Ø and then repeatedly carrying out a process for using an element i_ts derived from a vector p_t^(s) output by an FSF algorithm execution module FSF*^(s) to generate X_ts=X_t,s−1∪{i_ts}, and
  • a feed generation step of generating, in accordance with l_ti^(s)=f_t(X_t,s−1∪{i})−f_t(X_t,s−1)(i∈[n]) , a feed l_t^(s)=(l_t1^(s),l_t2^(s), . . . ,l_tn^(s)) to be input to the FSF algorithm execution module FSF*^(s).

Supplementary Note 14

An information processing apparatus including:

• • an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and
  • a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T∈2^S,
  • the subset sequence derivation means carrying out, in the each round t,
  • a subset derivation step of deriving a subset X_t=X_tn=Y_tn by repeatedly carrying out a process for (1) setting X_t0 to X_t0=Ø and setting Y_t0 to Y_t0=[n], (2) using a vector p_t^(s) output by an FSF algorithm execution module FSF*^(s) to set q_t^(s) to q_t^(s)=(1+2p_t1^(s))/4, and (3a) with a probability q_t^(s), setting X_ts to X_ts=X_t,s−1∪{s} and setting Y_ts to Y_ts=Y_t,s−1 or (3b) with a probability 1−q_t^(s), setting X_ts to X_ts=X_t,s−1 and setting Y_ts to Y_ts=Y_t,s−1\{s}, and
  • a feed generation step of setting α_ts to α_ts=f_t(X_t,s−1∪{s})−f_t(X_t,s−1) and setting β_ts to α_ts=f_t(Y_t,s−1\{s})−f_t(Y_t,s−1), and then generating, in accordance with l_ti^(s)=(1−q_t^(s))α_ts and l_t2^(s)=q_t^(s)β_ts, a feed l_t^(s)=(l_t1^(s),l_t2^(s)) to be input to the FSF algorithm execution module FSF*^(s).

Supplementary Note 15

An information processing method including: setting, as an objective function f_t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and

• • deriving a subset sequence X₁, X₂, . . . , X_T∈2^S in which an expected value of regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to any benchmark X₁* ,X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*) is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 16

An information processing method including: setting, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and

• • deriving a subset sequence X₁, X₂, . . . , X_T satisfying the following condition β1 or β2:
  • the condition β1 being that each subset X_t satisfies |X_t|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying |X_t*|≤k and Σ_t∈[T−1]d_H(X_t*,X_t−1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0,
  • the condition β2 being that the asymptotic behavior of the expected value of the α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1* |.

Supplementary Note 17

A program for causing a computer to operate as an information processing apparatus,

• • the program causing the computer to function as: an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T∈2^S in which an expected value of regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*) is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)−|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 18

A computer-readable storage medium storing the program according to Supplementary note 17.

Supplementary Note 19

A program for causing a computer to operate as an information processing apparatus,

• • the program causing the computer to function as: an objective function setting means that sets, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and a subset sequence derivation means that derives a subset sequence X₁, X₂, . . . , X_T satisfying the following condition β1 or β2:
  • the condition β1 being that each subset X_t satisfies |X_t|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying |X_t*|≤k and Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0,
  • the condition β2 being that the asymptotic behavior of the expected value of the α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 20

A computer-readable storage medium storing the program according to Supplementary note 19.

Supplementary Note 21

An information processing apparatus including at least one processor, the at least one processor carrying out: an objective function setting process for setting, as an objective function f_t in each round t∈[T] (T is any natural number), a submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and a subset sequence derivation process for deriving a subset sequence X₁, X₂, . . . , X_T∈2^S in which an expected value of regret Σ_t∈[T]f_t(X_t)−Σ_t∈[T]f_t(X_t*) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^Ss satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0, where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 22

An information processing apparatus including at least one processor, the at least one processor carrying out: an objective function setting process for setting, as an objective function f_t in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2^S of a set S consisting of n elements (n is any natural number); and a subset sequence derivation process for deriving a subset sequence X₁, X₂, . . . , X_T satisfying the following condition β1 or β2:

• • the condition β1 being that each subset X_t satisfies |X_t|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying |X_t*|≤k and Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0,
  • the condition β2 being that the asymptotic behavior of the expected value of the α regret αΣ_t∈[T]f_t(X_t*)−Σ_t∈[T]f_t(X_t) with respect to the any benchmark X₁*, X₂*, . . . , X_t*∈2^S satisfying Σ_t∈[T−1]d_H(X_t*,X_t+1*)≤V coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,
  • where d_H(X_t*,X_t+1*) is a Hamming distance between subsets, the Hamming distance being defined by d_H(X_t*,X_t+1*)=|X_t*∪X_t+1*|−|X_t*∩X_t+1*|.

Supplementary Note 23

Note that any of these information processing apparatuses may further include a memory, which may store a program for causing the at least one processor to carry out the objective function setting process and the subset sequence derivation process. Not also that the program may be recorded in a non-transitory, tangible computer-readable storage medium.

REFERENCE SIGNS LIST

• • 1, 2 Information processing apparatus
  • 11, 21 Objective function setting unit (objective function setting means)
  • 12, 22 Subset sequence derivation unit (subset sequence derivation means)
  • S1, S2 Information processing method
  • S11, S21 Objective function setting process
  • S12, S22 Subset sequence derivation unit

Claims

1. An information processing apparatus comprising at least one processor, the at least one processor carrying out:an objective function setting process for setting, as an objective function ft in each round t∈[T] (T is any natural number), a submodular function on a power set 2S of a set S consisting of n elements (n is any natural number); anda subset sequence derivation process for deriving a subset sequence X1,X2, . . . ,XT∈2S in which an expected value of regret Σt∈[T]ft(Xt)−Σt∈[T]ft(Xt*) with respect to any benchmark X1*,X2*, . . . ,Xt*∈2S satisfying Σt∈[T−1]dH(Xt*,Xt+1*)≤V is not more than an upper limit Max (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,where dH(Xt*,Xt+1*) is a Hamming distance between subsets, the Hamming distance being defined by dH(Xt*,Xt+1*)=|Xt*∪Xt+1*|−|Xt*∩Xt+1*|.

2. The information processing apparatus according to claim 1, wherein in the subset sequence derivation process, after deriving a subset Xt in a round t, the at least one processor is capable of referring to a value ft(X) of the objective function ft with respect to any subset X∈2S, andthe upper limit Max (n,T,V) is given by the following expression (a): Max(n,T,V)=4√{square root over (T(n+2V))}+√{square root over (32Tlog(┌logT┐+4))}  (a)

3.The information processing apparatus according to claim 2, wherein in the subset sequence derivation process, the at least one processor uses (i) a d-dimensional vector pt∈[0,1]d (d is a maximum natural number not exceeding logT+4) satisfying |pt|=1 and (ii) d n-dimensional vectors Xt(1),Xt(2), . . . ,Xt(d)∈Rn to carry out, in each round,a subset derivation step of using a randomly selected ut∈[0,1] to derive the subset Xt={i∈[n]|xti≥ut}, assuming that ptj is a jth component of the vector pt, xt is an n-dimensional vector defined by xt=Σj∈[d]ptjxt(j), and xti is an ith component of the vector xt,a subgradient derivation step of deriving a subgradient gt at xt of the objective function ft, anda vector update step of updating the vectors xt(1),xt(2), . . . ,xt(d) in accordance with the following expression (a1) and updating the vector pt in accordance with the following expression (a2):

4. The information processing apparatus according to claim 1, wherein in the subset sequence derivation process, after selecting a subset Xt in a round t, the at least one processor is (1) capable of referring to a value ft(Xt) of the objective function ft with respect to the selected subset Xt and (2) incapable of referring to a value ft(X) of the objective function ft with respect to a subset X∈2S that is different from the selected subset, andthe upper limit Max (n,T,V) is given by the following expression (b):

5. The information processing apparatus according to claim 4, wherein in the subset sequence derivation process, the at least one processor uses (i) a d-dimensional vector pt∈[0,1]d (d is a maximum natural number not exceeding 4logT) satisfying |pt|=1 and (ii) d n-dimensional vectors xt(1),xt(2), . . . ,xt(d)∈Rn to carry out, in each round,a subset derivation step of (1) using a randomly selected ut∈[0,1] to derive the subset Xt={i∈[n]|xti≥ut} or (2) using a permutation σ on a set [n] satisfying xtσ(1)≥xtσ(2)≥. . . ≥xtσ(n) and a randomly selected st∈{0,1, . . . ,n} to derive the subset Xt={σ(j)|j∈[st]}, assuming that ptj is a jth component of the vector pt, xt is an n-dimensional vector defined by xt=Σj∈[d]ptjxt(j), and xti is an ith component of the vector xt, the subset Xt={i∈[n]|xti≥ut} being derived with a probability of 1−γ, the subset Xt={σ(j)|j∈[st]} being derived with a probability of γ,an unbiased estimator derivation step of deriving an unbiased estimator {circumflex over ( )}gt ({circumflex over ( )}g is a symbol with ∧ above g) of a subgradient gt at xt of the objective function ft, anda vector update step of updating the vectors xt(1),xt(2), . . . ,xt(d) in accordance with the following expression (b1) and updating the vector pt in accordance with the following expression (b2):

6. An information processing apparatus comprising at least one processor, the at least one processor carrying out:an objective function setting process for setting, as an objective function ft in each round t∈[T] (T is any natural number), a submodular function on a power set 2S of a set S consisting of n elements (n is any natural number); anda subset sequence derivation process for deriving a subset sequence X1,X2, . . . ,XT∈2S,in the subset sequence derivation process, the at least one processor using (i) a d-dimensional vector pt∈[0,1]d (d is a maximum natural number not exceeding logT+4) satisfying |pt|=1 and (ii) d n-dimensional vectors xt(1), xt(2), . . . , xt(d)∈Rn to carry out, in each round,a subset derivation step of using a randomly selected ut∈[0,1] to derive a subset Xt={i∈[n]|xti≥ut}, assuming that ptj is a jth component of the vector pt, xt is an n-dimensional vector defined by xt=Σj∈[d]ptjxt(j), and xti is an ith component of the vector xt,a subgradient derivation step of deriving a subgradient gt at xt of the objective function ft, anda vector update step of updating the vectors xt(1), xt(2), . . . , xt(d) in accordance with the following expression (a1) and updating the vector pt in accordance with the following expression (a2):

7. (canceled)

8. An information processing apparatus comprising at least one processor, the at least one processor carrying out:an objective function setting process for setting, as an objective function ft in each round t∈[T] (T is any natural number), a normalized submodular function on a power set 2S of a set S consisting of n elements (n is any natural number); anda subset sequence derivation process for deriving a subset sequence X1,X2, . . . ,XT satisfying the following condition β1 or β2:the condition β1 being that each subset Xt satisfies |Xt|≤k assuming that k is a given natural number and that an asymptotic behavior of an expected value of α regret αΣt∈[T]ft(Xt*)−Σt∈[T]ft(Xt) with respect to any benchmark X1*, X2*, . . . , Xt*∈2S satisfying |Xt*|≤k and Σt∈[T−1]dH(Xt*,Xt+1*)≤V coincides with an asymptotic behavior of a function A (k,T,V) determined from k,T,V, assuming that V is a given integer not less than 0,the condition β2 being that the asymptotic behavior of the expected value of the α regret αΣt∈[T]ft(Xt*)−Σt∈[T]ft(Xt) with respect to the any benchmark X1*, X2*, . . . , Xt*∈2S satisfying Σt∈[T−1]dH(Xt*,Xt+1*)≤V coincides with an asymptotic behavior of a function B (n,T,V) determined from n,T,V, assuming that V is a given integer not less than 0,where dH(Xt*,Xt+1*) is a Hamming distance between subsets, the Hamming distance being defined by dH(Xt*,Xt+1*)=|Xt*∪Xt+1*|−|Xt*∩Xt+1*|.

9. The information processing apparatus according to claim 8, wherein in the subset sequence derivation process, after deriving a subset Xt in a round t, the at least one processor is capable of referring to a value ft(X) of the objective function ft with respect to any subset X∈2S, andthe function A (k,T,V) is given by the following expression (c): A(k,T,V)=√{square root over (kT(k+V))}  (c)

10. The information processing apparatus according to claim 9, wherein in the subset sequence derivation process, the at least one processor carries out, in the each round t,a subset derivation step of deriving the subset Xt=Xtk by setting Xt0 to Xt0=Ø and then repeatedly carrying out a process for using an element its derived from a vector pt(s) output by an FSF algorithm execution module FSF*(s) to generate Xts=Xt,s−1∪{its}, anda feed generation step of generating, in accordance with lti(s)=ft(Xt,s−1∪{i})−ft(Xt,s−1)(i∈[n]), a feed lt(s)=(lt1(s),lt2(s), . . . ,ltn(s) to be input to the FSF algorithm execution module FSF*(s).

11. The information processing apparatus according to claim 8, wherein in the subset sequence derivation process, after deriving a subset Xt in a round t, the at least one processor is capable of referring to a value ft(X) of the objective function ft with respect to any subset X∈2S, andthe function B (n,T,V) is given by the following expression (d): B(n,T,V)=√{square root over (T(1+V/n))}  (d)

12. The information processing apparatus according to claim 11, wherein in the subset sequence derivation process, the at least one processor carries out, in the each round t,a subset derivation step of deriving the subset Xt=Xtn=Ytn by repeatedly carrying out a process for (1) setting Xt0 to Xt0=Ø and setting Yt0 to Yt0=[n], (2) using a vector pt(s) output by an FSF algorithm execution module FSF*(s) to set qt(s) to qt(s)=(1+2pt1(s))/4, and (3a) with a probability qt(s), setting Xts to Xts=Xt,s−1∪{s} and setting Yts to Yts=Yt,s−1 or (3b) with a probability 1−qt(s), setting Xts to Xts=Xt,s−1 and setting Yts to Yts=Yt,s−1\{s}, anda feed generation step of setting αts to αts=ft(Xt,s−1∪{s})−ft(Xt,s−1) and setting βts to βts=ft(Yt,s−1\{s})−ft(Yt,s−1), and then generating, in accordance with lti(s)=(1−qt(s))αts and lt2(s)=qt(s)βts, a feed lt(s)=(lt1(s),lt2(s)) to be input to the FSF algorithm execution module FSF*(s).

13-14. (canceled)