A Dutch Book argument for linear pooling

Often, we wish to aggregate the probabilistic opinions of different agents. They might be experts on the effects of housing policy on people sleeping rough, for instance, and we might wish to produce from their different probabilistic opinions an aggregate opinion that we can use to guide policymaking. Methods for undertaking such aggregation are called pooling operators. They take as their input a sequence of probability functions c1,,cn, all defined on the same set of propositions, F. And they give as their output a single probability function c, also defined on F, which is the aggregate of c1,,cn. (If the experts have non-probabilistic credences and if they have credences defined on different sets of propositions or events, problems arise -- I've written about these here and here.) Perhaps the simplest are the linear pooling operators. Given a set of non-negative weights, α1,,αn1 that sum to 1, one for each probability function to be aggregated, the linear pool of c1,,cn with these weights is: c=α1c1++αncn. So the probability that the aggregate assigns to a proposition (or event) is the weighted average of the probabilities that the individuals assign to that proposition (event) with the weights α1,,αn.

Linear pooling has had a hard time recently. Elkin and Wheeler reminded us that linear pooling almost never preserves unanimous judgments of independence; Russell, et al. reminded us that it almost never commutes with Bayesian conditionalization; and Bradley showed that aggregating a group of experts using linear pooling almost never gives the same result as you would obtain from updating your own probabilities in the usual Bayesian way when you learn the probabilities of those experts. I've tried to defend linear pooling against the first two attacks here. In that paper, I also offer a positive argument in favour of that aggregation method: I argue that, if your aggregate is not a result of linear pooling, there will be an alternative aggregate that each experts expects to be more accurate than yours; if your aggregate is a result of linear pooling, this can't happen. Thus, my argument is a non-pragmatic, accuracy-based argument, in the same vein as Jim Joyce's non-pragmatic vindication of probabilism. In this post, I offer an alternative, pragmatic, Dutch book-style defence, in the same vein as the standard Ramsey-de Finetti argument for probabilism.

My argument is based on the following fact: if your aggregate probability function is not a result of linear pooling, there will be a series of bets that the aggregate will consider fair but which each expert will expect to lose money (or utility); if your aggregate is a result of linear pooling, this can't happen. Since one of the things we might wish to use an aggregate to do is to help us make communal decisions, a putative aggregate cannot be considered acceptable if it will lead us to make a binary choice one way when every expert agrees that it should be made the other way. Thus, we should aggregate credences using a linear pooling operator.

We now prove the mathematical fact behind the argument, namely, that if c is not a linear pool of c1,,cn, then there is a bet that c will consider fair, and yet each ci will expect it to lose money; the converse is straightforward.

Suppose F={X1,,Xm}. Then:
  • We can represent a probability function c on F as a vector in Rm, namely, c=c(X1),,c(Xm).
  • We can also represent a book of bets on the propositions in F by a vector in Rm, namely, S=S1,,Sm, where Si is the stake of the bet on Xi, so that the bet on Xi pays out Si dollars (or utiles) if Xi is true and 0 dollars (or utiles) if Xi is false.
  • An agent with probability function c will be prepared to pay c(Xi)Si for a bet on Xi with stake Si, and thus will be prepared to pay Sc=c(X1)S1++c(Xm)Sm dollars (or utiles) for the book of bets with stakes S=S1,,Sm. (As is usual in Dutch book-style arguments, we assume that the agent is risk neutral.)
  • This is because Sc is the expected pay out of the book of bets with stakes S by the lights of probability function c.
Now, suppose c is not a linear pool of c1,,cn. So c lies outside the convex hull of {c1,,cn}. Let c be the closest point to c inside that convex hull. And let S=cc. Then the angle θ between S and cic is obtuse and thus cosθ<0 (see diagram below). So, since S(cic)=||S||||cic||cosθ and ||S||,||cic||0, we have S(cic)<0. And hence Sci<Sc. But recall:
  • Sc is the amount that the aggregate c is prepared to pay for the book of bets with stakes S; and 
  • Sci is the expert i's expected pay out of the book of bets with stakes S.
Thus, each expert will expect that book of bets to pay out less than c will be willing to pay for it.



Comments

  1. Interesting post. You write, "Since one of the things we might wish to use an aggregate to do is to help us make communal decisions, a putative aggregate cannot be considered acceptable if it will lead us to make a binary choice one way when every expert agrees that it should be made the other way." I was wondering what you might think about the SSK example at the end of their "Coherent Choice Functions under Uncertainty" paper. There, two experts unanimously reject an option in a three-option menu. But this option is uniquely admissible according to the .5-.5 convex combination of the two expert opinions.

    ReplyDelete
  2. Thanks for this, Rush. Yes, you're right that I have to be more careful about how I state that. What linear pooling guarantees is that, if all experts prefer A to B, then the aggregate prefers A to B. And, as this result shows, only linear pooling entails that. But, as you point out, it is possible that all experts reject A in favour of B or C, while the aggregate favours A. The Miners Paradox would be a case of this. But what will happen in this situation is that one expert prefers B to A to C, and the other prefers C to A to B, and the aggregate prefers A to B/C.

    ReplyDelete
  3. I wanted to thank you for this great read!! Posts are very helpful.
    The best hotel rooms

    ReplyDelete
  4. Grateful for you writing this blog

    ReplyDelete

Post a Comment