SuperMargin Implications? Yes, They Are Atrocious.

In a recent blog I developed an empirical model of AFL scoring in which I assumed that the Scoring Shots generated by Home and Away teams could be modelled by a bivariate Negative Binomial and that the conversion of these shots into Goals could be modelled by Beta Binomials.

Read More

Why AFL Handicap-Adjusted Margins Are Normal : Part II

In the previous blog on this topic I posited that the Scoring Shot production of a team could be modelled as a Poisson random variable with some predetermined mean, and that the conversion of these Scoring Shots into Goals could be modelled as a BetaBinomial with fixed conversion probability and theta (a spread parameter).

Read More

The Responsiveness of Bookmaker Prices To Winning and Losing

In this blog I'm seeking to answer a single question: how are a team's subsequent head-to-head bookmaker prices affected by the returns they've provided to head-to-head wagering on them in recent weeks? More succinctly, how much less can you expect to make wagering on recent winners and how much more on recent losers?

Read More

Assessing Probability Forecasts: Beyond Brier and Log Probability Scores

Einstein once said that "No problem can be solved from the same level of consciousness that created it". In a similar spirit - but with, regrettably and demonstrably, a mere fraction of the intellect - I find that there's something deeply satisfying about discovering that an approach to a problem you've been using can be characterised as a special case of a more general approach.

Read More

Modelling Miscalibration

If you're making probability assessments one of the things you almost certainly want them to be is well-calibrated, and we know both from first-hand experience and a variety of analyses here on MatterOfStats over the years that the TAB Bookmaker is all of that.

Well he is, at least, well-calibrated as far as I can tell. His actual probability assessments aren't directly available but must, instead, be inferred from his head-to-head prices and I've come up with three ways of making this inference, using an Overround-Equalising, Risk-Equalising or an LPSO-Optimising approach.

Read More

Bookmaker Overround: Relating Team Overround to Victory Probability

In the previous blog I described a general framework for thinking about Bookmaker overround.

There I discussed, in the context of the two-outcome case, the choice of a functional form to describe a team's overround in terms of its true probability as assessed by the Bookmaker. As one very simple example I suggested oi = (1-pi), which we could use to model a Bookmaker who embeds overround in the price of any team by setting it to 1 minus the team's assessed probability of victory. 

Whilst we could choose just about any function, including the one I've just described, for the purpose of modelling Bookmaker overround, choices that fit empirical reality are actually, I now realise, quite circumscribed. This is because of the observable fact that the total overround in any head-to-head market, T, appears to be constant, or close to it, in every game regardless of the market prices, and hence the underlying true probability assessments, of the teams involved. In other words, the total overround in the head-to-head market when 1st plays last is about the same as when 1st plays 2nd.

So, how does this constrain our choice of functional form? Well we know that T is defined as 1/m1 + 1/m2 - 1, where mi is that market price for team i, and that mi = 1/(pi(1+oi)), from which we can determine that: 

  • T = p1(o1 - o2) + o2

If T is to remain constant across the full range of values of p1 then, we need the derivative with respect to p1 of the RHS of this equation to be zero for all values of p1. This implies that the functions chosen for o1 and o2 must satisfy the following equality: 

  • p1(o1' - o2') + o2' = o2 - o1 (where the dash signifies a derivative with respect to p1).

I doubt that many functional forms o1 and o2 (both of which we're assuming are functions of p1, by the way) exist that will satisfy this equation for all values of p1, especially if we also impose the seemingly reasonable constraint that o1 and o2 be of equivalent form, albeit it that o1 might be expressed in terms of p1 and o2 in terms of (1-p1), which we can think of as p2.

Two forms that do satisfy the equation, the proof of which I'll leave as an exercise for any interested reader to check, are: 

  • The Overround-Equalising approach : o1 = o2 = k, a constant, and
  • The Risk-Equalising approach : o1 = e/p1; o2 = e/(1-p1), with e a constant 

There may be another functional form that satisfies the equality above, but I can't find it. (There's a rigorous non-existence proof for you.) Certainly oi = 1 - pi, which was put forward earlier, doesn't satisfy it, and I can postulate a bunch of other plausible functional forms that similarly fail. What you find when you use these forms is that total overround changes with the value of p1.

So, if we want to choose functions for o1 and o2 that produce results consistent with the observed reality that total overround remains constant across all values of the assessed true probability of the two teams it seems that we've only three options (maybe four): 

  1. Assume that the Bookmaker follows the Overround-Equalising approach
  2. Assume that the Bookmaker follows the Risk-Equalising approach
  3. Assume that the Bookmaker chooses one team, say the favourite or the home team, and establishes its overround using a pre-determined function relating its overround to its assessed victory probability. He then sets a price for the other team that delivers the total overround he is targetting. This is effectively the path I followed in this earlier blog where I described what's come to be called the Log Probability Score Optimising (LPSO) approach.

A fourth, largely unmodellable option would be that he simultaneously sets the market prices of both teams so that they together produce a market with the desired total overround while accounting for his assessment of the two team's victory probabilities so that a wager on either team has negative expectation. He does this, we'd assume, without employing a pre-determined functional form for the relationship between overround and probability for either team. 

If these truly are the only logical options available to the Bookmaker then MAFL, it turns out, is already covering the complete range since we track the performance of a Predictor that models its probability assessments by following an Overround-Equalising approach, of another Predictor that does the same using a Risk-Equalising approach, and of a third (Bookie_LPSO) that pursues a strategy consistent with the third option above. That's serendipitously neat and tidy.

The only area for future investigation would be then to seek a solution superior to LPSO for the third approach described above. Here we could use any of the functional forms I listed in the previously blog, but could only apply them to the determination of the overround for one of the teams - say the home team or the favourite - with the price and hence overround for the remaining team determined by the need to produce a market with some pre-specified total overround.

That's enough for today though ...

Bookmaker Overround: A General Framework

Previously I've developed the notion of taking a Bookmaker's prices in the head-to-head market and using them to infer his opinion about the true victory probabilities of the competing teams by adopting an Overround-Equalising or a Risk-Equalising approach. In this blog I'll be summarising and generalising these approaches.
Read More

Incorporating the Draw in Overround Calculations

At university, studying undergraduate Economics - which, granted, was a while ago - I particularly disliked theories premised on simplifying assumptions, which were introduced with an implicit promise, rarely honoured, to relax these assumptions later and nudge the theory a little closer to observed reality.
Read More

Determining Bookmaker Implicit Probabilities: The Risk-Equalising Approach

In the previous blog I developed a new way of divining a bookmaker's probability assessments of the two teams by assuming that he believes his maximum calibration error - the (negative) difference between his probability assessment for a team and its true probability of victory - is the same for each team in percentage point terms, and that he levies overround on each team's price so as to ensure that it will still deliver an expected profit even if his probability assessment is maximally in error.
Read More

Measuring Bookmaker Calibration Errors

We've found ample evidence in the past to assert that the TAB Bookmaker is well-calibrated, by which I mean that teams he rates as 40% chances tend to win about 40% of the time, teams he rates as 90% chances tend to win about 90% of the time and, more generally, that teams he rates as X% chances tend to win about X% of the time.
Read More

Estimating Fair Head-to-Head Prices : Part I

You'll recall that the total overround embedded in the head-to-head market, ignoring the possibility of a draw, is calculated by summing the reciprocal of the head-to-head prices for each team. So, for example, if the head-to-head prices for a game were $1.20 / $4.60, the overround would be 1/1.2 + 1/4.6, which is 105.1%. Some subtract 1 from this figure and would report this overround as 5.1%.
Read More

Deconstructing The 2011 TAB Sportsbet Bookmaker

To what extent can the head-to-head prices set by the TAB Sportsbet Bookmaker in 2011 be modelled using only the competing teams' MAFL MARS Ratings, their respective Venue Experiences, and the Interstate Status of the fixture?
Read More