Challenges with the tennis challenge system

The new challenge system for close line calls in tennis has been used on the ATP and WTA tour for grand slam events since the 2006 US Open, and was designed to increase fairness for players by obtaining accurate line calls and enhance spectator interest through video technology. In the current system, players have unlimited opportunity to challenge, but once three incorrect challenges are made in a set, they cannot challenge again until the next set. If the set goes to a tiebreak game, players are given additional opportunities to challenge (usually one extra). If the match is tied at six games all in an advantage set, the counter is reset with both players again having a limit of up to three incorrect challenges in the next 12 games, and this resetting process is repeated after every 12 games.

Strategies as to when players should challenge have recently appeared in the literature. Pollard et al. (2010) show that challenge decisions are based on the rate at which challenges occur, the expected number of points remaining in the set, the number of challenges remaining in the set, the probability of the challenge decision being successful and the importance of the point to winning the set. Clarke and Norman (2010) apply dynamic programming to the challenge system to investigate the optimal challenge strategy and obtain some general rules.

There appears to be problems with the current challenge system:

  • Firstly, both of the above articles show that early in the set a player needs to decide whether to challenge, or save challenges to later on in the set when the points are typically more important. Having to make such decisions is completely irrelevant to the game of tennis itself. The aim of the contest is to find the better player, and not to favour the player who is luckier within, or better at playing the challenge system. This is reflected by an article 'Replay System Becomes Part of Players’ Strategies' in The New York Times during the 2009 US Open.
  • Secondly, a player can run out of challenges because that particular set has a lot of balls that go close to the lines. This is perhaps particularly true in men’s singles and men’s doubles. The problem is exacerbated when each player does not have a similar number of challenges. A player who plays more balls near the lines is disadvantaged relatively. The player who, by chance has the need for more challenges, is disadvantaged.
  • Thirdly, it would appear to be disappointing for the player and the spectators when that player runs out of challenges, the point is very important, and a challenge would have a clear likelihood of success. What is the chance that a grand slam final will be ‘messed up’ by an umpire making a wrong call and the player having run out of challenges, and subsequently losing the final when he might well have won it otherwise? This would be a very bad result for the player, the umpire and the game. Maybe this probability is not quite as small as some people might expect.

Importance of points

Morris (1977) defines the importance of a point for winning a game (IPG) as the probability that the server wins the game given he wins the next point minus the probability that the server wins the game given he loses the next point. Table 1 gives the importance of points to winning the game when the server has a 0.62 probability of winning a point on serve, and shows that 30-40 and Ad-Out are the most important points in the game. In a similar way, we can define the importance of a game to winning a set and the importance of a set to winning a match. Table 2 gives the importance of games to winning a tiebreak set (IGS) for player A serving. Player A and Player B were assigned point probabilities of 0.62 and 0.60 respectively to reflect overall averages in men’s tennis. It is clear that every point is equally important for both players. Table 2 shows that the tiebreak game has the highest importance of 1.00, as the winner of this game wins the set. Similarly, table 3 gives the importance of sets to winning a best-of-5 set match (ISM) and shows that the deciding set at 2 sets-all has the highest importance of 1.00, as the winner of this set win the match. Morris (1977) derived the following useful multiplicative result to obtain the importance of a point to winning the match (IPM): For any point of any game of any set, IPM = IPG * IGS * ISM.

The definition of importance of a point in a match is a way of stating how much difference will result in the outcome of the match depending on whether a point is won or lost. In the context of a challenge system, importance of a point in a match can be viewed by how much percentage error will occur if a wrong decision is made. For example, suppose the score in a best-of-5 set match (all tiebreak sets) is 2-2 in sets, 5-5 in games and 30-30 in points and player A is currently serving. Suppose player A is winning 62% on serve and player B is winning 60% on serve. Using a Markov Chain model (Barnett and Clarke, 2005), player A has a 51.5% chance of winning the match from that position. If player A won the point, then his chance of winning the match would be 60.3%: whereas if player A lost the point then his chance of winning the match would be 37.3%. Therefore the importance of the point in the match is given as 60.3%-37.3%=23.0%. If a wrong decision was made at that particular point in the match, then it would cost one of the players 23 percentage points in their chance of winning the match.

Proposed new challenge system

It is proposed that the present challenge rule is modified in one way. Namely, that a player is allowed to challenge on points with sufficiently large importance, without risking that player’s challenge point total.

Suppose the threshold value on when a player can always challenge a line call was given by the importance of the point in the match at 2 sets-all, 3 games-all and player A serving. This is calculated as 0.247*0.420*1.00=0.104 when player A and player B have a 0.62 and 0.60 probability of winning a point on serve respectively. Then a player can always challenge at 2 sets-all and 3 games-all, only if the point score in the game has an importance of at least 0.247. This occurs at 30-40 or Ad-Out (IPG=0.727), 15-40 (IPG=0.451), 15-30 (IPG=0.447), 30-30 or deuce (IPG=0.446), 0-30 (IPG=0.384), 0-15 (IPG=0.341), 15-15 (IPG=0.315), 0-40 (IPG=0.279), 40-30 or Ad-In (IPG=0.273) and 0-0 (IPG=0.247). This is represented in table 4 for a range of game scores in the deciding set, where an X indicates that a challenge is always allowable by both players. Note that a player can challenge at 2 sets-all and 6 games-all (tiebreak game), only if the point score has an importance of at least 0.104. This occurs for the majority of points in the tiebreak game, as expected.

 

References

  • Barnett T and Clarke SR (2005), Combining player statistics to predict outcomes of tennis matches. IMA Journal of Management Mathematics. 16 (2), 113-120.
  • Clarke S and Norman J (2010), An introductory analysis of challenges in tennis. Proceedings of the Tenth Australasian Conference on Mathematics and Computers in Sport. Edited by A Bedford and M Ovens. 43-48.
  • Morris C (1977), The most important points in tennis. In Optimal Strategies in Sports, Volume 5 in Studies in Management Science and Systems, Edited by S.P. Ladany and R.E. Machol, Amsterdam: North-Holland Publishing Company, 131-140.
  • Pollard GN, Pollard GH, Barnett T and Zeleznikow J (2010). Applying strategies to the tennis challenge system. Journal of Medicine and Science in Tennis 15(1), 12-15.