Simulation Metrics for All Time Greats
Tennis Grand Slam winners have played more than 3,000 matches between each other. Pantheonists, the 16 greatest tennis players of all time, have played more than 1,400 matches against each other while winning 70% of the available grand slam titles of the Open era. We crunched the numbers and created two metrics to measure the overall greatness during a career for Pantheonists. In reviewing the data, we normalized it by considering only matches where players were younger than 31 (there are only a few slam winners over this age) or if there was less than 5 years of age between the players, such as with Sampras and Agassi, we included that data into their later years.
Results are below which show that on a winning percentage vs. other all time greats, Roger Federer ranks #14 on the SITDON scale. Rafael Nadal’s #1 ranking is built entirely on his dominance over Federer and we consider there to be insufficient data to rank him #1. We believe that we will need to see Nadal’s performance over the next few years vs. other rising players to clearly see where he ranks among the all time greats, but he has a fantastic start and it is clear that we are now in the midst of the “Nadal” era overshadowing Federer’s era with his defeat of Federer at Grand Slam finals on every surface the last time they played.
On a cumulative quality of slams all surface ranking, Federer ranks #10 all time. Federer’s all surface slam does little to influence his overall ranking as there was only one other single slam winner in the quarterfinals of his French Open victory. Assuming Federer does not change stylistically i.e. adapt a kamikaze net rush style at all costs approach like McEnroe, Rafter, Edberg and Sampras in their later years, we don’t anticipate he will win another slam without injuries or upsets to his central competitors. Nadal is on course to surpass both Borg and McEnroe from a cumulative quality point of view on his next slam victory and may surpass Sampras with 2 or 3 more slams. We consider this a difficult task since Nadal is the same age as Wilander at the time he won his last slam and one year younger than Borg when he retired.
Our two metrics are SITDON, the Secada Index of Tennis Dominance with Overt Normalization, and SATERICCON, the Secada Absolute Tennis Era Relative Influence and Championship Competitiveness Over Normalization. SITDON looks at career winning percentage before the player turns 31 to determine how they did vs. other all time greats. We consider this to be an excellent substitute for weeks at number 1 ranking and number of slams won. From our point of view, SITDON is the equivalent of baseball ERA which tells you week in, week out, what was the consistency of that player. However, SITDON is far more granular as it only looks at the statistics in matches between all time greats, like pitching against Reggie Jackson or Barry Bonds and does not include the equivalent of baseball’s bum of the month.
SATERICCON, measures individual greatness at any point in time. Though SITDON measures overall career performance, SATERICCON answers the question, in a tournament of the greatest players, who would win those tournaments? Historically, who was the greatest at the instant when it mattered. It is a complementary statistic to our Slam Triple metric yet it considers the cumulative value of winning a number of slams which may be less competitive vs. winning a few ultra-competitive slams. So it answers the question, if you won a slam in the ultra competitive 1987-1993 period, how would that translate into playing in slams in the far less competitive, A32 era and vice versa.
Normalization is the process of looking at data, in this case, 1,400 plus match results and selecting the good data while throwing out the bad. Though not a perfect process we erred on the side of conservatism in determining when a player was at or near their peak. In this case we included all data for players from the time they began playing pro tournaments to their 31st birthday. Long-playing champions such as Connors, Lendl, Sampras and Agassi are rewarded by both metrics for their longevity. They are more than just champions for tennis, they are part of the fabric of the sport, tennis DNA.
SITDON has 4 advantages over other measures. (1) it eliminates factors that others say make era comparison indeterminate such as equipment, fitness or seedings. All that matters is the results between top players, (2) it makes it easier to evaluate how age, mileage and style impact the outcome of a match and (3) it refines overall win record and overall match record to only those matches between the greatest players of eras at their peak. (4) It eliminates computer ranking which is frequently subverted for business to incentify players to play more with higher risk of injury.
SITDON is an absolute measure of competitiveness between Pantheonists in the same era. Federer’s total match record vs. Pantheonists ranks him 15th all time in number of matches and with normalization, he ranks 14th out of 16 in winning percentage vs. Pantheonists as well. John Newcombe takes the last spot as all of his wins over Laver and Rosewall are eliminated via normalization i.e. they were all over 30 when he played them. Even without normalization i.e. elimination of matches vs. Pantheonists far from their peak, Federer finishes near last in the Pantheon.
Note: though cumulative career statistics matter on an absolute basis, there is a danger in quoting mid-career statistics average or percentile statistics for tennis players as they are surely to decline in the second half of a career. Nadal and Federer’s percentages and averages are surely to decline as has every Pantheonist before them as they play longer and deeper into the latter half of their careers.
SITDON measures what would happen if Pantheonists were to play one singles match against each other, SATERICCON measures what would happen if Pantheonists were to play a succession of matches against each other. SATERICCON’s basis is to determine who was greatest when the greatest all played each other assuming a winner of an all time great tourney would be indicated by past performance.
To create this measure, we use analytic methodology and then we consider ancient and present competitive folklore. Larry Holmes was undefeated in his first 44 bouts beating an old Muhammad Ali in 15 rounds. Ali defeated 6 heavyweight champs in or near their prime. Experts consider Ali a greater champion. Michael Jordan’s Bulls became champs after beating Isiah Thomas’ Detroit Pistons (at their prime) who had beaten the Celtics and Lakers before them. Olajuwon’s Rockets won the championship when Jordan semi-retired and the Bulls and Pistons were long past their glory. They disappeared when Jordan returned. Jordan’s Bulls are considered greater than the Rockets.
In the Trojan war, Achilles retired briefly over compensation issues, in the interim period Hector laid waste the Greeks slaying far more than Achilles that year and nearly destroying their navy, almost altering history. But when Achilles came out of retirement, everyone well knew who would win, it was destiny. Our methodology borrows heavily from this philosophy and the Highlander series. When the Highlander defeats another Highlander he gains the power of that Highlander and all their previous victims. Likewise in the Volsunga Saga of Nordic and Germanic literature, if you defeat a dragon and eat it’s heart you gain it’s power. When measuring greatness, history has always looked at the quality of your victories over the quantity. In SATERICCON, when you defeat another slam champ or the person who defeated them in the slam, you gain their power rating as a cumulative score.
We measure the overall difficulty of winning a grand slam championship by the quality of the field at the quarterfinal stage of the tournament. We consider the number of grand slams won by the other quarterfinalists, excluding the winner and score the slam as having the value of difficulty assigned by all quarterfinalists. So for example, Pete Sampras’ first Wimbledon championship had Jim Courier, Boris Becker, Mats Wilander, Stefan Edberg, Goran Ivanisevic and Andre Agassi in the quarterfinals. The cumulative score of that win is a 28 which is the number of career slams by those players. In Federer’s first US Open victory, Andy Roddick, Lleyton Hewitt and Andre Agassi were quarterfinalists . Those players won 11 grand slams between them and Federer’s score is an 11. However, to come up with a true “normalized” measure of greatness, we only measure players who were at or near their peak in skills and athleticism, so Federer’s score was reduced to 3 by eliminating Agassi who was already 33 at the time of this tournament. Every player was impacted by this measure as almost each player had an all time great long past their prime in the quarterfinals of one or more of their championships.
The impact of normalization on Federer’s record is far greater since he has played so few Pantheonists and is dominated by Nadal, the only other Pantheon player in his era. Without normalization, based on his wins over a 33 year old Agassi, Federer would move past Becker and Wilander on the all time list but that would only get him to #8 all time on an all surface basis. It was important to use the cumulative score of grandslam wins vs the average score as it balances out the dearth of grand slam champs Federer defeated per tournament but gives him extra points for his cumulative slam wins. (On an average Slam victory Q-Rating score basis, Federer would rank near last.) This study does not address what would have happened if Lendl had given up his Quixotic quest for a Wimbledon title and won 2 more French Opens, what would have happened if McEnroe had not taken a break during his career or what would have happened should Jimmy Connors have been allowed to play the French Open in 1974. All these players ranked ahead of Federer in SITDON and SATERICCON rating.
To create the metric for competitiveness of grand slam victory, we used Federer as the baseline for all other players since so many journalists and talking heads rank Federer as #1 we gave Federer’s cumulative score a 1 and then graded the other players on a scale relative to Federer. Though several other players have won a Slam Triple, Federer has never been able to do it which questions his ability to win a tournament of all time greats. Though our SATERICCON rating does not say Pete Sampras is 2.37 more likely to win an average slam than Federer (though we think it is positively indicative), it does say he is far more likely to win a slam 2.37 times more difficult than Federer.
We also eliminated the Australian Open from consideration because it had little relevance in tennis until it became the first slam on the calendar in 1987. Players like Orantes never played the Australian Open and Borg and Nastase played in it once. Next, The toughest tournaments of all time on each surface and the winners.
Secadametrics's Blog 