SODOS
Table of contents |
Definition
SODOS is a tie-breaking method sometimes used in small (often round-robin) tournaments. It should not be used in McMahon tournaments.
SODOS stands for Sum Of Defeated Opponents' Scores.
It is defined as the Sum of Defeated opponents' McMahon scores, which is equivalent to "sum of defeated opponents' wins", when used properly.
As the name SODOS suggests, its value depends upon how many opponents you have defeated. If you lose all your games then your SODOS is zero. If you beat two others then it is the sum of two scores. If you beat 10 others then it is the sum of 10 scores.
The intent behind using it is to discover how strong your opponents were. The theory being that if you have defeated a stronger set of opponents than another player on the same final score, then you are slightly stronger / better than they are.[1]
SODOS is also sometimes named SDOS. It is called SODOMS (Sum Of Defeated Opponents McMahon Scores) when it is used in a McMahon Tournament. Chess players dub it Sonneborn-Berger.
It is sometimes used in round robin tournaments, where SOS is of no use [1].
Notes:
- SODOMS was used as a tie breaker by the American Go Association in the 2007 US Open (
results) at the 2007 US Go Congress.
- The British Go Association recommends that
SODOS should not be used in McMahon tournaments. See discussion below.
The use of SODOS as a tie breaker is flawed
SODOS differences are NOT always invariant under change of origin of the McMahon Pairing scale.
The origin of the McMahon Pairing scale does vary: it is zero at 20 kyu in many European tournaments, it is zero at shodan in the UK.
Here is an example of a 3-round tournament illustrating concerns about using SoDoS as a tie breaker.
We have a shodan Alan winning 2 games playing:
Bob(1k)-, Cath(1d)+ Dave(1k)+
We have a 1kyu Juliet winning 3 games playing:
Karen(1d)+ Lionel(1k)+ Martin(1k)+
It is not necessary to show the entire tournament results table. Here is a summary of the key information for Alan's and Juliet's opponents' scores in UK and EU styles.
Alan's opponents:
UK MMS Euro MMS Name Wins initial final initial final Bob(1k) 2 -1 1 19 21 Cath(1d) 1 0 1 20 21 Dave(1k) 2 -1 1 19 21
Juliet's opponents:
UK MMS Euro MMS Name Wins initial final initial final Karen(1d) 0 0 0 20 20 Lionel(1k) 2 -1 1 19 21 Martin(1k) 2 -1 1 19 21
If we use SoDoS as the one and only tie breaker, then we can construct the portion of the final ranklist showing both Alan's and Juliet's position. The column MMSi is the initial McMahon Pairing score, and MMSf is the final McMahon Pairing score.
Using the UK scale, we have Alan and Juliet ranked equal and sharing any prize:
Wins MMSi MMSf SoDoS WHO CONTRIBUTES TO SODOS Juliet(1k) 3 -1 2 0+1+1=2 Karen+Lionel+Martin Alan(1d) 2 0 2 1+1=2 Cath+Dave
Using the EU scale Juliet is ahead of Alan, Juliet gets the prize:
Wins MMSi MMSf SoDoS WHO CONTRIBUTES TO SODOS Juliet(1k) 3 19 22 20+21+21=62 Karen+Lionel+Martin Alan(1d) 2 20 22 21+21=42 Cath+Dave
It does not matter here which result is better. It demonstrates that SODOS is flawed and should not be used.
Note that if you use SOS (Sum of all opponents McMahon scores) as the tie breaker, then this effect does not happen because you are summing over all games, not just a selection.
Read the example above again comparing either scheme with one where a shodan scores -100. In that case a player with no wins scores 0 whilst one with several wins will be far worse off with a score of minus several hundred!
wms: I find this argument to be totally bogus. If I understand correctly, the argument is: SODOS changes based on your origin, therefor it is a lousy tiebreaker in MM tournaments. My answer: Each tournament has only one origin, so within the context of the tournament the SODOS is reliable, therefore the "problem" doesn't exist.
Harleqin: For SODOS, losing a game is worth the same as winning against a player with 0 MacMahon points. Obviously, below the origin, you will get behaviour inverse to that over the origin. This means that for getting the desired direction of your tiebreaker, you have to make sure the origin is lower than the last player. Also, the effect of losing a game is directly proportional to the distance from the origin. This means that also with swiss pairing, the top players (whose opponents have points close to the number of rounds) will see a big effect of winning or losing on their SODOS, while the last players (whose opponents have points close to 0) will not see any big effect.
wms: Yes, that is what I alluded to in the next paragraph. For high ranked players, when the weakest players started with 0 MM points, SODOS will place players with more wins above those with fewer wins, and when both players have the same number of wins, it will behave the same as Swiss-style SODOS. I find this behavior good, so therefore, I would call SODOS a good tiebreaker (if you set up your tournament properly).
Further, I find SODOS to be a better first tiebreaker than SOS if the bars and MM points are set up so that people only have positive initial scores. My reasoning is that in a tournament, the only thing a player has control over is when they win and when they lose. If the stronger players have positive starting scores, then the SODOS will prioritize the player with more wins over the player with fewer wins, so a player starting with 19 points who gets 3 wins will usually have a higher SODOS than a player starting with 20 points who gets only 2 wins. Meanwhile, using SOS as the first tiebreaker will usually give proritize the player who started with 20 points and won fewer games, because they started at a higher point, and thus probably played opponents with more points.
On KGS, originally I did use SOS then SODOS as the MM tiebreakers (same as used in Swiss tournaments), but found that the "tiebreaker" would always just hand the win to the player who started with more points, instead of the player who actually won more games. This struck me as a terrible tiebreaker since it would use something utterly beyond the control of the players to break the ties, instead of using actual tournament performance. I switched to SODOS first, and since then I can't find a single tournament where comparing wins vs. tiebreaker results "feels" wrong.
Chris Hayashida: Having just run the Cotsen Go Tournament, I find myself thrust in the middle of all of these tie-breaker problems. I think example above uses SODOS incorrectly. If I understand SODOS correctly, it should only be applied after the win-loss record is taking into account.
The example above is flawed in that Juliet, with 3 wins, is being compared against 2 wins. Juliet should always win because of a better record, regardless of SODOS. SODOS only comes into play when comparing two players with an equal number of wins.
wms: Chris, I think that usually in MM tournaments, the winner is not the player with the most wins. The winner is the player with the most MM points. Since you can gain (at most) one point on the current leader per round, that means that if you start more than 5 points below the top player in a 5 round tournaments, you have zero chance of being the overall winner. This sounds unfair, but the reason for it is that MM is a system that lets you have one tournament with people of all different ranks in it, and have the games be "close." In a Swiss tournament, the weaker players don't play each other, so you get a lot of badly lopsided games. But if MM gave the win to the player with the most wins, then the tournament wouldn't be won by the best player, it would instead be won by the biggest sandbagger, which wouldn't seem very satisfying either.
So MM gives the win to the most points at the end, and the best overall player wins, and the weaker players enter the tournament for the fun of it and have good games.
There's nothing stopping a TD from handing out prizes for "most wins", etc., which can give weaker players something to try for, but the tournament winner should be the best player in the tournament, which (if the tournament is set up properly) will be the player with the highest MM score at the end.
I thought that Cotsen was a Swiss tournament. Is it MM?
Chris Hayashida: The Cotsen Go Tournament is run as a Swiss-McMahon tournament. I am not clear on what the difference is. We do tiebreakers based on win-loss record, then use SOS and SODOS to break ties. Because each rating is more or less a separate band, it seems that the player with the stronger entry rating (and loses in later rounds) seem to have better tie break scores.
Bass: (2008-01-20) I strongly disagree with wms. Use of SODOS as described in the above comments is fundamentally wrong. The lengthy comment below tries to explain why, so please bear with me.
MacMahon is a system that is to be used in a tournament whose purpose is to find an order for all players, and to give the better score to the stronger player, giving this tournament's success an emphasis in evaluation of strength. If you have any other purpose for the tournament, or any other definition for "better", using MacMahon will very likely be counterproductive.
Now, if the MacMahon system fails to produce a difference in the score, you may want to use a tiebreaker to find out which one of the players was better. In this case you must remember that "better" is already defined, and it would be silly to change it at this point. So if you break ties, you should do in a way that is consistent with your definition of "better". If you use SOS, you will compare the strength of the opposition, as found out using your definition of "better". (It does not matter what your definition of "better" was, this is a property of the SOS tiebreaker.) So SOS is indeed a good way to break ties, when tiebreaking is necessary. Or if you really want to ignore the losses in the tiebreaker, you could imaginably average over the defeated opponent's scores. But if you use SODOS with all players having positive scores, you are actually rewarding the player that is worse by your definition of better. (As elaborated above by wms, when the players started from a different band, SODOS-cum-positive-mms produces results that are opposite to those given by SOS.)
If you do not like the definition of "better" used by the MacMahon system, you should use another tournament system. You should not kludge a buggy tiebreaker to produce results you happen to like, because if that tiebreaker is not consistent with the rest of the tournament system, then your tournament works the way you want only in the case of ties.
All in all, please do not combine SODOS with MacMahon. Thank you.
wms: Bass, you make some claims that I don't see. Please explain, how does SODOS reward the player that is worse by my definition of better? An example would be helpful I think.
I think what Bass is getting at is that if you define player A as better than player B, by giving player A more McMahon points at the start of the tournament, and they end up on the same McMahon score (so B has more points than A), then SODOS pretty much guarantees that B will be ranked higher. --Herman Hiddema
Bass: Thanks Herman, that was my point exactly. If you decide that "more MMS is better", then (if you really want to break ties) the logical follow-up is "getting the same MMS against better players is better". In other words, SOS is always consistent with the bigger plan. Therefore, an argument against SOS is usually an argument against "more MMS is better", which usually means that there is something wrong in the tournament system itself, and another one might be better.
Bass: Also, if you cannot avoid MacMahon for some reason and still really really want to award any MMS ties to the player with more wins, you should make that your primary tie breaker instead of cleverly exploiting a SODOS bug to provide the same effect. This allows you to choose a primary tie breaker other than SODOS for players that indeed have the same MMS and the same number of wins.
wms: But if starting points means a better player, then why hold the tournament at all? Starting points is the estimate of a player's strength, used to guarantee they play others close in strength. It's nothing more. By your reasoning, if A starts out with a MMS of 10, and B starts out with 9, then B wins two more games then A and thus beats A in tournament standing, the "wrong" player is winning the tournament. That's ridiculous. Tournaments should award winners to the player who had the best performance in the tournament, giving that precedence over the player who was seeded the highest. Using SODOS does exactly that. If two players end at the same MMS, then the one who won the most games (which will be the one seeded lower, since he had to win more to get to where he is) is considered the better player. I see that as rewarding exactly the correct player. (If they have the same number of wins, then again SODOS works great, it awards the better position to the player who had to beat tougher opponents).
Herman Hiddema: Well, an example of something that would certainly feel wrong to me would be:
- Alice is 1k, starts with MM 19
- Bruce is 1d, starts with MM 20
- Alice scores, in this order: 1k- 2k- 3k+ 2k+ 1k+ and achieves MM 22
- Bruce scores, in this order: 1d+ 2d+ 3d- 2d- 1d- and achieves MM 22
To me, the above results show that Alice is about 1k, scoring 50-50 against 1k players, but also just 50-50 against 2k players. Bruce shows himself to be a solid 1d, scoring 50-50 against other 1d and also 50-50 against 2d players. I would, based on these results, think that Bruce is the better player. But SODOS will award that distinction to Alice. Wrongly, IMO.
Now the other way around:
- Alice is 1k, starts with MM 19
- Bruce is 1d, starts with MM 20
- Alice scores, in this order: 1k+ 1d+ 1d+ 2d- 1d- and achieves MM 22
- Bruce scores, in this order: 1d- 1k- 1k- 2k+ 1k+ and achieves MM 22
To me, the above results show that Alice seems stronger than 1k, scoring 100% against 1k and 67% against 1d. Bruce shows himself to be a very weak 1d, scoring 0% against other 1d and just 33% against 1k players. I would, based on these results, think that Alice is the better player.
In both of the above cases, SOS will (generally) agree with me. SODOS will do one case wrong. So I think this shows SOS is the better tiebreaker.
pwaldron: It is important to distinguish between using SODOS in a European McMahon tournament vs. a North American event. From the examples above it appears that Europeans are trying to break ties regardless of initial score, which leads to trouble.
In North America, players are initially grouped into divisions and prizes are awarded by division. In such a case SODOS is only used to break ties within a division (and usually only after SOS fails to break the tie first). Used in this manner SODOS makes sense because in order to be tied players must have won the same number of games and the origin of the McMahon zero doesn't matter.
Herman: In Europe, tie breakers are really only used to determine the winner of a tournament. There are usually no divisions, so there is no need to break ties within them. Instead, players are awarded prizes based on their performance, which usually means that any player who scores 4/5 or better gets a prize, regardless of their starting rank or SOS/SODOS/etc.
Proper uses of SODOS
You can only use SODOS as a tie breaker if your tournament is so small that you only have one McMahon group. (So that you are basically just doing swiss pairing) Even then, you should consider using SOS first.
Some acceptable reasons for considering SODOS are
- SOS would not break any ties. (In a round-robin tournament all players at the same score have identical SOS)
- You want to award some tie breaker points according to how close the game was. (In a team tournament? you may want to award more tie breaker points for a 3-0 win than a 2-1 win, and maybe even something for a 1-2 loss)
However, you are probably better off using another tie breaking method, as SODOS tells nothing about the strength of the opponents the player lost to, and can therefore sometimes be considered unfair. (or more fair, depending on your point of view, of course)
[1]tderz: Has the following already been addressed?
Above we can read that
- SODOS stands for Sum Of Defeated Opponents' Scores and
- the intent of using it is to discover how strong your opponents were,
- the intent of using it is to discover how strong your opponents were,
with the underlying assumption that "if you have defeated a stronger set of opponents than another player on the same final score, then you are slightly stronger/better than they are."
Now let's imagine a new type of score called
- SOLOS (resp. SOLTOS or SOOLT etc.) stands for **Sum_Of_Lost_(to)_Opponents'_Scores **Sum_Of_Opponents_Lost_To_Opponents'_Scores or **Sum_Of_Opponents_Lost_To_Scores etc. and
- the underlying assumption of using it is, that "if you have lost to a weaker set of opponents than another player on the same final score, then you are slightly weaker than they are." Herman's example above makes that clear.
This weakness indicator SOL(T)OS should give us the same information of strength, be it with another polarity.
- SODOS + SOLTOS = SOS and SOLTOS = SOS - SODOS
If SODOS as tie-breaker is senseless in Swiss and round-robin tournaments,
it doesn't make directly sense in McMahon where several diverging examples can cloud the proof.
Perhaps you guess it at this point, I find SODOS as tie-breaker for McMahon tournaments quite senseless. McMahon tournaments are used for enabling many people to play interesting even games in a big tournament comprising players from a broad range of strengths. If the downside is that the tournament produces several winners, so be it.
If there is still need to end up with only one winner (e.g. un-dividable ticket or representation rights), then use again real Go strength as criterium (e.g. best-of-3 (rapid?) or a last decisive game) as opposed to chart reading.
A McMahon with more planned rounds, if needed with shorter time, e.g. 45 minutes - all of this can really help to produce clear winners.
If TDs (and the participants) do not have time for these measures, perform a lotterie (!) - which is as fair to all (except for those who are very fast at calculating which 'SOxyz' indicator would serve them best this time). Of course these rules for deciding on winnars should be made know to everyone beforehand.
See also:
This page was WMEd by SGBailey on 2004-12-18. The entire old contents of the page was appended to the discussion page. Original input from me, Geoff Kaniuk, Matti, barry, Christopher Gerlach, Jens Baaran, DrStraw, wms.