I don't get this critique/confusion at all, could you guys at least be bothered to read up on how the ratings actually work and what they are supposed to measure?
1. "He/I seems better/worse than his/my rating". Well, if you're talking about player's allround performance in all situations, that might be true - but rating only measures competition performance, doesn't it? It's not a measure of your total disc skills, or something... As a rating of competetition performance it seems to me we have a pretty good system in place. I know a lot of players that have a rating well below their capacity, but then they always perform worse in tornaments... Others behave the other way around, very few people perform as well in tournaments as in other situations.
2. You all have to realize that ratings will probably never FEEL correct, 'cause our feelings are geared towards pattern recognition and ratings are based on statistical averages. A classic example of this is how Apple had to "un-randomize" the random play function in Ipods: Real randomization led to people complaining about perceived patterns, like several songs from an artist in row... Now, we can all understand intellectually that this happens randomly, but our brains are geared to notice these patterns and they feel annoying.
Most of the suspicion of geographical or other unfairness in the system seems to stem from this type of psychological phenomenon, and most "confusion" I hear about as well (you might well be referring to something else, Dan, but I don't get wich stats you're referring to - if it's competition stats that's basically what we've got???).
And JR: "Isn't it also possible that SSA for any given round may be a little off by varying amounts and varying directions?" Of course there will be some deviations, but as long as it's not a regular and significant error so what? Do you have ANY indication (except anecdotal) that the ratings system fails because of this? If so, I'm sure Chuck would love to see it so that the system might be improved.
Disclaimer; I'm not a PDGA member yet (will join this year) but I have studied the ratings from the tournaments I played in pretty thorougly, as well as Chuck's previous explanations of the system here and elsewhere. A lot of the critique against the PDGA seems reasonable to me, but distrusting the ratings... not so much.