I'm looking for papers quantifying the validity of ontologies such as GO.
I'm relatively new to using annotation terms, and I often hear things like "annotation is messy" and "GO is good but it's not perfect." So I'd like to find papers that give numbers for just how messy.
I'm looking for answers from any experts that have a sense of the "quality" of GO terms (however you want to quantify it). For example, what fraction of terms are just wrong? The more computational parts of me want to sum up GO (or other ontologies) with a few descriptive validation statistics. e.g. "GO terms have an 80% precision and an R^2 of 0.6."
I'd like to see a few more examples similar to this paper that shows that a good fraction of GO ontology can be rebuilt from the ground up from independent data. That seems like one way to validate GO quality. They include this line about lack of GO validation in general literature: "... problems [with consistency and bias] are difficult to assess due to the lack of any definitive gold standard for the rigorous validation of GO."