There are several disadvantages of Rasch and other probabilistic models that outweigh those of the raw score classical test theory models. Examiners, parents and students can be mystified by the Rasch and probabilistic models as they may be less relevant in formative or training contexts. For these reasons, a raw score model of rater severity and rater fit was constructed and was applied to a data set of 8708 English Language proficiency candidates. This model is more intuitive and thus easier to explain to the stakeholders, including examiners, as a preliminary quality control tool.