Just an observation. If a ratings system is producing better results with the 1st, 3rd and 5th rater, wouldn't you not adjust the weightings behind the rules of variables to try and get the 3rd and 5th sitting as 2nd and 3rd respectively.

Or is it the 3rd and 5th have lower strike rates but better value?

Regards