Report on the Concurrent Validity and Inter-rater Reliability Studies of Uwezo
Results for Development Institute (R4D) led an evaluation of four citizen-led assessments supported by the William and Flora Hewlett Foundation in 2013 and 2014. As part of the evaluation, the Australian Council for Education Research (ACER) designed two small quasi‐experimental studies to investigate the concurrent validity and inter‐rater reliability of Uwezo, one of the citizen-led assessments.
The concurrent validity study explored the relationship between performance on Uwezo and performance on EGRA/EGMA (ie instruments that themselves have confirmed validity and reliability). The inter‐rater reliability explored the agreement in the scores assigned by Uwezo volunteers and by an expert rater to children’s responses to the Uwezo tasks.
Both of these studies were conducted in Kenya with the support of Qdata Enterprises (the local implementation partner), the Uwezo regional office, Uwezo district coordinators and volunteers, RTI‐Kenya personnel and individuals who had been involved in previous RTI‐led implementations of EGRA/EGMA.