In the absence of any commonly accepted methodology for measuring and reporting results, every agency and project must make its own decisions and measure results in its own way.
How can we tell whether the results that are produced are impartial and objective?
Do we need an independent accrediation body to certify that the methods used by individual projects are reasonable and reliable?
How might such a certification system work?
Tuesday, 2 October 2007
Attribution
How can we demonstrate that measured impacts resulted from one specific intervention rather than anything else?
In multi-donor projects, how do we decide what proportion of the impacts were due to the contribution of our particular agency?
If it wouldn't have happened with out us, does that mean we can claim responsibility for 100% of the impacts?
Or if we contibuted 40% of the project funds, should we claim only 40% of the project impacts?
In multi-donor projects, how do we decide what proportion of the impacts were due to the contribution of our particular agency?
If it wouldn't have happened with out us, does that mean we can claim responsibility for 100% of the impacts?
Or if we contibuted 40% of the project funds, should we claim only 40% of the project impacts?
Displacement
Did anyone suffer as a result of our intervention?
Did those who benefited do so at the cost of others?
How can we measure this?
Did those who benefited do so at the cost of others?
How can we measure this?
Deadweight
Would the observed impacts have happened anyway?
How can we take into consideration the continuation of external prior trends?
What data do we need to collect and where can we get it from?
How can we take into consideration the continuation of external prior trends?
What data do we need to collect and where can we get it from?
Sustainability
How can we incorporate project sustainability into results measurement?
Measurment at the end of a project may find better impacts generated by an intervention that use subsidies liberally, but these impact will probably decline rapidly once the external financing come to an end.
Measurment at the end of a project may find better impacts generated by an intervention that use subsidies liberally, but these impact will probably decline rapidly once the external financing come to an end.
Key Indicators
The choice of what to measure is crucial, as it implicity defines the priorities of an intervention.
Should we be working towards defining one or two key inidicators to be measured in all projects across the board?
If so, what should they be?
Should we be working towards defining one or two key inidicators to be measured in all projects across the board?
If so, what should they be?
Monday, 1 October 2007
Measuring Results; who are we doing it for?
Should pressure from HQ to measure performance be interpreted as a way for senior managers to control and steer field-based staff?
Or should results measurement be seen as an invaluable tool for staff motivation and project management, regardless of external pressure to report findings?
Or should results measurement be seen as an invaluable tool for staff motivation and project management, regardless of external pressure to report findings?
Quantitative versus Qualitative
Many practitioners favour a qualitative approach, often exploring in detail a number of particular case studies and identifying both positive and negative outcomes.
How useful is such an approach to results measurement?
Will such case studies always be needed to complement more quantitative measurements?
How useful is such an approach to results measurement?
Will such case studies always be needed to complement more quantitative measurements?
Subscribe to:
Comments (Atom)
