General instructions

The following issues should be considered for a program evaluation:

• A program evaluation always depends on project staff providing both information about their project and certain project data. Thus, a good trusting relationship is very important between program evaluators and project staff.

• Generating outputs for individual projects is not an aim of program evaluation. Therefore, data is usually processed anonymously. In this way, no inferences can be made about individual projects. Always inform project staff about which data will be used in which form and which data will be communicated!

• In an evaluation at output and effect level, ideally, data from project evaluations is  used, meaning the  actual data collection takes place at a project level - and therefore it is normally carried out by the members of the project team who, in turn, should be informed in good time (preferably at the beginning of their project!) when they are to provide which data and in which form for their project evaluation.

• Consider how you can support the project staff during their project evaluation. In this way, you will not only help the members of the project team but you can also more easily ensure that the data necessary for the program evaluation is provided in the necessary quality.

Furthermore, the following general issues are important:

• Are data collection tools already available? Using or adapting existing tools is usually easier and quicker than developing them from scratch. Please look at Chapter Instrument selection to find information relevant for you.

• Can you manage the instrument? Practice conducting interview with an interview schedule or using an observation scheme before the ”real” data collection.

• Collect only the data which is required to answer the question, which can be analysed and interpreted. Consider precisely what information is required so as not to put unnecessary strain on the participant.

• Set up a work schedule. Plan when the tool can be used and when the data collection can occur or when which data should be available from the projects. Define the corresponding responsibilities and check the deadlines.