|
 |
||||||||
Planning the implementation
Worksheet
Download the worksheet for evaluation planning (doc, 43 kB) and record your planning. This will constitute a basis for the evaluation report.
When the question has been specified, you can begin planning how the evaluation will be implemented. For this purpose, you should follow items f-j (cf. evaluationsnetz, 2005).
f) Select methods and tools for the data collection!
1. Which methods are suitable for answering the evaluation question(s)?
2. Are there tools available for the data collection? If so: what are they?
Information about different methods of evaluation can be found in the general part of this handbook (see page on Evaluation methods).
Evaluation tools provided in this handbook can be found in Chapter 2. Instrument selection.
g) Define your sample and the study design!
sample
“A sample is a subset of a (=>) population, often taken for the purpose of statistical inference” (From: Connexions, Populations and samples).
1. Who should be surveyed / interviewed / observed (e.g. students, lecturers, ...)?
2. Should
all participants be surveyed or only a proportion?
3. Should there be repeated measurements (before and after surveys or repeated data collection) or is a one-off survey enough?
Information about sample and evaluation design can be found in Chapter 3. Data collection.
h) Consider how you want to analyse the data obtained!
1. Is an analysis by descriptive statistics (means, distributions, etc.) conceivable and suitable?
descriptive statistics
“A term used to denote statistical data of a descriptive kind or the methods of handling such data, as contrasted with theoretical statistics which, though dealing with practical data, usually involve some process of inference in probability for their interpretation” (Glossary of Statistical Terms, Descriptive Statistics) (=>Statistical analysis methods)
2. Should coding schemes (e.g. category systems) be developed?
3. Which tools (e.g. Excel, SPSS) are required for data analysis?
Information about this issue can be found in Chapter 4. Data analysis.
i) Based on planning steps f-h, you should estimate which resources the evaluation will need and develop a timetable! Your timetable should especially take the course of the project into account as feedback obtained from evaluation only helps to optimise the project or program if it is received at the right time!
1. Which resources (people, finance ) will the evaluation provisionally need?
2. When should each step of the evaluation be carried out (preparation / development of the data collection tools, data collection, data analysis, reporting of the results)?
Information about which resources each method
requires can be found in the general part of this handbook (see page on Evaluation methods).
j) Plan the evaluation report and other feedback mechanisms (if necessary, during the course of the project or program)!
1. When do which stakeholders need which information?
stakeholders
A group of people that are or should be involved in, or that are affected by the => evaluation.
2. Who is the evaluation report directed at and how should it be structured?
Information about this issue can be found in Chapter 5. Reporting results.
