|
 |
||||||||
Planning the implementation
Worksheet
Download the worksheet for evaluation planning (doc, 56 kB) and record your planning. This will form a good basis for your evaluation report.
When the question has been clarified, you can begin planning how the evaluation will be implemented. For this purpose, you should note items f-j (cf. also evaluationsnetz, 2005).
f) Select the methods and instruments for data collection!
1. Which methods are appropriate for answering the evaluation question(s)?
2. Are there instruments already available for the data collection? If so: which ones?
Information about different methods of evaluation can be found in the general part of this handbook (see Evaluation methods page).
The evaluation instruments this handbook offers can be found in Chapter 2. Instrument selection.
g) Define your sample and the study design!
sample
“A sample is a subset of a (=>) population, often taken for the purpose of statistical inference” (From: Connexions, Populations and samples).
1. Who should be surveyed / interviewed / observed (e.g. students, lecturers, ...)?
2. Should all participants be surveyed or only a proportion?
3. Should there be a repeated measurement (before and after survey or repeated data collection) or is a one-off survey enough?
Information about sample and evaluation design can be found in Chapter 3. Data collection.
h) Consider how to analyse the data obtained!
1. Is an analysis by descriptive statistics (means, distributions, etc.) possible and suitable?
descriptive statistics
“A term used to denote statistical data of a descriptive kind or the methods of handling such data, as contrasted with theoretical statistics which, though dealing with practical data, usually involve some process of inference in probability for their interpretation” (Glossary of Statistical Terms, Descriptive Statistics) (=>Statistical analysis methods)
2. Should coding schemes (e.g. category systems) be developed?
3. Which tools (e.g. Excel, SPSS) are required for data analysis?
Information about this issue can be found in Chapter 4. Data analysis.
i) Based on the planning steps f-h, draw up a resource plan and timetable! Your timetable should, in particular,take the progress of the project or program into account since feedback obtained from evaluation only helps to optimise a project or program if it is obtained at the right time!
1. Which resources (people, finance) will the evaluation provisionally need?
2. When should each step of the evaluation be carried out (preparation / development of the data collection instruments, data collection, data analysis, reporting of the results)?
3. How can the evaluation process be linked to the project process in an optimum way?
project process
The project process structures the different phases of a => project, from project planning through development and the pilot phase to implementation.
Information about which resources each method
requires can be found in the general part of this handbook (see Page Evaluation methods).
j) Plan the evaluation report and other feedback mechanisms (if possible during the course of the project or program)!
1. When do which stakeholders need which information?
stakeholders
A group of people that are or should be involved in, or that are affected by the => evaluation.
2. Who receives the evaluation report and how should it be structured?
Information about this issue can be found in Chapter 5. Reporting results.
