Compilation of results from project evaluations

The evaluation levels presented in the chapter on Project evaluation contain generic assessment dimensions which area relevant for many e-learning projects. Compiling data collected based on these dimensions at a project level is useful for program evaluation. The following table aims to clarify this:

Projects a and b are examples representing a number of projects that have employed a certain tool (I.) in order to collect data on a certain assessment dimension (e.g. student satisfaction with the learning system). The results produced for an assessment dimension at the project level (O.) can be compiled on a cross-project basis, for example, in order to draw conclusions on the extent to which the students are satisfied overall with the learning systems created within the program.

- If the data collection tools used for the project evaluations were identical (e.g. the same satisfaction questionnaire in all of the projects), and if reasonable, a single mean value can be calculated from the mean values that have been created for each project.

- If different data collection tools have been used in different projects for the same question, or if it does not seem to be reasonable to create a mean value from all projects, the results can be compiled in terms of content or compared between the individual projects.

- The more similar the individual projects and the tools employed at the data collection stage of project evaluations are, the more successful the compilation of results will be. (At the lower evaluation levels, the latter can be achieved more easily than at the higher levels: Finding a usability questionnaire to be used in each project is easier than a transfer analysis tool that is applicable in all of the projects!)