|
 |
||||||||
Product level
At this level, the focus is on the characteristics of what the product of the project is or is to become. For example, a product can be learning software or an educational course. Product characteristics can be evaluated in the process of product development (formative evaluation) .
(formative evaluation)
“A type of process evaluation of new programs or services that focuses on collecting data on program operations so that needed changes or modifications can be made to the program in the early stages. This type of (=>) evaluation is carried out while a (=>) project or (=>) program is implemented in order to provide timely, continuous feedback as work progresses”. (From: Nonprofit Good Practice Guide, Formative Evaluation)
The evaluation can be based on the finished product, as well (summative evaluation) .
(summative evaluation)
Summative evaluation allows the [subsequent] control of quality, effects and usefulness of an educational course. The question of interest is whether an educational course or individual components of the course can meet certain expectations in practice (translated from Tergan, 2000).
The following questions might be asked at this level:
How user-friendly is the product or technology?
One important variable of learning software is its user-friendliness (usability). This defines how easily, for example, learning software can be used. The heart of usability is defined by the criteria of effectiveness, efficiency and the user satisfaction levels.
Which characteristics does the product cover and to what extent?
Criteria catalogues or checklists offer a systematic collection of different questions and rating scales for individual product characteristics. Criteria catalogues are a popular means of involving expert opinions in the evaluation of learning software. Large numbers of criteria catalogues have been developed on the basis of different goals.
You can find a collection of product variables (mind map) here, this can help provide ideas onformulating your evaluation question (although not all the characteristics are covered by instruments in the handbook!): mindmap (jpg, 600 kB).
