"Research evaluation of German Studies" project at Johannes Gutenberg University in Mainz

As part of the discussion about quality standards in science, the ZQ is conducting a project about the relevance of evaluation criteria, which is being tested in the German Studies department. The initiative is based upon a system-theoretical model for measuring research performance (see Schmidt/Dreyer 2007). The assumption behind this model is that research performance varies in the process of the scientific biography and can refer to different spheres of action. For example, whereas research output and the raising of external funds generally play a major role in the qualification phase, this may no longer be the case in the later phases of an individual's academic career, when other aspects become increasingly important. These other aspects include, for example, involvement within the academic community in the form of appraisals and committee memberships, or the aspect of academic management. The other premise behind this model is that the four dimensions identified are reflected equally, and are based upon a concept of quality that takes into account the balance between these levels of action. The pilot testing includes subject-specific concretization and the application of this approach within the field of German Studies. Involving the people to be evaluated plays a particular role, as they discuss and define the design of the criteria in the context of the model.

Methodically, this is done by using the Delphi Design: At the end of 2010, discussions were held with the participating professors in which the model was presented and subject-specific issues were discussed; in spring 2011, a revised research model was again communicated to the teaching staff and they were asked to provide feedback. The suggestions were again integrated into the model whilst maintaining its framework. In spring 2011, an example evaluation of the research performance of each member of the teaching staff should be carried out using the determined indicators and weightings, and positioned in relation to all of the other individuals involved in the project.