Abstract

PRIMI, Ricardo; MIGUEL, Fabiano Koich; COUTO, Gleiber  and  MUNIZ, Monalisa. Inter rater reliability in the creativity assessment using metaphor production. PsicoUSF [online]. 2007, vol.12, n.2, pp. 197-210. ISSN 1413-8271.

The measure of creativity is a difficult task in psychology and consequently there is a shortage of good quality instruments. Metaphors, like "The camel is the boat of the desert", are means of expressing different characteristics of a concept (camel) through association of ideas. The creation of such metaphors assumes the accomplishment of basic cognitive processes, like analogical reasoning and remote associations, which are linked to the creativity cognitive processess. The goal of this research was to study the reliability of scoring system for a creativity test based on metaphors creation, making use of items like "The camel is the ______ of the desert". The participants were 19 people and nine raters. The metaphor test is made of nine items, to which the participants gave 513 answers. Each answer was independently measured by the raters using a scale from 0 to 3, indicating the metaphor's elaboration. Reliability was calculated by a Rasch model assuming every idea as a case and each judge as an item of a hypothetical test in procedure called judge-linking network. The inter-rater reliability varied from .52 to .83 with a mean of .74 (SD=.08) resulting in a acceptable inter-rater reliability.

Keywords : Creativity test; Rasch model; Item response theory.

        · abstract in Portuguese     · text in Portuguese     · Portuguese ( pdf )