Publications and Presentations

Publications

  • Applying automated originality scoring to the verbal form of Torrance Tests of Creative Thinking (2021)
    • Abstract: In this study, we applied different text-mining methods to the originality scoring of the Unusual Uses Test (UUT) and Just Suppose Test (JST) from the Torrance Tests of Creative Thinking (TTCT)–Verbal. Responses from 102 and 123 participants who completed Form A and Form B, respectively, were scored using three different text-mining methods. The validity of these scoring methods was tested against TTCT’s manual-based scoring and a subjective snapshot scoring method. Results indicated that text-mining systems are applicable to both UUT and JST items across both forms and students’ performance on those items can predict total originality and creativity scores across all six tasks in the TTCT-Verbal. Comparatively, the text-mining methods worked better for UUT than JST. Of the three text-mining models we tested, the Global Vectors for Word Representation (GLoVe) model produced the most reliable and valid scores. These findings indicate that creativity assessment can be done quickly and at a lower cost using text-mining approaches.

    • View Article PDF

    • Citation: Acar, S., Berthiaume, K., Grajzel, K., Dumas, D., Flemister, C. T., & Organisciak, P. (2021). Applying automated originality scoring to the verbal form of Torrance Tests of Creative Thinking. Gifted Child Quarterly. Advance online publication. https://doi.org/10.1177/00169862211061874
  • Measuring flexibility: A text-mining approach. Creativity Research Journal (Under Revision)
    • Abstract: In creativity research, ideation flexibility, the ability to generate ideas by utilizing differing semantic categories, has long been the focus of investigation. Psychometric work to develop measurement procedures for flexibility has generally lagged behind fluency and originality. Here, we build from extant research on the measurement of originality using text-mining models to theoretically posit and then empirically validate a text-mining based method for measuring flexibility in verbal divergent thinking (DT) responses. The empirical validation of this method is accomplished in two studies. In the first study, we used the verbal form of the Torrance Test of Creative Thinking (TTCT) to demonstrate that our novel flexibility scoring method strongly and positively correlates with traditionally used TTCT flexibility scores. In the second study, we show that our text-mining based flexibility scoring method can achieve a high level of reliability and internal validity with Alternate Uses Task. In addition, flexibility scores correlated with theoretically relevant outside attributes including artistic expertise and Big 5 personality facets in the second study indicating criterion validity. To assist researchers in applying this flexibility scoring method and provide specific details about how to undertake an analysis of flexibility using text-mining models.

    • Citation: Grajzel, K., Dumas, D., Berthiaume, K., Acar, S., & Organisciak, P. (2021). Measuring flexibility: A text-mining approach. Creativity Research Journal (Under Review).
  • Measuring up: Aligning creativity assessment with the Standards. In M. Runco & S. Acar (Eds.), Handbook of Creativity Assessment. (In Press)
    • Citation: Dumas, D., & Grajzel, K.* (in press). Measuring up: Aligning creativity assessment with the Standards. In M. Runco & S. Acar (Eds.), Handbook of Creativity Assessment. Cheltenham, UK: Edward Elgar Publishing.

 

Presentations

  • Berthiaume, K. (Chair) (2022). Innovations in methodological approaches in creativity assessments for gifted education. Symposium accepted for presentation at American Educational Research Association Annual Meeting, San Diego, CA.
    • Dumas, D., & Dong, Y. (April, 2022). Observing students’ zone of proximal creativity using a dynamic assessment procedure. In K. Berthiaume (Chair), Innovations in Methodological Approaches in Creativity Assessments for Gifted Education. Symposium to be presented at the annual meeting of the American Educational Research Association, San Diego, CA.
    • Grajzel, K., Dumas, D., Berthiaume, K., Acar, S., & Organisciak, P. (April, 2022) Measuring flexibility: A text-mining approach. In K. Berthiaume (Chair), Innovations in Methodological Approaches in Creativity Assessments for Gifted Education. Symposium to be presented at the annual meeting of the American Educational Research Association, San Diego, CA.
  • Grajzel, K., Dumas, D., & Berthiaume, K. (2022). Time spent on task positively predicts creative quality of responses for elementary students. Roundtable talk accepted for presentation at American Educational Research Association Annual Meeting, San Diego, CA.
  • Acar, S., Berthiaume, K., Grajzel, K., & Flemister, T. (2021). Automated scoring of Torrance Tests of Creative Thinking (TTCT) verbal form for originality. Combined session at National Association for Gifted Children Annual Conference.