Scoring divergent thinking tests poses inherent challenges, demanding both time and resources. Within our commitment to advancing creativity research, supporting practitioners, and aiding educators, we present Open Creativity Scoring with Artificial Intelligence (Ocsai) platform — a project designed to disseminate the scientific foundations of our endeavors. For those employing the Alternate Uses Test, the Ocsai platform provides swift and accurate scoring of responses. Please refer to our website! for details on additional divergent thinking tests slated for integration into our scoring services.
This platform was created by Dr. Peter Organisciak aiming to make accessible work performed with Dr. Denis Dumas and Dr. Selcuk Acar.
The MOTES Corpus serves as a specialized corpus tailored for scoring open-ended divergent thinking tests, specifically designed for children. While many educational assessments adopt a closed-ended format for ease of consistent scoring and cost-effectiveness, computational measurement of open-ended responses has predominantly relied on language models trained on general English sources or domain-specific materials like textbooks. Notably, child-oriented language displays distinct vocabulary and word sense usage compared to general English, presenting lower gender and race biases. Incorporating a more representative understanding of children's language into automated educational assessments fosters fair and equitable testing practices. Furthermore, employing child-specific language models contributes to minimizing gender and race biases in assessments. For detailed insights, please refer to the referenced work.
Please see this work for details:
Organisciak, P., Newman, M., Eby, D., Acar, S. and Dumas, D. (2023), "How do the kids speak? Improving educational use of text mining with child-directed language models", Information and Learning Sciences, Vol. 124 No. 1/2, pp. 25-47. https://doi.org/10.1108/ILS-06-2022-0082
Unlock the Power of Creativity with MOTES!
In the dynamic landscape of education and the workforce, creativity is a prized asset. However, accurately assessing and nurturing creativity has been a formidable challenge—until now. Say goodbye to the limitations of traditional creativity assessments with the Measure of Original Thinking for Elementary School (MOTES), a groundbreaking solution meticulously crafted to revolutionize the way we measure and cultivate creativity.
Key Features:
- Comprehensive Development: MOTES underwent a rigorous five-phase development process, including the creation of an extensive item pool, expert validation, cognitive pilots, and validation of automated scoring and latent test structure.
- Game-Like Activities: Immerse students in three engaging computerized activities—Uses, Examples, and Sentences—each featuring eight items, totaling an exciting 24-item experience.
- Cutting-Edge Scoring: MOTES leverages advanced language modeling techniques, offering an innovative scoring approach. Our open-access artificial intelligence (AI) platform delivers scores for originality, exhibiting remarkable agreement with independent human ratings across all three subscales.
- Proven Reliability: Confirmatory factor analyses demonstrate a solid fit, revealing three distinct factors corresponding to each game, unified under a higher-order originality factor. Internal consistency reliability is robust for both subscales and the overarching originality factor.
- Real-World Impact: MOTES scores showcase meaningful correlations with external creative performance indicators and academic achievement, making it a valuable tool for holistic assessment.
Don't let creativity assessment be a barrier—empower your educational journey with MOTES and unleash the full potential of original thinking!
For more information on MOTES, see our recent publication.