Universidade Federal do Ceará
Mestrado e Doutorado em Ciências da Computação

Título:

Computerized Adaptive Testing as a Tool for Assessment and Preparation for Enade

Data:13/03/2025
Horário: 14h
Local: Remoto – https://meet.google.com/onw-djvf-adj

Resumo:

Higher education in computing in Brazil plays a crucial role in training professionals capable of meeting the demands of the job market and society. Law No. 10,861/2004 created the National System for the Evaluation of Higher Education (SINAES), aiming to assess Higher Education Institutions (HEIs), undergraduate programs, and student performance. Among the evaluation instruments, the National Examination of Student Performance (ENADE) stands out, periodically evaluating students in information and communication technology (ICT) courses. However, the 2021 results indicate a misalignment between the content covered in the exam and the teaching provided at HEIs, with 43% of students pointing out this discrepancy. Additionally, students reported challenges like lack of motivation (19.8%) and unfamiliarity with the content (20.2%). This reflects significant gaps in student preparation, as while a small portion of students (5.65%) prepared adequately, 22.65% stated that they were unable to learn all the required content for the exam. Despite the efforts of HEIs to improve educational quality, the analysis of ENADE results reveals that students still face substantial difficulties. This scenario highlights the urgent need to improve evaluation methods, potentially leading to the incorporation of adaptive technologies that cater to the individual characteristics of students during their preparation for the exam. The adaptation of the evaluation system could ensure more personalized preparation, considering students’ difficulties and areas of greater interest. In this context, the proposal for an adaptive question system aims to provide more efficient and personalized preparation for ENADE. The adaptation model allows students to be challenged with questions that match their skill level, focusing on areas that require more attention. Additionally, the data generated by the system will enable teachers to identify gaps in learning and adjust their teaching strategies. The adoption of this technology could not only improve students’ academic performance but also contribute to the competitiveness of HEIs, as ENADE performance directly impacts the institutions’ reputation. This thesis proposal aims to analyze the impact of cat on the perception, motivation, and engagement of Computer Education students during their preparation for the enade.The adopted model uses the Elo rating system to dynamically adjust the difficulty of questions based on students’ responses, promoting personalized learning. A question repetition mechanism and spaced repetition have also been added to make sure that questions are reviewed, which helps students learn without relying on shallow memorization. The Elo rating model was chosen for its simplicity and effectiveness in evaluating student performance, and the next steps involve integrating this model into the Questione system, conducting a proof of concept, and evaluating the impact on student engagement.

Banca examinadora:

• Prof. Dr. Windson Viana de Carvalho (MDCC/UFC) – Orientador
• Prof. Dr. Rafael Augusto Ferreira do Carmo (UFC) – Coorientador
• Prof. Dr. Yuri Almeida Lacerda (IFCE)
• Prof. Dr. César Lincoln Cavalcante Mattos (MDCC/UFC)
• Profa. Dra. Ellen Francine Barbosa (USP)