ΔΙΑΤΜΗΜΑΤΙΚΟ ΠΡΟΓΡΑΜΜΑ ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ
Download
1 / 45

Οξούζογλου Λεωνίδας Επιβλέπων Καθηγητής: Οικονομίδης Αναστάσιος Εξεταστής 1: Σατρατζέμη Μαρία - PowerPoint PPT Presentation


  • 146 Views
  • Uploaded on

ΔΙΑΤΜΗΜΑΤΙΚΟ ΠΡΟΓΡΑΜΜΑ ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ ΣΤΑ ΠΛΗΡΟΦΟΡΙΑΚΑ ΣΥΣΤΗΜΑΤΑ. STUDENTS’ ATTITUDES TOWARDS ALTERNATIVE MULTIPLE CHOICE QUESTIONS. Οξούζογλου Λεωνίδας Επιβλέπων Καθηγητής: Οικονομίδης Αναστάσιος Εξεταστής 1: Σατρατζέμη Μαρία Εξεταστής 2: Ξυνόγαλος Στυλιανός.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Οξούζογλου Λεωνίδας Επιβλέπων Καθηγητής: Οικονομίδης Αναστάσιος Εξεταστής 1: Σατρατζέμη Μαρία' - zazu


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

ΔΙΑΤΜΗΜΑΤΙΚΟ ΠΡΟΓΡΑΜΜΑ ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ΣΤΑ ΠΛΗΡΟΦΟΡΙΑΚΑ ΣΥΣΤΗΜΑΤΑ

STUDENTS’ ATTITUDES TOWARDS

ALTERNATIVE MULTIPLE CHOICE QUESTIONS

Οξούζογλου Λεωνίδας

Επιβλέπων Καθηγητής: Οικονομίδης Αναστάσιος

Εξεταστής 1: Σατρατζέμη Μαρία

Εξεταστής 2: Ξυνόγαλος Στυλιανός


Multiple choice questions
Multiple Choice Questions ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • objective

  • easy to score

  • cost-effective (especially in large scale assessment)

  • sampling of content can be broader

  • items can be stored in item-banks and reused

  • the use of large number of items is possible

  • individual test items can be subjected to statistical analysis


Multiple choice questions1
Multiple Choice Questions ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • more difficult to construct

  • when used for assessing higher levels, the reliability is questioned

  • the examinee might be exposed to acquiring false knowledge

  • the score might be affected by the use of guessing

  • lack of assessment of partial knowledge


Methods of testing using mcqs
Methods of testing using MCQs ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Developed to address the problem of guessing

and to assess partial knowledge


Number of right scoring
Number of Right Scoring ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

the scoring of a test just by counting the number of correct answers

if a wrong option is chosen, the score of the item is 0


Negative marking
Negative Marking ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Scoring Rule

where k, the number of choices in an item


Answer until correct
Answer Until Correct ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • the examinee, in case of an incorrect choice, is permitted to choose one of the remaining options.

  • this procedure is repeated until the correct option is selected.


Answer until correct1
Answer Until Correct ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

S(k,a) = k – a

Scoring Rule

where k is the number of choices in an item and a is the number of attempts


Elimination testing
Elimination Testing ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

(Coombs et al., 1956)

the student has to indicate the wrong options of an item


Elimination testing1
Elimination Testing ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Scoring Rule

for MCQs with 4 options


Subset selection testing
Subset Selection Testing ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

the examinee is permitted to choose more than one options


Subset selection testing1
Subset Selection Testing ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

General Scoring Rule:

the larger the number of options selected the lesser the score credited to the item


Subset selection testing2
Subset Selection Testing ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Liberal Tests (Bush ,2001)

where k is the number of options in a MCQ

and a is the number of options selected by the examinee


Studies on students preference in methods of assessment
Studies on Students Preference in Methods of Assessment ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Zeidner (1990)

  • the majority of students believe that essay type exams are:

  • more reflective of students' true achievements,

  • more suitable for assessing course objectives,

  • generally fairer

  • than MCQs

  • students find MCQ type exams :

  • easier and less time consuming to prepare for

  • feel less time-pressure when taking the exams


Studies on students preference in methods of assessment1
Studies on Students Preference in Methods of Assessment ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Birenbaum & Feldman (1998)

  • students with good learning skills who have high confidence in their academic ability, tend to prefer the constructed-response type of assessment over the MCQ type

  • students with high test-anxiety tend to prefer the MCQ testing format


Studies on students preference in methods of assessment2
Studies on Students Preference in Methods of Assessment ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Birenbaum (1997); Furnham et al. (2008);

Gijbels & Dochy (2006)

students’ approaches to learning have a significant effect on assessment preference


Purpose of the study
Purpose of the Study ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • what are the students’ preferences and opinions regarding assessment using MCQs ?

  • how do factors like gender, grade of education, school performance and course preference affect students’ preference in a certain method ?

  • what is the relation, if any, of student’s preference in an assessment method and his/her approach to learning ?


Method
Method ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Participants:

  • 178 students from the area of Thessaloniki

  • 96 students of secondary education

  • 82 university students


Method1
Method ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Participants:

  • 178 students from the area of Thessaloniki

  • 100 females

  • 78 males


Method2
Method ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Questionnaires :

  • Revised two-factor learning process questionnaire (R-LPQ-2F, Kember et al., 2004)

  • Revised two-factor study process questionnaire (R-SPQ-2F, Biggs et al., 2001)


Method3
Method ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Questionnaires :

  • Preferred Assessment Method

  • Methods of Assessment

  • Essay type questions.

  • Number of Right (NR).

  • Negative Marking (NM)

  • Answer Until Correct (AUC).

  • Elimination Testing (ET)

  • Subset Selection Testing (SST)


Method4
Method ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Questionnaires :

  • Preferred Assessment Method

  • Indicate how fair you think is this method.

  • Indicate how accurate you think is this method in measuring each person’s level of knowledge.

  • Indicate how stressful for the student you think this method is.

  • Indicate the level of your personal preference in this method.

    (9-point Likert – type scale)


Method5
Method ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Procedure:

  • The students were given the questionnaires in class, under test conditions and given adequate time to think and respond.

  • The assessment methods had been thoroughly explained to them in a previous meeting.

  • A written explanation of the methods was given to them along with the questionnaires.


Results
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Correlations between perceived fairness and level of preference were positive and significant at the 0.01 level

  • Correlations between perceived accuracy and level of preference were also positive and significant at the 0.01 level

  • Correlations between perceived student anxiety and level of preference were negative and not all of them significant

  • Correlations between perceived fairness and perceived accuracy were computed and found to be positive and significant at the 0.01 level


Results1
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ


Results2
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Correlations between Level of Preference in different methods


Results3
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Level of Preference categorized by grade of education

* the difference of mean values is significant at the 0.05 level


Results4
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Correlations between Level of Preference in each method and learning approach scale scores


Results5
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

significant interactions between:

Learning Approach and Gender factors in Level of Preference in Essay Type (significant at the 0.01 level) and SST (significant at the 0.05 level).


Results6
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

Level of Preference in Essay Type


Results7
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

Level of Preference in SST


Results8
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

significant interactions between:

Learning Approach and Grade factors in Level of Preference in SST (significant at the 0.05 level).


Results9
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

Level of Preference in SST


Results10
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

significant interactions between:

Learning Approach, Gender and Grade factors in Level of Preference in NR (significant at the 0.05 level).


Results11
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

ANOVA analysis

Level of Preference in NR


Results12
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Correlations between Level of Preference in each method and school performance


Results13
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Level of Preference categorized by Preference in Mathematics

Level of Preference categorized by Preference in Science


Results14
Results ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Level of Preference categorized by Preference in Language


Conclusion
Conclusion ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Fairness and accuracy seem to be significant variables in shaping students’ level of preference. Less significant role seems to play the anxiety that a method brings to a student.

  • MCQs with NR scoring scheme is the students’ most preferred method

  • The least preferred method of assessment is MCQs with a NM scoring scheme


Conclusion1
Conclusion ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • Students who have a higher level of preference in one of the alternative methods (AUC, ET and SST) tend to have high level of preference in the remaining two.

  • Students that prefer Essay Type questions have a lower level of preference in alternative methods.


Conclusion2
Conclusion ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • the deeper the approach a student adopts the more he/she prefers conventional method of assessment as Essay Type and NR MCQs


Conclusion3
Conclusion ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • factors like Gender, Grade of Education or Learning Approach have an impact on students’ preference in assessment method

  • students with a high school performance tend to favor Essay Type Questions while those with a lower performance tend to favor the SST method

  • preference in certain courses (Mathematics, Science and Language) is related with a preference in some methods of assessment


Conclusion4
Conclusion ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

Future research

the study of students’ attitudes before and after testing using each method


Conclusion5
Conclusion ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ

  • The Goal

  • PROVIDING EDUCATORS WITH METHODS OF ASSESSMENT USING MCQs, that:

  • Reduce the effect of guessing

  • Assess partial knowledge

  • Have the acceptance of students


ΕΥΧΑΡΙΣΤΩ ΜΕΤΑΠΤΥΧΙΑΚΩΝ ΣΠΟΥΔΩΝ


ad