Language Testing: TESTING ORAL ABILITY

1. Language Testing:TESTING ORAL ABILITY Presented by Eroika Jeniffer

2. The basic problem in testing oral • We want to set tasks that form a representative of the population of oral tasks that we expect candidates to be able to perform. • The tasks should elicit behavior which truly represents the candidates’ ability. • The samples of behavior can and will be scored validity and reliably

3. Representative tasks • We will begin by looking at the specified content of the Cambridge CCSE Test of Oral Interaction 1.Operations - Expressing - Directing - Describing - Eliciting - Narration - Reporting

4. 2. Types of text Discussion 3. Addressees ‘Interlocutor’ (teacher from candidate’s school) and one fellow candidate 4. Topics Unspecified 5. Dialect, Accent and Style Also unspecified It can be seen that the content specifications are similar to those for the Test of Writing

5. The categorisation of the operation based on Bygate (1987) • Skills Informational skills Interactional skills Skills in managing interactions

6. Type of text Presentation (monologue) Discussion Conversation Service encounter Interview

7. Other speakers (addressees) Maybe equal or higher status Maybe known or unknown • Topics Topics which are familiar and interesting to the candidates

8. Dialect Standard British English or Standard American English • Accent RP Standard American • Style Formal or informal • Vocabulary range Non-technical except as the result of preparation for a presentation • Rate of speech will vary according to task

9. It can be seen that this second set of content specifications is rather fuller than the first (Cambridge CCSE). In author’s point of view, the greater the detail in the specification of content, the more valid the test is likely to be.

10. Elicit a valid sample of oral ability Choose appropriate techniques Three general formats are presented here: interview; interaction with fellow candidates; responses to audio-or video-recorded stimuli.

11. Format 1 – interview useful techniques are: • Questions and requests for information Yes/No questions should generally be avoided • Requests of elaboration “What is exactly do you mean?” 3. Appearing not to understand in order to see if the candidates can cope with being misunderstood

12. Invitation to ask questions “Is there anything you’d like to ask me?” • Interruption to see how the candidate deals with this • Abrupt change the topic to see how the candidate deals with this • Pictures single picture are particularly useful for eliciting description

13. Role play this allows the ready elicatation of other language functions • Interpreting you can see the example how to conduct this on page 120 10.Prepared monologue 11.Reading aloud

14. Format 2 – Interaction with fellow candidates Possible techniques: 1.Discussion Tasks may require the candidates to go beyond discussion and, for example, take a decision 2.Role play Role play can be carried out by two candidates with the testers as an observer

15. Format 3 – Responses to audio-or video-recording • Described situations • Remarks in isolation to respond to • Simulate conversation

16. Plan and structure the testing carefully • Make the oral test as long as is feasible • Plan the test carefully • Give the candidate as many ‘fresh starts’ as possible • Use the second tester for interviews • Set only tasks and topics that would be expected to cause candidates no difficulty in their own language

17. Carry out the interview in quiet room with good acoustics • Put candidates at their ease so that they can show what they are capable of • Collect enough relevant information • Do not talk too much • Select interviewers carefully and train them

18. Ensure valid and reliable scoring Create appropriate scales of scoring These will have been applied to candidates performing the tasks: ACCURACY Pronunciation must be clearly intelligible even if some influences from L1 remain SIZE Must be capable of making lengthy and complex contribution where appropriate

19. APPROPRIACY The use of language must e generally appropriate to function and to context RANGE A wide range of language must be avaiable to the candidate FLEXIBILITY There must be consistent evidence of the ability to ‘turn-take’ in a conversation and to adapt to new topics or changes of direction

20. Calibrate the scale to be used Generally the same procedures are followed in calibrating speaking scales as were described for writing scales Train scorers (as opposed to interviewers) The training of interviewers has already been outlined. Where raters are involved in the rating of responses to audio-or video-recorded stimuli

21. Follow acceptable scoring procedures Great care must be taken to ignore personal qualities of the candidates that irrelevant to an assessment of their language ability

22. Conclusion The accurate measurement of oral ability is not easy. It takes considerable time and effort, including traning, to obtain valid and reliable results. Nevertheless, where a test is high stakes, or backwash is an important consideration, the investment of such time and effort may be considered necessary.

23. We are reminded that the appropiateness of content, of rating scale levels, and of elicitation techniques used in oral testing will depend upon the needs of individual institutions or orgaisations.

24. Thank You!!!