Quality of language exams in evaluation of professional communicative competence

Presentation of the main material

The analysis of the structure of professional examinations in foreign language with professional orientation and the requirements for the level of English proficiency of medical students in accordance with CEFR showed the particularities of their structure and content to assess the level of English. The following exams were involved in the analysis: Cambridge Exams, KROK -1(ESP) qualified exam, TOLES, BEC, OET, APTIS. The results of the analysis of the purposes, structure, types and content of the tasks of these well- known and professional exams revealed the following characteristics.

KROK-1 (English for specific_purposes (ESP).

Objective: according to the Procedure for realization of the Unified State Qualifying Examination for higher education master's degree applicants in the specialties of the field of knowledge “22 Health Care” approved by the Resolution of the Cabinet of Ministers of Ukraine dated March 28, 2018 №334, “KROK-l (ESP)” is an exam in general scientific disciplines which is passed after studying the main fundamental disciplines. This exam is conducted and administered by the Testing Center of the Ministry of Health of Ukraine.

Structure: the duration of the test exam “KROK -1(ESP)” is two hours and a half, during this time students should answer 150 questions. The professional English exam lasts an hour. Those students who have not passed the Unified State Qualifying Examination are given one more attempt to pass it. “KROK-1(ESP)” exam is a standardized tool for diagnosing the level of professional competence of a specialist, which establishes the compliance of specialists training quality with the standards of higher education.

Purpose: a practical (clinical) exam is an exam that assesses the readiness of a graduate to carry out professional activities in accordance with the requirements of a higher education standard by demonstrating practical (clinical) components of professional competence on a real object (person) or on a model (phantom, moulage, simulators, etc.). An International exam in the basics of medicine is an international exam in fundamental and clinical disciplines used at the international level and is developed and organized by one of the foreign agencies for assessment the quality of applicants knowledge level of and established by the state organization “Center for Testing the Professional Competence of Specialists with Higher Education in «Medicine”, “Pharmacy” under the Ministry of Health of Ukraine» (The Resolution of the Cabinet of Ministers of Ukraine, 2018:2).

KROK-1 (ESP) is an important and extremely challenging exam that all medical students must take. It is the first in a series of three exams that comprise Ukraine Medical Licensing Examination, all of which students must pass in order to become a licensed physician in Ukraine.

KROK-1 (English for specific purposes (ESP)) part of Exam is made up to test only medical knowledge of candidates which covers these traditionally defined disciplines: anatomy, behavioral sciences, biochemistry, biostatistics and epidemiology, microbiology, pathology, pharmacology and physiology. It also touches upon these interdisciplinary areas: genetics, aging, immunology, nutrition and molecular and cell biology.

This Exam tests students on their understanding and application of the basic sciences to the practice of medicine, focusing especially on the principles of health, disease, and therapeutic interventions.

Also, KROK-l (ESP) English Part for specific purposes may implicitly test candidates reading skills in English. It is not made to test such English language skills as listening, writing and speaking.

Thus, we can say that KROK-l(ESP) Exam's purpose is not to test English, but to test medical knowledge and skills by means of the English language.

Certificate in Advanced English (CAE) is a certificate of high English proficiency, it is a British exam for obtaining a certificate of English language proficiency at C1 level according to ZEP scale.

Objective: The certificate serves as a proof that you can carry out comprehensive research and communicate effectively in English at professional level.

Purpose: to test and confirm knowledge of English at the advanced level with a comprehensive exam that includes four types of work.

Structure: the exam consists of four parts. It is not necessary to complete all four parts to receive a certificate. The duration of the exam is 4 hours. There are three grades: A, B, C. Having passed A grade exam, C2 level certificate is obtained, having passed B or C grade exam, C1 level certificate is obtained. If the score obtained is not enough for C grade, B2 level certificate can be obtained, if it is demonstrated an appropriate level on the exam. Task types:

Part I - "Reading and Use of English”. The duration is 1 hour 30 minutes. It checks the text perception skills, the level of grammar and lexical knowledge of applicant. It contains 8 subparagraphs. It checks the skills of text comprehension, the level of grammar and lexical knowledge of candidate. It contains 8 subparagraphs: subparagraphs from 1 to 4 contain texts including grammar and lexical tasks, subparagraphs from 5 to 8 contain a list of texts including tasks for their understanding. The total number of tasks is 56.

Part II - “Writing”. The duration is 1 hour 30 minutes. It checks the ability to write texts according to the appropriate style and type. It contains 2 subparagraphs: in subparagraphs 1 it is necessary to write an essay appealing to the two points of view provided, in subparagraphs 2 it is necessary to choose one type of text from those offered for choice (report, review, letter, proposal). The total number of tasks is 2.

Part III - “Listening”. The duration isapproximately 40 minutes. It tests the ability to understand and analyze information phonetically. All recordings are played twice. It contains 4 subparagraphs: in subparagraph 1 it is required to listen to a recording with three short texts and answer two questions for each, in subparagraph 2 it is required to listen to the recording and enter the required word or complete the sentence, in subparagraph 3 it is required to listen to the recording and answer six questions, in subparagraph 4, it is required to listen to a recording with five short texts and answer two questions as for the main points for each. The total number of tasks is 30.

Part IV - “Speaking”. The duration is 15 minutes. It checks grammar, lexical, communication skills, pronunciation and logical presentation of ideas. More often, two candidates and two examiners take part in the conversation. It contains 4 subparagraphs: free interview between candidates and examiners, each candidate should demonstrate in his turn his skills, describe the proposed images, a dialogue between two candidates on a proposed topic, a free interview between candidates and examiners on the topic proposed in the previous subparagraph (5).

Test of Legal English Skills (TOLES) is an international legal English exam administered by Global Legal English Ltd.

Objective: the results of this exam confirm the qualified knowledge of English of law, recognized in most international and regional law companies.

Purpose: to test exceptionally the candidate practical skills in the field of English of law, namely reading and writing, which are priority in the legal profession. professional еnglish speaking communicative medical student

Structure: there are three levels of this exam: TOLES Foundation (basic level), TOLES Higher (high level) and TOLES Advanced (advanced level). We consider the structure based on the example of TOLES Advanced exam. Total duration of exam is 2 hours. It consists of two parts, the first tests use of English, the second tests understanding of language and attentiveness when working with written contracts. The rating scale of this exam is the following: Gold - advanced level, Orange - high level, Red - good level, Purple - satisfactory level, Blue - level close to satisfactory, Green - basic level.

Task types: Part I - “Use of language”. It contains subparagraph from 1 to 6:

1) a short text with a task to it (10 missing words)

2) lexical questions (12 sentences with a missing word)

3) 10 sentences with a missing preposition

4) a text that is a letter with a task to it (12 missing words)

5) a text in which it is necessary to correct the wrong form of the word (10 words)

6) 10 sentences are divided into three sections, where one of the section contains a mistake (one should find the section with a mistake).

Part II - “Understanding and accuracy while working with written contracts”.

To understand the language while working with written contracts. Contains subparagraphs 7-12.

7. The part of the contract with 10 missing fragments (one should find the appropriate).

8. The part of the commercial contract with 10 underlined words/phrases with the task (one should find the equivalent of the text to the proposed notion).

9. The part of the credit agreement with 10 missing words.

10. The part of the contract with 5 missed prepositions.

11. 10 sentences, which are divided into three sections, where one of the section contains a mistake (one should find the section with a mistake).

12. Three points from one contract with 5 missed fragments (one should select the appropriate fragment) (9).

Business English Certificate (BEC) - Certificate in Business English - a British exam that tests knowledge of business English.

Aim: to confirm the level of English language proficiency for everyday use in the business environment for candidates who works or who is planning to work in business, including branches of marketing, production, financial services and general work in office.

Objective: to check the appropriate level of business English for using in business.

Structure: there are three levels of this exam: B1 Business Preliminary (BEC Preliminary), B2 Business Vantage (BEC Vantage) and C1 Business Higher (BEC Higher). Let's consider the structure of this exam using the example of BEC Higher. The total duration of the exam is a little more than 3 hours. The exam consists of four parts. There are three grades: A, B, C. When you take the exam for grade A, you get a certificate of level C2, when you pass the exam for grade B or C - a certificate of level C1. If you do not get enough points for a C grade, you can still get a BEC Vantage B2 level certificate if you demonstrate the appropriate level at the exam.

Task types: Part I - “Reading”. The duration is 1 hour. It tests the skills of understanding the text, its structure and details. It contains subparagraphs, each subparagraphs tests text perception skills, determine its main idea, understand the structure, lexical knowledge, identify the characteristics of the text and understand the structure of sentences. The total number of the tasks is 52.

Part II - “Writing” - Writing skills. The duration is 1 hour 10 minutes. It tests the ability to write the texts on the appropriate type. It contains subparagraphs: in subparagraph 1 it is necessary to write a short report based on certain input data in the form of graphs, histograms or charts, in subparagraph 2 it is necessary to choose one type of the text from the three offered (report, letter, proposal). The total number of the tasks is 2.

Part III - “Listening”. The duration is about 40 minutes. It tests the ability to perceive and analyze information aurally. All recordings are listened to twice. It contains 3 subparagraphs: in subparagraph 1 you need to listen to a recording of the monologue and put down the required word or phrase (up to three words), in the subparagraph 2 one should listen to a recording of five monologues related to one topic and answer two questions about the main points for each, in subparagraph 3one should listen to a recording of a conversation between several people and answer eight questions. The total number of the tasks is 30.

Part IV - “Speaking” - Communication. The duration is 16 minutes. It tests grammatical, lexical, communicative skills, pronunciation and logical presentation of the ideas. Two candidates and two examiners take part in the interview. It contains 3 subparagraphs: free interview - questions on personal or work-related topics, “mini-presentation” of each of the candidate on one of the proposed business topics, discussion between two candidates for a situation proposed by the examiner and make a definite decision (6).

Aptis - English Computer Testing is a multi-level and flexible computerized English language test from the British Council.

Aim: to confirm the required level of English proficiency by choosing individual skills for testing or a comprehensive exam at once.

Objective: to test the level of English by comprehensive testing, assess all four skills on the CEFR scale separately - reading, writing, listening and speaking, or some of them at the candidate's choice, as well as grammar and lexical knowledge.

Structure: the exam consists of five components - basic (grammar and vocabulary) and four skills (reading, listening, writing, speaking). Everyone who takes this exam prepares for the main component, as well as the skill components selected by the client. You can choose one skill or all at once. The total duration of the exam is 2 hours 42 minutes.

Task types: The main part - “Grammar and vocabulary”. The duration is 25 minutes.

The component to choose is Reading. The duration is 35 minutes. The component to choose is Listening. The duration is about 40 minutes. The component to choose is Writing skills. The duration is 50 minutes.The component to choose is Speaking, Communication. The durationis 12 minutes (8).

Occupational English Test (OET) - Professional English Testing is an international professional English language test for medical workers.

Aim: to confirm the required level of English language proficiency for studying and working in the English-speaking field of health care.

Objective: to test the level of professional English of medical workers with a comprehensive exam that includes four basic skills.

Structure: the exam contains of four parts. The total duration of the exam is 2 hours and 50 minutes. Reading and listening include general topics for all medical workers, writing skills and communication are specialized for a particular profession, based on typical work situations.

Part I - “Listening”. The duration is about 50 minutes. It tests the ability to perceive and analyze information aurally, to capture details. All recordings are listened to only once. It contains 3 subparagraphs: in subparagraph 1, two records of patient consulting should be listened to and professional notes should be filled, in sub-paragraph 2, one should listen to six recordings of professional conversational situations and answer one question to each situations, in subparagraph 3, two recordings of different professional situations should be listened to and six questions should be answered. The total number of tasks is 42.

Part II - “Reading”. The duration is 60 minutes. It tests the skills of perception of specific information, the ability to analyze, pay attention to detail and determine the essence. It contains 3 subparagraphs: in subparagraph 1 it is necessary to read four short texts related to one medical topic and answer 20 questions, in subparagraph 2 it is necessary to read six short texts on professional situations and answer 1 question, in subparagraph 3 it is necessary to read two texts on the topic of interest in medical workers and answer 8 questions. The total number of questions is 42.

Table 1

The inclusion of language competences in popular English language proficiency exams

Conclusions

It was concluded that analyzed exams evaluate all communicative skills of students, but in its turn, the qualification exam KROK-l(ESP) in its structure and content is not a qualitative exam for a comprehensive assessment of all communicative competencies of medical students, and it assesses only the level of professional knowledge, but not the level of English for specific purposes proficiency.

Bibliography

1. Кравчина Т.В. Класифікація міжнародних іспитів та сертифікатів з англійської мови. Молодий вчений. 2017. берез. (№3 (43)). С.405-409.

2. Люлько М.Є. Класифікація міжнародних іспитів з англійської мови за їх специфікою. Науковий вісник Національного університету біоресурсів і природокористування України. Філологічні науки. Київ, 2015. №215(1). С. 86-192.

3. Порядок здійснення єдиного державного кваліфікаційного іспиту для здобувачів ступеня вищої освіти магістр за спеціальностями галузі знань «22 Охорона здоров'я»: Постанова Кабінету Міністрів України від 28 березня 2018 р. №334.

4. Програма з англійської мови для професійного спрямування. Колектив авторів: ГЄ. Бакаєва, О.А. Борисенко, І.І. Зуєнок, В.О. Іваніщева, Л.Й. Клименко, Т.І. Козимирська, С.І. Кострицька, Т.І. Скрипник, Н.Ю. Тодо- рова, А.О. Ходцева. Київ:Ленвіт, 2005. 119 с.

5. C1 Advanced, formerly known as Cambridge English: Advanced (CAE), is one ofour Cambridge English Qualifications. web-site.

6. C1Business Higher. web-site.

7. OET- English language test for health care professionals. web-site.

8. Prepare for Aptis. web-site.

9. The Test of Legal English Skills. web-site.

10. Іспит з англійської мови професійного спрямування. Центр тестування при Міністерстві охорони здоров'я України.

References

1. Kravchyna T.V. Klasyfikatsiia mizhnarodnykh ispytiv ta sertyfikativ z anhliiskoi movy. Molodyi vchenyi. [University classification of international examinations and certificates in English. Young Scientist] 2017. berez. №3 (43). S. 405-409. [in Ukrainian].

2. Liulko M.Ye. Klasyfikatsiia mizhnarodnykh ispytiv z anhliiskoi movy za yikh spetsyfikoiu. Naukovyi visnyk Natsionalnoho universytetu bioresursiv i pryrodokorystuvannia Ukrainy. Filolohichni nauky. [Classification of international exams on the English language according to their specifics Scientific journal of National university of life and environmental sciences of Ukraine. Philological sciences] Kyiv, 2015. №215(1). S. 86-192. [in Ukrainian].

3. PORIaDOK zdiisnennia yedynoho derzhavnoho kvalifikatsiinoho ispytu dlia zdobuvachiv stupenia vyshchoi osvity mahistr za spetsialnostiamy haluzi znan «22 Okhorona zdorovia»: Postanova Kabinetu Ministriv Ukrainy vid 28 bereznia 2018 r. [the Resolution of the Cabinet of Ministers of Ukraine dated March 28, 2018, the Unified State Qualifying Examination for higher education master's degree applicants in the specialties of the field of knowledge «22 Health Care»] №334.[in Ukrainian].

4. Prohrama z anhliiskoi movy dlia profesiinoho spriamuvannia. Kolektyv avtoriv: H.Ie. Bakaieva, O.A. Borysenko, I. I. Zuienok, V. O. Ivanishcheva, L.I. Klymenko, T.I. Kozymyrska, S.I. Kostrytska, T.I. Skrypnyk, N.Iu. Todorova, A.O. Khodtseva. [English language program for professional purposes. Authors: G.Ye. Bakaeva, O.A. Borisenko, I.I. Zuenok, V.O. Ivanishcheva, L.Y. Klimenko, T.I. Kozymyrska, S.I. Kostrytska, T.I. Skripnik, N.Yu. Todorova, A.O. Khodtseva.] Kyiv:Lenvit, 2005. 119 s. [in Ukrainian].

5. C1 Advanced, formerly known as Cambridge English: Advanced (CAE), is one of our CambridgeEnglishQualifications. web-site. [C1 Advanced, formerly known as Cambridge English:Advanced (CAE), is one of our CambridgeEnglishQualifications.web-site] [in English]

6. C1Business Higher. web-site [C1Business Higher. web-site] [in English]

7. OET- English language test for health care professionals. web-site [OET-English language test for health care professionals. web-site] [in English]

8. Prepare for Aptis. web-site [Prepare for Aptis. web-site] [in English]

9. The Test of Legal English Skills. web-site [The Test of Legal English Skills. web-site] [in English]

10. Ispyt z anhliiskoi movy profesiinoho spriamuvannia. Tsentr testuvannia pry Ministerstvi okhorony zdorovia Ukrainy [Professional English exam. Testing Center at the Ministry of Health of Ukraine] [in Ukrainian].

Размещено на allbest.ru