30. Monitoring of Standards
The WCF recognises the need for self-monitoring the standards for all stages of the examination process and institutes an annual monitoring procedure for each appropriate element. The Evaluation Report and Development Plan are at Appendix 14 (examiner's manual).
Elements that are monitored:
- Recruitment of Examiners.
- Competence of Examiners.
- Examination Results in total and for individual examination centres.
- Reasonable Adjustments and Special Considerations.
- Complaints, Enquiries, and Appeals procedure.
- Customer Service Targets.
- Malpractice.
Timetable:
- Monitoring and reporting takes place annually.
- The Examination Monitoring Report is drafted in October by the Registrar. It includes an analysis of each of the sections identified above and covers the calendar year (January to December).
- The Report is presented for discussion to the Examinations Executive Group at their October meeting.
- It is then presented to the October meeting of the Examinations Board for review and evaluation. An Action Plan for each element is agreed
- The Report and the Action Plans are presented to the Court at its December meeting for approval.
The Report will include the following sections:
- Recruitment and Training of Examiners
- The report will detail the number of examiners recruited in the current year, their qualifications and experience, and their involvement with the examination in the year. The report also includes details of the existing examiners including their years as an examiner and the projected requirement for new examiners in the forthcoming year.
- The report will also details the training sessions that have taken place in the year and includes feedback from these sessions. If necessary, any proposed changes to the training plan will be discussed, agreed, and recorded.
- Competence of Examiners
- The report will include a statistical analysis of the involvement of each of the examiners, including the number of candidates examined for both the oral and practical sections, and will include any reports submitted by the Senior Examiner. The report will identify any examiners whose work is causing concern. Examiners who are unable to meet the required standards will not be allowed to continue examining.
- Examination Results
- This will include both the overall analysis for the examination in total and a breakdown of results for each individual Examination Centre. It will include a comparison year-on-year and will identify any trends, either positive or negative.
- Reasonable Adjustments and Special Considerations
- This will give details of all the candidates who required Reasonable Adjustments and Special Considerations to be put in place for the examinations held during the report year. It will also include any comments from the examination centres.
- Complaints, Enquiries, and Appeals procedure
- This will include an analysis of all complaints enquiries and appeals but will not identify the individuals involved. It should indicate the issues involved in the complaint, enquiry, or appeal and will include an indication of any action or change that has been instituted as result of the complaint, enquiry, or appeal. It will include a year on year comparison.
- Customer Service Targets
- The customer service targets must be measured and evaluated each year, including a year-on-year comparison. The report must include a recommendation as to the continuing appropriateness of the targets and recommendations if the targets are constantly under achieved.
- Malpractice
- This section should report any instances of malpractice, and a review of the processes in place to prevent malpractice. The report will include cases of reported malpractice at the Approved Training Colleges which have been notified to the WCF.