last updated:25/04/2016 @ 9:26 am
Print this page

SLE – DOPS pilot videos

The DOPS/SLE pilot has now reached the third stage. The purpose of this stage is to test the inter-rater reliability of the tools, and to explore the degree to which the observers agree during assessments.

Trainers are asked to watch and assess two videos which record procedural activities, and to use the new SLE DOPS forms to record the assessments.

Video 1: Communication Activity

The first video is of a communication activity (Duration c 3 minutes). You should use the SLE- for communication activity to rate this activity. The scenario is an occupational medicine trainee who discusses a clinic case with a line manager.

Copyright © 2014 Faculty of Occupational Medicine

Written transcript

Video 2: Spirometry

The second video is of the procedure of spirometry (Duration c 6 minutes).  You should use the SLE- spirometry to rate this activity. The scenario is an occupational medicine trainee who undertakes a spriometry investigation of a worker, and then discusses the investigation results with a more senior colleague.

Copyright © 2014 Faculty of Occupational Medicine

Written transcript

You should assess both scenarios as if the  occupational medicine trainee is in the final year of training.

Once you have completed the pilot forms (Pages 1 & 2), please return them to the Examinations & Training Team, preferably as a scanned document by email, or by post to the Faculty.

Many thanks for your time and effort in helping us with this pilot evaluation.


Notes on the Videos

We are aware that video 1 (communication activity) is relatively short, and that the traineewould normally be observed over a longer period. However, we are principally interested in how you would rate the trainee and give feedback, and for us then to compare content of the forms returned to us to assess the inter-rater reliability of the method.

Video 2 (spirometry) contains a discussion between the trainee and a consultant in the second section of the video. We are aware that there is a degree of feed-back by the consultant in this section, but that is not relevant, and the aim is for you to use the tool to assess the interpretation of results /clinical decision making / communications and recommendations ability by /of the trainee.

Please make some allowance for the limited resources available to complete the videos. We are aware that technical factors (such as sound quality) may interfere with your assessment, depending on the software or hardware you are using to play the videos. We have made written transcripts of both videos available for your use as necessary to help with this.

Notes on the Pilot Aims

Our aim with this exercise is to assess the strength of the pilot SLE-DOPS tools in terms of reliability. This is a measure of the stability of the tool and the degree to which different raters agree in their decisions. This is done by having a range of assessors evaluate a single performance using one of the tools.

Other measures of tool quality are the usability, utility and acceptability of the tools, which are primarily being tested through the recently issued Survey Monkey questionnaire sent to all trainers and trainees, after the pilot tools have been reviewed and used in practice.