Survey Oversight Policy

Aim

1. This policy is for the regulation and rationalisation of the student-facing education/experience surveys at Leeds. It seeks to ensure that this activity is focused, purposeful and reduces survey fatigue.

Scope

2. The policy applies broadly to surveys addressing current students which:
   1. Are about student education or experience;
   2. Sample a large group (250+ students) across more than one unit/school/department;
   3. Are promoted via digital communications (e.g. Minerva, email).
3. Surveys falling within this scope must be submitted to the Survey Oversight Group for approval prior to being run, unless they fall within an exemption (see points 8-11 below). Requests will be submitted via a form, with a clear timeline for approvals to ensure that activity is not held up by this process.
4. Surveys will be added to a repository mapping activity and questions. This will allow for the effective institutional monitoring and joining up of survey activity and datasets, identification of areas of repetition and, where appropriate, the development of trend analysis and benchmarking.
5. Surveys will be approved based on a range of criteria appropriate to the scale and function of the survey (see points 12-19). A clear timeline for the turnaround of approvals will be offered, ensuring that those wishing to run surveys can plan accordingly.
6. The policy applies to both new and existing surveys unless the proposed survey meets any of the exemptions listed. The types of surveys the policy will apply to includes any externally led survey e.g. those run by Advance HE, Jisc and iGraduate, and any internal survey e.g. evaluation of teaching or student experience, but also surveys run for educational research purposes, those monitoring service delivery, and those feeding into review processes.
7. Once approved, annual surveys making significant changes to question set, sample or timing, should re-apply to the group for approval.

Exemptions

8. All surveys addressing students prior to starting at Leeds, or after graduation.
9. Polls and questionnaires run during focus groups, workshops, or synchronous teaching sessions (e.g. using Vevox), including as part of module check-ins.
10. UG and PGT students completing research projects.
11. Student representatives running short surveys to proactively address the immediate concerns of students. Student representatives and interns wishing to run more substantial surveys about student education/experience matters will need to seek approval as appropriate. There will be additional support for students undertaking this process.

Criteria for Survey Approval

12. The objectives of the survey cannot feasibly be fulfilled through other means (e.g. focus groups, online interviews, exit polls of events, online polls, analytics).
13. The data does not already exist in a suitable form.
14. The survey does not substantively duplicate questions from other surveys addressing the same cohort in the same year unless there is strong reason to compare data gathered within the same session.
15. The survey is relevant and targeted at the population from which the data is needed.
16. The survey is timely (i.e. considered in the light of existing survey timings to avoid overloading students and reducing response rates in surveys that meet institutional strategic objectives).
17. There is a clear plan regarding:
    1. How results will inform practice or the development of student education and/or experience;
    2. How the analysis of results and dissemination of outcomes will be resourced and managed;
    3. How the feedback loop will be closed with participants.
18. The need for ethical approval has been considered and, if required, has been obtained or is being sought.
19. Applications will be prioritised based on meeting at least one of the following criteria relating to their institutional or local contribution:
    1. The survey supports achieving the strategic objectives and priorities of the University or of a school/unit, faculty, institute or service. This includes surveys that measure Key Performance Indicators.
    2. The survey is designed to contribute to reflection and continuous improvement by the University.
    3. The survey responds to student feedback and will inform enhancement of our teaching activity or other services.
    4. The survey is required for external compliance.
    5. The survey will provide data enabling useful benchmarking with other institutions and/or impact on the University's external reputation through league tables or other measures.
    6. The survey supports external initiatives to which the University wishes to contribute, particularly where these are sector-wide.

Resources

20. The following resources will be available to support applicants:
    1. A flow diagram outlining the application process and timeline of approval process.
    2. Resources to support awareness of current survey practice at Leeds.
    3. Resources to support appropriate design of survey questions, data protection, engagement with students, and use of University of Leeds IT systems to gather data.
    4. An online community of practice for those working with student experience surveys.
21. Additionally, the possibility of convening a panel of experts to consult on the design of survey questions will be investigated.

This is version 1.0 of this policy which is owned by the Quality Assurance and Enhancement Team. Please contact [email protected] for any matters related to this policy. Guidance for staff is available on the staff intranet.