This is an HTML version of an attachment to the Freedom of Information request 'Race Equality Impact Assessment'.

The following is an extract from a draft report that is currently being considered through the committee structure at Edge Hill University to assess the validity of the methodology for Equality Impact Assessments. It has previously been to the Widening Participation Group on Thursday 21st January 2010 and will be discussed at the Equal Opportunities and Student Support Committee meeting on Wednesday 17th February 2010. It shows the new approach we are hoping to implement in the light of new data being available, in particular, via the University and Colleges Admissions System (UCAS) and also new methods internally of looking at data.

For the purposes of responding to the FOI request in relation to impact assessments based on Race, only data in respect of this aspect has been extracted from the draft report. However the general commentary on how the cohort samples have been identified and the issues that arise with this are included.

Edge Hill University

Equality Impact Assessment - Data Analysis (DRAFT)

Stuart MacFarlane February 2010

Introduction

This report analyses data on UCAS applications to Edge Hill in the 2008 cycle, and the retention of full-time degree students in the 2005-2008 cohort, to assess the impact of the Admissions Policy and the Teaching and Learning Strategy on a number of cohort subgroups.

A major purpose of the report is to test the methodology used, so that it can be refined in order to carry out a more focused examination of some more recent data.

The journey of a potential student into, through, and out of Edge Hill is illustrated in simplified form in Figure 1. Each of the stages and transitions is discussed in more detail below, but, in essence, the journey comprises a number of stages, which each individual either completes successfully (from Edge Hill's viewpoint), or does not.

This analysis for the Equality Impact Assessment looks at the progress on this journey of several subgroups of (potential or actual) students. The method used here is to look at the percentage of `successes' at each transition on the journey, and to check (where possible) whether there is evidence that subgroups of the population are affected equally. If there is a difference, then there may be an equality issue to address.

For each stage, the (potential) student body will be divided into subgroups according to the relevant characteristics of the individual, and according to the programme areas they are applying for, or studying.

0x08 graphic
0x01 graphic

Figure 1 - The Applicant-Student Journey

    1. Individual Characteristic Subgroups

For each of the five variables of interest, two or three classifications are used. Numbers are too small in most cases to allow further subdivision (for example into different non-white ethnic groups).

  • Conclusions

  • A weakness of the methodology used here is that each variable has been analysed separately. It is likely that there are interactions between some variables that might provide explanations for some findings. For example, the good performance of students over 25 may be in part because many of the students in this age group are women, and women appear to perform better. However, a full analysis of all possible relevant variables and their interactions would be complicated and time-consuming.

    One particular factor that might interact with other factors, and that has not been considered in the analysis, is previous educational performance, which can be considered a proxy for the `academic quality' of a student. This could be assessed using the total tariff points for enrolled students, but would be more difficult to take account of for applications, since the majority have not completed their qualifications when they apply.

    Another factor that should be investigated, if possible, is the type of qualification - `traditional' or `vocational'. Detailed data is available on the qualifications of applicants and students, but it may not be complete, and it may not be straightforward to distinguish the two types.

    Where a group of interest is small, it can be difficult to draw any conclusions from calculations such as those above. For example, the numbers of students in ethnic groups other than `White', and the numbers declaring disabilities, are sufficiently small that any differences in performance may not be visible. It may be more appropriate to assess the impact of policies on such groups by other methods.

    In the analysis of applications, there is little sign of differences in patterns of acceptances of offers, and it may be appropriate to drop this from future investigations. Instead it would be useful to investigate, where possible, the different ways in which applications are `lost', including withdrawals, and the reasons for rejection, such as inappropriate qualifications, or poor interview performance.

    With reference to the retention analyses, for most factors it appears that the first year progression data predicts what is likely to happen in subsequent years. Hence it should be possible to analyse much more recent data, such as the 2008 intake, rather than having to wait for the cohort to complete the entire programme.

    An issue that remains to be settled is how courses should be allocated to `departments' in analyses such as this. For a number of reasons, different classifications were used here for the applications and retention analyses.

    For degree students, an award of an ordinary degree at the end of year 3 is regarded as a success, while the award of a DipHE is regarded as a loss.

    Regarded as being three years for an undergraduate degree.

    14

    Other applicants

    Losses

    Successes

    Students who leave or fail to complete target award in target time

    Offer holders who don't turn up

    Applicants who withdraw, decline, or are rejected

    Enquirers who don't apply

    Successful students

    Registered students

    Confirmed offer holders

    Applicants

    Enquirers

    Students graduating by September in year 3

    Losses

    Successes

    Vanish

    Those who withdraw, intercalate, achieve a lower exit award, or fail during or at the end of year 3

    Those who withdraw, intercalate, or fail before start of year 3

    Those who withdraw, intercalate, or fail before start of year 2

    Students enrolling for year 3

    Decline place

    Students enrolling for year 2

    Students enrolling for year 1

    Enrol

    Confirm final acceptance

    If conditional, reject after results

    If conditional offer, confirm place after results

    Accept offer

    Losses

    Successes

    Figure 2 - The Application Process

    Decline offer

    Withdraw

    Reject

    Conditional or unconditional offer

    EHU decision, possibly after interview

    Application