“The final product of a grounded theory study is an integrated and comprehensive grounded theory that explains a process or scheme associated with a phenomenon.” (Birks & Mills, 2011: 12). A ‘storyline’ is usually used to present grounded theory findings, and it often entails presenting the findings as a whole before explaining parts in depth, using data fragments and coding concepts as supporting evidence. At this stage, the significance of existing theory and knowledge may also be discussed (ibid: 134-136). “In the end, a GT analysis is a story that integrates focused codes – the main categories of events and ideas in a set of texts.” (Bernard & Ryan, 2010: 275)
5.8
Rhodes University as a Case Study
Cohen et al (2007) advocate finding a site which provides the best location for the research design, as well as for locating, identifying and approaching key participants. Rhodes University was chosen as single-site case study because of my long association with the institution (27 years of employment, 11 of which were in a senior administrative position) which enabled me to access rich, reliable data as well as secure appointments with academic and executive staff within the institution. RU provided the perfect site for “events and situations to speak for themselves” and for “combining subjective and objective data.” (ibid: 254)
5.9
Reliability and Validity
There will always be a certain amount of bias and subjectivity involved in qualitative research which is why it is important for researchers to assure readers that the research framework and methods used are reliable and valid. However, reliability and validity are not infallible concepts and, as noted by Cohen et al (2011: 179), “at best we strive to minimize invalidity and maximize validity.” In order to claim reliability, one needs to have well-validated procedures. “Your audience should be able to trust that you have used thorough and consistent methods to produce a trustworthy outcome.” (Richards 2005: 192)
74 Validity in quantitative research is based on positivist principles such as predictability, objectivity and replicability whereas qualitative research is more concerned with authenticity and understanding (Cohen et al, 2011: 180).
From a grounded theory perspective, methodological congruence and procedural precision are paramount in pursuing reliability and validity. Methodological congruence is achieved when there is harmony between the researcher’s philosophical position, the aims of the research and the methodological approach used to achieve these aims (Burks and Mills, 2011: 36). Procedural precision - or rigour - concerns the processes used to generate and analyse data. Grounded theory methods should be rigorously applied in order to develop theory which can be considered a quality product. (Glaser, 2004) The most important elements of procedural precision in grounded theory are the use of memos, keeping an audit trail, managing data and resources, and demonstrating procedural logic. (Burks and Mills, 2011: 38)
For the qualitative data analysis, careful records and memos were kept electronically using NVivo software, and frequently returned to in order to verify claims made in the discussion section of each Chapter. Hard copies of memos made over the years as well as articles, policy documents and relevant printed materials were also kept in folders labelled according to the major focus areas of this study: Access, RPL, Graduateness, Context, Statistical Data, Interview Data and Methodology. A separate exercise book was kept to record thoughts and questions which initially did not have a thematic ‘home’ but warranted further consideration.
“Coder reliability” is critical aspect of grounded theory methodology. According to Richards, (2005: 98) “Reliability in qualitative research is a contentious topic… qualitative methods are all about interpretation and individual agency.” The aim is to sure that you are interpreting a code the same way across time, or that colleagues/other readers/coders would interpret it the same way. In this context then, reliability means consistency. In order to achieve reliability in this area, I included a large amount of verbatim data from the interviews in the form of tables (see Chapter 7) so that readers might judge for themselves whether my interpretation of the transcripts was consistent and valid.
“Member checking” is another tool used to enhance reliability and validity. The researcher “produces the report and has it reviewed by those studied, revisiting it in the light of their judgement.” (Richards, 2005: 140) Following one of the early interviews, I went back to one of the respondents once the interview had been transcribed and went through it with him question by question, asking if his
75 responses had been accurately recorded and interpreted. The interviewee was satisfied with the outcome which gave me confidence that I was able to adequately capture the content, essence and tone of each interview.
The statistical data used in the quantitative analysis in this study was produced by the University’s Data Management Unit. It was extracted from the institutional database which is externally audited and verified annually and can therefore be considered reliable. The methods used to analyse the quantitative data were simple numeric calculations which can be tested and replicated.
The Senate and Faculty minutes as well as motivation records analysed in this study (see Chapter 8) are historical documents - which are “social products, located in specific contexts and have to be interrogated and interpreted rather than simply accepted” (Cohen et al, 2010: 203). Senate and Faculty minutes fall on the left hand side of the following reliability and validity continuum (adapted and expanded from Cohen et al, 2011: 203) and as such are considered to be satisfactorily reliable and valid, particularly as university minutes are “… in the public domain *and+ written by skilled professionals and contain more valuable information and insights than those written by relatively uninformed amateurs.” (ibid: 201)
FIGURE 1 Reliability and Validity Continuum for Historical Documents