The purpose of this section of the thesis is to provide a descriptive analysis of the pilot study that was completed prior to the main study phase. It also outlines improvements to the scale in regard to wording, items, and ease of response. In terms of analysis, detailed findings will not be presented. However, the process used and the final outcomes will be reported concerning development of the main study scale however because factors were correlated Oblimon rotation was employed
The survey was piloted with 100 respondents employing a five-point Likert scale. The scale included 76 items aligned under six components of social capital including trust, friendship, acceptance, reciprocity, norms, and governance. These respondents were not part of the main study (quantitative) section, but their responses were analysed using factor analysis to test reliability and validity. This process was used to factor out items which were not strong indicators of social capital, were not relating to other scale items nor contributing to strength of the scale (Tabachnick, & Fidell, 2001). The questionnaire of 76 items was too large for the main sample, and further item reduction was required which resulted in a smaller scale with high validity. Therefore, the pilot study and analysis was another process for removal of weak items and further scale refinement.
5.2.1 Pre-test
Prior to the pilot test, the draft scale was provided to two members of sporting clubs who were not part of the pilot test nor included in the main study. The rationale for
conducting the pre-test was to obtain feedback on actual question clarity, ambiguity, and understanding of instructions (Babbie, 2007). The researcher sat with each respondent while the respondent read each scale item and explained what they perceived it was asking them, prior to making their response. The pre-test provided feedback on clarity, and time needed for responses. Feedback suggested that two items (items 5 and 65) be altered slightly to provide greater clarity.
5.2.2 Pilot Test Sample
The questionnaire was trialled with a convenience sample of 100 members of diverse sport and recreation clubs (Dillman, 1978). The sample consisted of 38 female and 62 male participants, from 18 through 70 years of age, with a mean age of 46. An attempt to provide a balance between members of sport and members of recreation clubs was made. The pilot study included representatives from cricket, cycling, lawn bowls, softball, dog obedience, rowing, angling, trugo, lacrosse, tennis, basketball, shooting, triathlon, netball, hockey, soccer, calisthenics, and football clubs.
5.2.3 Questionnaire.
A five- point Likert response category, ranging from 1 = strongly disagree, 2 = disagree, 3 = neither agree or disagree, 4 = agree to 5 = strongly agree, was employed (Babbie,
2007). Likert response was chosen due to the clarity of responses for the participants, ease of analysis and data entry, and time required to answer questions (Dillman, 2000). Basic descriptive background information about each of the respondents was also obtained, including age, gender, whether a sport or recreation club, time in the club, and club role. Item responses were analysed to identify items that were not strong indicators of social capital factors, to observe the pattern of responses, and for item clarity
(Dillman, 2000).
Prior to the pilot test, scale items were reordered so they were not clustered together under the same factor headings but were spread out across the scale. Brief instructions were provided regarding directions on completing the survey, and the importance of responding to each item (see Appendix G). Members were also reminded that questions related to social aspects of most clubs and that the research was interested in the degree or extent that this may or may not exist in their particular club.
5.2.4 Procedures
The researcher distributed copies of the questionnaire to club members who then provided it to those members of their club who were part of the convenience sample for completion of the survey. The club member also coordinated the collection of completed questionnaires, while a small number were mailed back to the researcher.
5.2.5 Analysis
In total, 100 completed questionnaires were returned to the researcher for analysis. Factor analysis was conducted using the Statistical Package for the Social Sciences (SPSS) version 15. The process using Exploratory Factor Analysis was prescriptive and methodical allowing for development and testing of scale through a number of iterations reducing items and providing a factor mapping exercise after each showing a methodical map of item reduction. Oblimon rotation was used with principal components as they allowed for identification of main components and allowed for correlation (relationships) between factors to be identified to a minimum degree. Factor analysis resulted in a large number of related items aligned into a smaller number of factors, thereby resulting in greater clarity and parsimony (Harman 1976; Kass, & Tinsley, 1979). Items were observed for validity, strength of the item in the scale, and for reliability in the scale
(Neuman, 1997). This analysis helped reduce items for the final scale. Factor analysis enabled measurement of validity and factor strength through use of item total correlation and item reliability tests using Cronbach’s alpha (Thomas, Nelson, & Silverman, 2011).
The procedure allowed for removal of weak items from the scale, maintaining internal reliability and item and total scale strength. This method is especially suited to items in scales with various point values, such as attitudinal scales employing Likert scales (Thomas, Nelson, & Silverman, 2011).
In termsof scale development and sample analysis, careful regard was given to normality and extremes in co-variance. Checks were made for normality of distribution. Thus the process and procedures were logical and robust, with careful checks conducted at all steps of the analysis (Tabachnick & Fidell, 2001).
5.2.6 Results
The data were normally distributed. During analysis an item-mapping exercise of the discovered factors against the intended factors was conducted. Items that did not load strongly on any of the single factors were dropped (items whose weight on a particular factor was low < .05 and items that loaded on two factors with difference less than .1 (Tabachnick & Fidell, 2001). In total 34 weak items that statistically did not contribute to scale reliability and or validity were removed. The process reduced the survey instrument from 76 to 42 items, representing the six components (factors) of social capital (trust, friendship, acceptance, reciprocity, norms, and governance). In the final refining of items, attention was given to wording, the factor of social capital they addressed, and an attempt to maintain a similar number of items (7) for each factor. Employing exploratory factor analysis in the pilot study, it was important not too report everything as it is a
developmental process and not a tool. Mild skewness (slight bias) of responses towards the centre on the 5 point Likert scale suggested the need for more variation resulting in the employment of a 7 point Likert scale providing greater variation and precision. This refinement resulted in the establishment of the 42 item Club Social Capital Scale (CSCS) (see Appendix H.).