ANALISIS Y DISCUSIÓN DE LOS RESULTADOS

To ensure a high-calibre and well-organised data collection staff, which is of critical importance to data quality.

Rationale

Interviewers are a component of survey error which can be minimised through frequent monitoring by supervisory staff. Close supervision and mentoring of the data collection staff are required to produce the best quality study data. The supervisor-to-staff ratio should be low enough that supervisors are able to monitor whether interviewers are following all study procedures and administering the instruments as designed. Monitoring is required to uncover potential issues that may have an impact on the survey data and to allow for opportunities to provide and receive feedback at all levels of the field management structure.

Standards, Guidelines and Recommendations

Standard 8.1.1 The successful implementation of data collection requires a variety of staff – including interviewers, supervisors, field managers and a field director – with clearly defined roles and responsibilities.

Guideline 8.1.1A Several factors determine the number of interviewers required for data collection

(see Standard 8.3.1). The interviewer’s duties should include the following:  Completion of interviewer training (see Section 9.4);

 Location of sampled persons/households;

 Administration of survey instruments following the PIAAC procedures;  Submission/transmission of survey data in a timely manner;

 Reporting to a supervisor on a regular basis;  Performance of various administrative procedures.

Guideline 8.1.1B There should be at least 1 supervisor for approximately 15 to 20 interviewers,

making up one “region,” as defined for work purposes. The supervisor’s duties should include the following:

 Interviewer staffing for the region;

 Completion of supervisor training (see Section 9.3);  Participation in interviewer training (see Section 9.4);

 Day-to-day management of the field effort for the defined region, including case assignment and reassignment among interviewers;

114

 Ongoing monitoring of each interviewer’s work, including goal setting for each interviewer;  Involvement in the implementation of quality control procedures;

 Weekly conference calls with each interviewer;  Nonresponse follow-up;

 Validation of each interviewer’s work (see Section 9.9);  Reporting to a field manager on a weekly basis.

Guideline 8.1.1C There should be at least one field manager for every three to five supervisors. The

field manager’s duties should include the following:

 Participation in supervisor and interviewer training (see Sections 9.3 and 9.4);  Oversight of interviewer hiring;

 Ongoing monitoring of each region’s work;  Supervision of the supervisors;

 Weekly conference calls with each supervisor in his/her assignment;

 Development and implementation of techniques for motivating interviewers, reassigning cases, converting nonresponse and related functions;

 Reporting to the field director on a weekly basis.

Guideline 8.1.1D There should be one field director overseeing the entire effort. The field director’s

duties should include the following:

 Development of a field plan, including determination of the number of interviewers to be hired (see Standard 8.3.1);

 Hiring of field managers and supervisors;

 Preparation of materials for and conduct of supervisor training (see Section 9.3);  Preparation of materials for interviewer training (see Section 9.5);

 Ongoing monitoring of the entire data collection effort, including interviewer production and costs, with particular attention to quality control procedures;

 Supervision of the field managers;

 Weekly conference calls with the field managers;

 Development of various reports for project management, including production reports, as well as responses to ad hoc requests;

 Development and implementation of strategies in response to issues that arise during data collection, such as high levels of nonresponse or the need for attrition training.

Recommendation 8.1.1A To produce a strong project team, members at the upper levels of the

management structure should have worked together effectively on similar projects.

Recommendation 8.1.1B The field director should be based at the survey institute’s home office,

while the field managers and supervisors may operate from the field.

Standard 8.1.2 Staff must remain in close, regular communication throughout the data collection period.

Guideline 8.1.2A Field supervisors should have weekly conference calls with each interviewer to

discuss progress and problems, productivity and response rates, and a strategy for the completion of remaining cases in the assignment.

115

Guideline 8.1.2B Field managers should have weekly conference calls with each supervisor in their

assignment to discuss progress toward production and cost goals, review travel plans, assess interviewer resources within the region, and identify potential problems.

Guideline 8.1.2C The field director should have weekly conference calls with the field managers to

discuss data collection progress and issues that have occurred in the field and to review production and cost reports.

Guideline 8.1.2D In addition to scheduled weekly conference calls between data collection staff, the

interviewers, supervisors, field managers and field director should be available on a daily basis by e-mail or telephone to provide status updates, answer questions or provide other information.

Recommendation 8.1.2 Countries should develop a monthly newsletter as a way of sharing

information among the field staff and fostering concepts of teamwork. The newsletter should report regional and overall production. It can also be used as a forum for improving aspects of the fieldwork, for instance, sharing ideas for working difficult cases, new approaches to increase productivity or techniques for convincing reluctant respondents to participate.

Quality Control Procedures

As part of the National Survey Design and Planning Report process for the field test and the main study, countries will be required to document their proposed management structure and their plan for facilitating communication at all levels.

On a monthly basis during the survey planning and data collection period, countries will be required to complete quality control monitoring forms to report the status of recruitment and hiring of field staff and field management for the field test and the main study.

116

8.2 SUPERVISION AND MONITORING OF DATA COLLECTION STAFF