The evaluation of a vocational and tech- nical education system involves a critical examination of its development or effec- tiveness. The evaluations are intended to determine the necessary corrective mea- sures or modifications.
To support the ongoing evaluation of the system, the MEQ regularly publishes documents containing indicators on
Educational
and
Management
Chapter
education and training.32In them it pro-
vides information on the evolution of enrollments, the government’s financial contribution to education and access to programs of study. Most of these publi- cations include a section on vocational and technical education.
In order to fulfill its mandate and ensure the monitoring and evaluation of education, however, the SFPTFC has its own indicators, which are divided into three categories:
• the evolution of program offerings • the integration of graduates into the
labour market
• the effectiveness of the vocational and technical education system
The evolution of program offerings
Analysis of the evolution of program offerings is essential for making informed decisions and disseminating relevant infor- mation. Indicators regarding the evolution of program offerings include information about enrollments and graduates ac- cording to age, gender, VTE sector and administrative region. The analysis also provides specific data for the greater Montréal area and establishes compari- sons between the situation in Québec and that in the rest of Canada.
Particular attention is paid to female enrollments, women being clearly under- represented in most VTE sectors. The MEQ is using special activities and financial measures to encourage women to open up to a greater variety of career choices
and to promote their sociovocational integration into profitable sectors of the Québec economy. Increasing the presence of women in every VTE sector is a commit- ment the government made in its policy on the status of women entitled Action Plan
2000-2003: Equality for All Women of Québec.33
The integration of graduates into the labour market
Two types of indicators reveal whether program offerings meet labour market needs. The first type, found in the training- job matching model, are used to determine the ideal number of annual enrollments for each program of study and region in order to ensure consistency between pro- gram offerings and work force needs.
The second type of indicator reveals the conditions for the integration of gra- duates into the labour market and the level
32See <http://www.meq.gouv.qc.ca/m_stat.htm>.
Educational
and
Management
Chapter
of employer satisfaction. These indicators are the result of an annual survey carried out among all vocational and technical education graduates and the businesses that hire them, known as Relance.34
•
Consistency between programofferings and work force needs
The training-job matching model in- cludes data that are excellent indicators for evaluating the system. Indeed, by compa- ring the actual and targeted enrollments for all programs of study, it is possible to determine which ones have a surplus of enrollments, and which have a shortage, revealing whether training needs had been correctly evaluated.
•
Relance surveysTwo types of surveys are done: one with graduates and one with employers.
The aim of the survey of graduates is to describe the situation of vocational and technical education graduates a few months after graduation. This provides a source of first-hand information about the integration of new graduates into the labour market by program, VTE sector and region, as well as overall. These surveys are conducted annually among all new graduates.
The survey of employer satisfaction is intended to obtain businesses’ assessment of recent graduates hired during the refer- ence year. This survey is conducted among
a random sample of businesses that have hired recent graduates. The information it provides is that much more reliable since employers are surveyed directly.
The two types of surveys are complemen- tary. Indeed, any demand-driven education system must, on the one hand, adopt a model for predicting needs in order to plan program offerings and, on the other, have a relatively accurate idea of the rate of integration of graduates from each program into the labour market in order to be able to adjust program offerings. This feedback can result in various meas- ures such as quotas, the reduction or increase of program offerings or the pro- motion of programs of study with better job prospects. It may also be necessary to improve the quality of education, given the observations regarding the satisfaction of graduates and employers.
The effectiveness of the vocational and technical education system
In Québec, the measurement of the overall effectiveness of the vocational and technical education system is based on four main elements: performance, adapt- ability and flexibility, the cost of education and the ability to meet labour market needs. The MEQ makes an effort to deter- mine the indicators to be favoured in order to improve the measurement of the effectiveness of the current system.
Educational
and
Management
Chapter
SUMMARY
The central management of vocational and technical education includes four major dimensions: labour market anal- ysis, the planning of program offerings, the organization of program offerings and
the monitoring and evaluation of program offerings. The table below illustrates the results sought and the means used for each step in the central management process.
Table 2 Steps in the process for the central management of education
Steps Results sought Means and tools
Labour market The assessment of Training-job matching
analysis qualitative needs model
The assessment of Strategic watch quantitative needs
The definition of program Regional vocational and development priorities technical education plansRegional monitoring Planning of Training approaches Impact analysis
program offerings The conditions for imple- Map of options menting the program Student financial (funding parameters) assistance The determination of
program offerings Measures designed to facilitate access
Organization of The determination of Instructional and material program offerings funding methods organization guide
Physical and material Implementation cost
organization estimate
In-service training for Budgetary rules
human resources Provincial in-service training program
Monitoring and The evolution of program Information about applicants evaluation of offerings
program offerings The integration of graduates Survey of secondary-levelvocational education graduates into the labour market Survey of college-level
The effectiveness of the VTE technical education graduates
system Survey of employers
Performance indicators (success rate, graduation rate, etc.)
Educational
and
Management