PSYCHOMETRICIAN, LEARNING ASSESSMENT PROGRAMS/PSYCHOMÉTRICIENNE/PSYCHOMÉTRICIEN, PROGRAMMES D’ÉVALUATION DE L’APPRENTISSAGE

THE COUNCIL OF MINISTERS OF EDUCATION, CANADA (CMEC) is an intergovernmental body providing leadership in policy development, program administration, and research at the pan‑Canadian and international levels. Located in the heart of Toronto (steps from the St. Clair subway), CMEC is seeking a:

PSYCHOMETRICIAN, LEARNING ASSESSMENT PROGRAMS

Full-time position, fixed term contract until December 18, 2026

Current annual salary range: $74,114–$109,214, depending on experience and qualifications

Work arrangement can be remote, in-person, or hybrid

This position is a member of the Canadian Office and Professional Employees Union (COPE) Local 343.

In joining CMEC, you will be part of a dynamic, intellectually stimulating, and collegial environment, in an organization that is focused on enhancing the quality of education for all Canadians. You will work with government officials, international partners, and colleagues from across the organization and around the country. 

The Psychometrician supports the successful development, implementation, analysis, and reporting of flagship projects that assess the knowledge and skills of students at the pan-Canadian and international levels. Such projects include the Pan-Canadian Assessment Program (PCAP), the Progress in International Reading Literacy Study (PIRLS), the Programme for International Student Assessment (PISA), and the Trends in International Mathematics and Science Study (TIMSS).

The Psychometrician applies their expertise to test development and sampling, as well as to carrying out psychometric analyses of assessment instruments; providing statistical analyses of large-scale assessment data; and contributing to the drafting of reports (public, thematic, contextual, technical), data outputs, and research notes for pan-Canadian and international education decision-makers and other interested parties.

This position reports directly to the Coordinator, Learning Assessment Programs.

Key responsibilities

• Establish methodologies and procedures for analyzing cognitive and questionnaire data for respective assessments
• Model large-scale assessment data using classical test theory as well as item response-theory models
• Generate and validate assessment results and data sets at the pan-Canadian, provincial/territorial, and international levels
• Conduct statistical analyses using sampling, achievement, and contextual data and analyze comparisons, associations, trends, and different variables of interest
• Draft public, contextual, thematic, and technical reports, as well as research papers and notes on large-scale assessment data and results
• Review and validate international reports, and other assessment data-related documentation and outputs
• Prepare presentations on assessment results and data for interested parties
• Develop detailed and complex sampling plans based on assessment and international standards, and advise on sampling-related processes and data
• Assist in the development and analyses of assessment frameworks and technical standards
• Support standard-setting processes
• Evaluate the psychometric properties of assessment instruments and processes
• Assist in the development and review of cognitive instruments for large-scale assessments in reading, mathematics, and science, as well as other domains
• Assist in the development and review of questionnaires for students, teachers, school principals, and parents/guardians of students participating in large-scale assessments
• Design and implement quality-control standards and coding procedures for large-scale assessments and ensure data validity and reliability to support defensibility of assessments
• Provide expert advice on the advanced technical aspects of designing, analyzing, and disseminating assessment data sets
• Provide support to provinces, territories, external researchers, and other interested parties on the design and use of large-scale assessments and data sets

Key qualifications 

• Superior oral communication and writing skills in English
• Excellent oral communication and writing skills in French is considered an asset
• Graduate degree (master’s or PhD) with specialization in psychometrics, educational measurement, and/or assessment
• A minimum of two years’ experience in analyzing and managing large data sets (experience with large-scale assessment data sets is considered an asset). Such experience is typically gained through work at related organizations, preferably within the education sector or government institutions
• Experience in research methodology and design, psychometric methods, statistical analysis (such as multivariate and multilevel modelling), and reporting
• Proficiency using advanced statistical packages (e.g., R, SPSS, SAS, Stata) to analyze data sets
• Strong knowledge of classical-test-theory and item-response-theory modelling
• Experience with item calibration, scaling, linking and equating
• Exceptional research skills to stay current with developments in the field
• Exceptionally detail-oriented, with strong organizational skills and the ability to meet critical deadlines
• Demonstrated ability to prepare analytic and reporting plans, monitor progress, and track timelines
• Highly collaborative, with strong interpersonal and communication skills to develop and maintain relevant networks and positive working relationships with senior government officials and other interested parties
• Ability to work independently and collaboratively within a team
• Strong analytical, decision-making, and problem-solving skills
• Knowledge of Canada’s education systems and intergovernmental relations is considered an asset

The position offers a competitive salary based on experience, as well as a full benefits package, including:

• Competitive vacation allotment
• Twelve (12) paid statutory holidays
• Ten (10) paid sick days
• Five (5) paid personal days
• Personal wellness and professional development account ($600 annually)
• Contribution towards employee’s own retirement savings plan
• Health benefits
• Flexible work schedule, with the opportunity for hybrid or remote work

Please send an electronic version of your cover letter and résumé to the Council of Ministers of Education, Canada (CMEC), by November 10, 4:00 p.m. ET. For more information, visit us at www.cmec.ca.  

CMEC is committed to fostering an inclusive, diverse, and accessible environment, where all employees, business partners, and clients feel valued, respected, and supported. If you require accommodation during the recruitment and selection process, please let our Human Resources team know.

CMEC thanks all candidates for their interest in this position. Only those who are selected for an interview will be contacted. Candidates must be legally entitled to work in Canada.

CMEC is an equal-opportunity employer.

Please visit our careers page to see more job opportunities.