Our client located in Toronto, is the national voice for education in Canada. They provide leadership in education at the pan-Canadian and international levels.
The incumbent applies their expertise to all phases of test development, carrying out psychometric analyses of the instruments; providing statistical analyses of, and reports on, large-scale-assessment data; and contributing to the drafting of reports (public, thematic, contextual, technical) and research notes to national and international education decision makers and other stakeholders. The Psychometrician reports directly to the Coordinator, Learning Assessment Programs.
- Excellent benefits
- The opportunity to work in a dynamic, collegial environment that promotes professional development and career advancement.
- Located in the heart of Toronto; steps from the subway station
- Develop detailed, complex sampling plans that meet international standards;
- Assist in the development of instruments for the large-scale assessment of reading, mathematics, and science skills, as well as new areas of study
- Assist in the development of survey questionnaires for students, teachers, administrators, school principals, and parents of students participating in the assessments;
- Advise on sampling procedures for the assessment questions;
- Create and implement quality-control procedures for scoring large-scale assessments, where scoring is led by the organization;
- Establish methodologies and procedures for analyzing assessment and questionnaire data;
- Model large-scale assessment data using classical test theory as well as item-response-theory models;
- Assist in standard-setting processes;
- Evaluate the psychometric properties of assessment and survey instruments;
- Generate and validate assessment results at the pan-Canadian and provincial/territorial levels, taking into account the complex nature of the data collected;
- Contribute actively to the drafting of public and contextual reports on these assessments;
- Write technical reports on these assessments;
- Provide expert advice to assessment-program managers regarding the advanced technical aspects of designing, analyzing, and disseminating assessment results;
- Provide support to provinces, territories, and external researchers on the use of large-scale assessment data for projects facilitated through the organization.
- Excellent command of French and English, both written and spoken
- Exceptionally detail-oriented, with strong organizational skills and the ability to meet critical deadlines
- Demonstrated ability to prepare analytic plans, monitor progress, and track Timelines
- Highly collaborative, with strong interpersonal skills to work with various stakeholders in the assessment development and reporting process
- Ability to work independently and collaboratively within a team
- Preference will be given to candidates with one or more of the following
- Demonstrated ability to prepare effective visual presentations of complex data
- Knowledge of Canada’s education systems
- A minimum of two years’ experience with large-scale assessments, typically gained through work at provincial/territorial/national ministries/departments of
education or educational institutions
- Extensive experience in research methodology, advanced statistical analysis such as multivariate and multi-level modelling, and reporting (using advanced
- Experience in classical test theory, item-response-theory modelling, and test linking and equating
- Exceptional research skills to stay current with developments in the field of specialization
Graduate degree (master’s or PhD) with specialization in psychometrics educational measurement, and/or assessment