Term: Temporary, Full-Time (ending Jan 2028)Work Location: Hybrid, Vancouver B.C. (a combination of in-office and remote work)

Who we are

Inspire Global Assessments (Inspire), formally known as the Nursing Community Assessment Services (NCAS), is a branded service of the BC College of Nurses and Midwives. We're working with nursing regulators and governments across the country to address the acute nursing shortage. Inspire is a unique assessment service that supports the transition of internationally educated health care professionals into the global work force.

The British Columbia College of Nurses & Midwives (“BCCNM”) is the college empowered under the Health Professions Act to regulate the practice of all licensed practical nurses, nurse practitioners, registered midwives, registered nurses, and registered psychiatric nurses in British Columbia. Regulation helps to protect the public by ensuring that professional care or service received by the public is competent, ethical, and meets the standards that society views as acceptable.

As western Canada's largest health profession regulator, we believe a diverse and inclusive team enriches our efforts to protect the public. We welcome applications from all who reflect of the communities we serve, and especially encourage Indigenous Peoples and members of equity-seeking groups to apply. We believe diverse perspectives and experiences bring both innovation and better outcomes to the work we do and the decisions we make.

BCCNM's commitment to Indigenous Specific Anti-Racism

BCCNM is committed to working with Indigenous Peoples and health system partners to support Indigenous-specific anti-racist practices in the health system. As the largest health regulator in Western Canada, BCCNM has the opportunity to influence the health professionals we regulate, as well as the broader health-care system, to break the cycle of racism, and improve health outcomes for Indigenous Peoples. BCCNM has pledged to become culturally safe and anti-racist, and to support the health professionals we regulate to do the same.

What we offer you

We promise to provide you with rewarding work that challenges you. You will be part of a passionate team contributing to our important mandate of protecting the public. As a member of the team, you can expect to be working in a collaborative, team-based environment, and treated in a respectful and professional manner.

The expected starting base salary for this position is $75,000 - $85,000 annually, depending on a variety of factors including qualifications and experience.

What you'll be doing:

Reporting to the Executive Director, Inspire Global Assessments, the Psychometrician supports the Inspire Global Assessment (INSPIRE) ongoing and future assessment activities. This position focuses on transforming the assessment delivery model into a fully virtual, AI-integrated platform. The psychometrician will play a key role in shaping the future of competency-based assessments through psychometric design, data analytics, and innovative test methodologies.

Key responsibilities:

Virtual, AI-Integrated Platform Responsibilities:

As a core contributor to the development of Inspire's virtual performance-based assessment tool, the Psychometrician is responsible for:

1. Leads psychometric design and analysis for immersive virtual assessments, including the development of scoring frameworks, indicator mapping, validation models, and standard setting plans.
2. Serve as the Subject Matter Expert (SME) on scoring methodology, ensuring alignment with psychometric best practices and assessment goals.
3. Develop and maintaining foundational evaluation tools
4. Collaborate with technology teams and vendors to ensure appropriate data structures, AI-enhanced scoring methods, and integration of computational psychometrics.
5. Conduct applied research and environmental scanning to support product innovation and inform decision-making.
6. Contribute to the design and refinement of quality assurance procedures, including documentation, data validation, and evaluation protocols.
7. Support product lifecycle activities, including scenario review, scoring logic alignment, pilot evaluation, and data reporting.
8. Facilitate vendor collaboration and providing psychometric oversight to maintain assessment, fidelity and fairness.
9. Contribute to cross-functional discussions on product strategy, technical feasibility, and long-term innovation opportunities.

Operational Program Responsibilities

In addition to leading the virtual platform initiative, the Psychometrician supports Inspire's ongoing operational programs:

• Conduct classical test theory (CTT) and item response theory (IRT) analyses to support item and test-level evaluation.
• Perform item analysis, reliability and validity studies, equating, and scoring evaluations for written and performance-based assessments.
• Support the design and facilitation of standard setting, item writing, and field-testing sessions in collaboration with the Assessment Developer.
• Develop psychometric documentation, technical reports, and quality assurance protocols to support transparency and decision-making.
• Manage data pipelines including data extraction, cleaning, transformation, and preparation for analysis and reporting.

Qualifications:

• Master's degree in Measurement and Evaluation, Quantitative Methods, Educational Psychology, or a closely related quantitative field; a Ph.D. is preferred. A combination of education and relevant experience may be considered.
• Minimum of 3–5 years of experience in psychometric analysis, preferably within high-stakes testing, certification, or licensure assessment environments.
• Advanced knowledge of psychometric theories and statistical modeling techniques, including Classical Test Theory (CTT), Item Response Theory (IRT), Generalizability Theory (G-Theory), Structural Equation Modeling (SEM), and Hierarchical Linear Modeling (HLM).
• Proficiency in designing and conducting statistical analyses, simulations, and psychometric research, including the generation of performance reports and technical documentation.
• Demonstrated ability to write and modify code using statistical software such as R and Python (FlexMIRT preferred); experience with SAS, SPSS, Mplus, Winsteps, BILOG, and/or PARSCALE is considered an asset. Experience with SQL for database querying is also desirable.
• Familiarity with virtual assessment platforms and AI/NLP-enhanced scoring applications is a strong asset.
• Working knowledge of generative AI (prompt engineering) and natural language processing to support assessment innovation and automation.
• Strong written and verbal communication skills, with demonstrated ability to translate technical concepts for diverse audiences.
• Proven experience in stakeholder engagement, including collaboration with internal teams, vendors, regulators, and subject matter experts; facilitation of advisory or working group discussions is an asset.
• Demonstrated project management skills, including the ability to develop analytic plans, track deliverables, and manage timelines in complex, multi-stakeholder environments.
• Strong organizational and problem-solving skills, with a demonstrated ability to work independently and collaboratively in a fast-paced, evolving environment.
• Awareness of the historical and ongoing impacts of colonization on Indigenous peoples in Canada, and familiarity with key reports and frameworks such as the Truth and Reconciliation Commission's 94 Calls to Action (2015), In Plain Sight (2020), and Reclaiming Power and Place (2019), is considered an asset.
• Demonstrated understanding of equity, diversity, inclusion, and cultural humility, particularly as they apply to assessment, health care, and regulatory practices.

How to Apply

If you are interested in this position, please apply online by July 16, 2025. This opportunity will remain posted until filled; however, priority consideration will be given to those who apply by the deadline. To see a full list of our current opportunities or to learn more about working at the BC College of Nurses & Midwives, please visit our website at Careers at BCCNM.

Collection Notice

To apply to a job posting, you need to create an online account with BCCNM. To create an online account as well apply for a job posting, you'll be asked to provide personal information.

The BC College of Nurses and Midwives (BCCNM) collects your personal information for the purposes of creating your online account as well as for recruiting, evaluating, and selecting employees. The legal authority for collecting this information is under section 26 British Columbia's Freedom of Information and Protection of Privacy Act. If you have any questions, please contact [email protected].

Please note: BCCNM no longer requires staff, contractors, board and committee members, and volunteers to provide an attestation of vaccination related to the Covid-19 pandemic.

In the event of a Public Health Order being issued, the College is committed to full compliance with all directives and guidelines set forth by the Provincial Health Officer (PHO) to ensure the safety and well-being of our employees and the community partners we work with, consistent with the duty of the College to serve and protect the public.