Summary

The Psychometrician supports a range of activities from the establishment of scoring methodologies and design of assessment instruments to the analysis of items, and production of results and statistical data.

Description

Status: Regular, Full-Time

Number of Positions: 1

Work Location:  Vancouver, BC. – Hybrid (a combination of in-office and remote work)

Salary: $75,000 – $85,000 per annum

Expected Start Date: January 2024

Is your superpower being able to analyze towers of measurement data at a single glance? Are you keen to dive deep into the workings of new and complex testing approaches? If so, consider bringing your talents to the Nursing Community Assessment Service (NCAS)!

Who we are

The Nursing Community Assessment Service (NCAS) is a branded service of the BC College of Nurses and Midwives. We’re working with nursing regulators and governments across the country to address the acute nursing shortage. NCAS is a unique assessment service that is helping to streamline the entry of internationally educated nurses into the Canadian health care workforce by determining the extent to which an applicant meets the standards necessary for safe practice in Canada.  Learn more at www.ncasbc.ca,

BCCNM is empowered under the Health Professions Act to regulate the practice of all licensed practical nurses, nurse practitioners, registered midwives, registered nurses, and registered psychiatric nurses in British Columbia. Regulation helps to protect the public by ensuring that professional care or service received by the public is competent, ethical, and meets the standards that society views as acceptable.

As western Canada’s largest health profession regulator, we believe a diverse and inclusive team enriches our efforts to protect the public. We welcome applications from all who reflect the communities we serve, and especially encourage Indigenous Peoples and members of equity-seeking groups to apply. We believe diverse perspectives and experiences bring both innovation and better outcomes to the work we do and the decisions we make.

What you’ll be doing

Reporting to the Manager of Assessment and Psychometrics (MAP), the Psychometrician supports the Nursing Community Assessment Services (NCAS) ongoing and future assessment activities including those related to BCCNM’s broader examination assessment needs.  The position focuses on providing psychometric expertise to the continuous refinement and evolution of NCAS’ multi-pronged triple track assessment. The Psychometrician supports a range of activities from the establishment of scoring methodologies and design of assessment instruments to the analysis of items, and production of results and statistical data.

​Key responsibilities include:

  • Lead the development, refinement and analysis of performance assessment instruments conventional test methodologies, standard setting and validation activities associated with the assessment of nursing competencies.
  • Participate and collaborate in the scoring, development of blueprints, case development, modification, and field-testing activities.
  • Generate performance reports with associate, perform quality checks, and provide results to key stakeholders (written or verbally)
  • Interface with multiple stakeholders and technology providers to ensure accurate and seamless data flows.
  • Create and implement quality-control procedures for scoring.
  • Database management and monitoring of item exposure rates and statistical anomalies.
  • Develop, implement and evaluate standard-setting and product-improvement processes, including the facilitation of discussions with subject matter experts and stakeholders.
  • Provide psychometric consultation and help problem solve in support of the ongoing assessment operations and new assessment builds, including using IRT, item analysis, forms construction and equating, reliability and validity analyses, etc.
  • Work closely with the MAP to conduct analysis in support of content development and quality assurance.
  • Work closely with the Assessment Developer to monitor and maintain item banks and its content.
  • Maintain and/or provide oversight of testing platforms, vendors and databases.
  • Develop documentation to support assessment infrastructure along with public and technical reports on the assessments.
  • Identify and carry out independent research in support of assessment activities.
  • Work to integrate AI and intelligent algorithms capable of learning, analyzing and predicting future events on tasks, virtual performance-based assessments, and of using Computational Psychometrics to enhance the organization’s products.
  • Present research findings, represent the organization and share innovations at professional conferences and/or through publication of research articles.
  • Foster and maintain an organizational culture that promotes mutual respect, teamwork, and service excellence. Supports the mentorship of new staff and furthers their understanding of assessments and psychometrics.

Your education & skills 

  • A Master’s degree but preferred Ph.D. in Measurement and Evaluation, Cognitive, Quantitative or Industrial/Organizational Psychology (with a concentration in Psychometrics), statistics or educational equivalent in a closely related quantitative field.
  • At least five years of experience in an applied measurement or statistical analysis environment.
  • At least three to five years in designing and conducting psychometric analysis in a test environment.
  • Expertise with a variety of statistical models used in testing (eg: classical test theory, generalizability theory, factor analysis, HLM, norms development, and item response theory)
  • Competence in the use of advanced statistical analysis and data visualization software and programming languages (SAS, SPSS, Mplus, Winsteps, BILOG and/or PARSCALE, PowerBi; Programming languages: Python and R (preferred) and the ability to retrieve data from databases (SQL required).
  • Familiarity with professional testing standards (e.g., ISO 17024, NCCA, Joint Technical Standards, ITC Guidelines, INACSL, and the Standards for Educational & Psychological Testing)
  • Very strong inter-personal and communication skills, and preferably group facilitation experience
  • Experience managing testing programs with small to medium volumes.
  • Demonstrated project management skills.
  • Exceptional research skills and a curiosity for staying current with the field of assessment.
  • Demonstrated initiative-taker, with strong organizational skills and the ability to meet deadlines.
  • Demonstrated ability to prepare analytic plans, monitor progress, and track timelines.
  • Highly collaborative, with strong interpersonal skills to work with various stakeholders in the assessment development and reporting process.
  • Ability to work independently and collaboratively within a team.
  • Demonstrated ability to prepare effective visual presentations of complex data.
  • Ability to thrive and take initiative in an environment of ambiguity and change.
  • A passion for doing meaningful work that will make a significant difference to the lives of nursing professionals globally.
  • Demonstrated understanding of diversity, inclusion, and cultural humility as they apply to nursing and midwifery practice and health care is an asset.

How to Apply

If you are interested in this position, please apply online. This opportunity will remain posted until filled; interviews will be scheduled to begin January 2024. To see a full list of our current opportunities or to learn more about working at the BC College of Nurses & Midwives, please visit our website at Careers at BCCNM.

Note: References, education and professional credential verifications, and a criminal record check will be required for all final candidates. 

To learn more about NCAS, please visit www.ncasbc.ca. Thank you for your interest in NCAS and the BC College of Nurses and Midwives To learn more about BCCNM, visit www.bccnm.ca