Search by job, company or skills

Advanced Learning Company

Digital Education Assessment Specialist

new job description bg glownew job description bg glownew job description bg svg
  • Posted a day ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Digital Education Assessment Specialist

Assessment expert covering all areas of validity theory, score interpretations, scaling, linking/equating scores to recommendations reporting, forms design, IRT calibration, DIF/fairness analyses, post-release analytics (SEMs, pass-rate stability), and technical documentation.

This position ensures the reliability, fairness, and scientific rigor of all assessments across the platform.

  • Test design and scaling: developing and monitoring test forms, item banks, and equating/linking methods to maintain comparability across versions.
  • IRT calibration and analysis: calibrating large-scale item pools, conducting item-fit checks, and setting reliability targets (like SEM bands).
  • Fairness and DIF: identifying differential item functioning and applying bias-mitigation strategies to ensure equity.
  • Post-release analytics: working with active platform data to monitor score distributions, pass-rate stability, and performance drift to safeguard assessment integrity.
  • Technical documentation: preparing manuals, validity evidence reports, and partner-facing/ board-facing research summaries.
  • Collaboration: advising content authors, AI specialists, and research teams to ensure both AI-generated and human-authored materials meet psychometric standards.

Background: Advanced degree and/ or field experience in educational measurement, psychometrics, or statistics with applied experience in large-scale K-12 assessment. Proficiency in IRT software and equating methods. Strong ability to communicate complex findings in clear, bilingual reports (English and Arabic fluency is required).

More Info

Job Type:
Industry:
Employment Type:

Job ID: 143267507