The College Board, the national educational organization, is conducting a search for a Assistant/Associate Psychometrician to work in the Psychometrics department. This position will be based out of our Newtown Office Yardley, PA office. About the College Board We are a mission-focused, not-for-profit membership organization that believes in promoting innovation, equity, and excellence for generations of students. Our members include more than 6,000 of the world's leading colleges, schools, and other educational organizations. We have over 1,900 employees in 13 offices across the U.S. and Puerto Rico. We are advocates for children and parents; we empower teachers and educators, and we are a strong presence in thousands of schools and communities across the country through programs and services - the SAT, Advanced Placement (AP®) and Pre-AP are just a few. Our work falls broadly into four categories: College Readiness, College Connection & Success, Student Opportunities, and Advocacy. About the Role The Assistant/Associate Psychometrician will provide psychometric support to College Board programs, specifically focusing on supporting the CLEP program. Psychometric support could include production of item and test analysis reports using both classical and item response theory models, test security analyses, performing item pool equating, form assembly, standard setting, and production of test documentation materials. The Assistant/Associate Psychometrician may also design, conduct, and manage research efforts to support various projects related to the support of CLEP or other CB programs, and will work closely with other Psychometric staff and IT to develop systems related to various College Board assessments. Responsibilities of the role
Provide psychometric support to College Board programs, including production of item and test analysis reports using both classical and item response theory models, test security analyses, supporting state level contracts and other general psychometric support. Perform equating, linking, scaling, standard setting and other psychometric analyses, using standard and customized psychometric analysis tools and statistical software packages. Manage test analysis processes to ensure the quality and accuracy of results.
Design, conduct, and/or manage research projects to support College Board programs and/or to support state initiatives.
Design, program, document and implement statistical and reporting systems. Design, develop and document technical and operating procedures.
Write and/or review technical and research reports involving psychometric analyses, test validity, and reliability.
Respond to requests for data and data interpretation.
Work collaboratively with program leads to sustain current programs and develop new initiatives.
Work collaboratively with committees (e.g. exam committees and technical advisory committees).
Participate in discussions, and contribute to the research, development and evaluation of the potential effects of changes in programs, including new testing modes and item types.
Prepare memos, presentations, and research reports for both internal and external audiences to explain research results.
Contribute to the profession through articles, presentations, seminars and participation in professional organizations.
Contribute to the improvement of current processes (e.g. shorter cycle time, reduced costs, greater customer satisfaction and quality control).
Qualifications needed for the role
Doctorate in psychometrics, educational research, educational measurement or a related field is required. New PhD level applicants will be considered, as will applicants with additional experience. A minimum of 3 years relevant experience is required for the Associate level.
Demonstrated ability to work collaboratively with colleagues of various professional backgrounds.
Experience in working with large datasets and assessment data.
Demonstrated ability to design and conduct research studies and complex statistical analyses.
Expertise with classical test theory and item response theory is required, as is experience with statistical analysis software (e.g., SAS, SPSS, BILOG, FLEXMirt, WINSTEPS, and PARSCALE).
Excellent verbal and written communications skills, including technical presentation, public speaking, interpersonal, and writing and editing skills
Preferred skills for the role
Excellent organizational, managerial and consultation skills.
Ability to work on several projects simultaneously.
Excellent time management skills.
Strict attention to detail and extreme accuracy.
Benefits We offer an outstanding benefits package that includes up to four weeks of paid time off each year, comprehensive health insurance, a generous retirement savings plan, tuition reimbursement, ongoing professional development and training, and more. Mission Our mission is to clear a path for all students to own their future. EEOC statement College Board is proud to be an equal opportunity employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.