Are you enthusiastic about shaping the future of education and skills-based hiring? Join our dynamic team as a Product Development Coordinator and take on a crucial role in crafting impactful assessments that drive learning and achievement. At our company, innovation and collaboration are central to our culture. As a Product Development Coordinator, you'll play a pivotal role within our assessment team, collaborating with other professionals to create cutting-edge assessments that not only meet industry standards but surpass expectations. Your ideas and creativity will be highly valued, directly influencing the growth and success of our organization. If you're eager to make a difference and be part of a tight-knit team where your talents are acknowledged and valued, we welcome you to embark on this thrilling journey with us!
The NOCTI/NBS Product Development Coordinator/Facilitator plays a vital role in facilitating the organization's customized and standardized test development activities as part of the assessment team. The role is responsible for coordinating various aspects of test development and maintenance, including organizing workshops with subject matter experts, designing test blueprints, overseeing item creation and review processes, conducting pilot tests, and managing assessment documentation. Additionally, responsibilities include coordinating subject matter experts, maintaining an item bank, understanding psychometric principles, basic data analysis, handling assessment-related customer feedback, and facilitating communication among stakeholders.
Facilitation: Organize and facilitate test development/revision workshops with groups of subject matter experts. Activities include establishing objectives, adhering to test development guidelines, guiding and tracking the development process, managing group dynamics, encouraging participation, promoting collaboration, managing time, and summarizing next steps.
Product Strategy: Collaborate with cross-functional teams to assist in prioritizing features and enhancements that contribute to product growth, based on customer feedback, research, and the target markets.
Test Design: Collaborate with Subject Matter Experts to design blueprints and assessments to ensure alignment with industry standards.
Item Writing: Oversee the creation of test items and jobs, ensuring they are clear, accurate, adhere to the NOCTI/NBS item/job development guidelines, and meet the intended difficulty level.
Item Review: Conduct thorough proofreading of test items/jobs in collaboration with subject matter experts to evaluate and revise test items based on feedback. Ensure all modifications align with established standards of validity, reliability, and fairness.
Pilot Testing: Assist in assembling tests for pilot administration to gather data on the performance of test items/jobs and overall test reliability, adjusting as necessary.
Related Product Development: Assist with the development and maintenance of related assessment learning resources.
Subject Matter Expert Coordination: Assistwiththe recruitment, management, training, and performance of high-quality subject matter experts to ensure the successful completion of projects.
Assessment Documentation: Use an assessment documentation system to track the progress of a test from its initial stages to implementation; this system enables internal stakeholders to determine the assessment's status at any given time.
Item Bank: Assist with maintaining test items/jobs in the organizational item bank.
Psychometric Basics: Have a basic understanding or familiarity of the principles of psychometrics and assessment theory and the ability to stay current with trends in assessment practices.
Data Analysis: Maintain a basic understanding of data analysis techniques that are used as part of the item revision/development processes.
Customer Feedback: Manage the customer comment database which includes entering feedback, responding to comments, and working with subject matter experts when clarification is needed.
Communication: Engage with both internal and external stakeholders to gather feedback, address inquiries, and disseminate updates regarding project progress, timelines, and objectives. Collaborate with cross-functional teams to streamline communication processes and enhance organizational efficiency.
Requirements
Bachelor degree preferred; however, a combination of relevant education and experience will be considered.
Experience in assessment development, assessment delivery, facilitation, and familiarity with psychometric principles is required.
The position is hybrid, with the majority of the work conducted remotely. There will be occasional travel required for onside assessment-related activities and travel to the Big Rapids, Michigan Headquarters for specific dates or events.
Please submit a cover letter, a current resume, and three references to hr@nocti.org by May 15, 2024.