Director I, AP Computer Science Principles Curriculum and Assessment

Job Description

Director I, AP Computer Science Principles Curriculum and Assessment

College Board - AP&I

Location: This is a remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). All CB employees are required to occasionally travel to meet in person for business purposes.

Role Type: This is a full-time position

About the Team

The AP Curriculum and Assessment Team at College Board (125+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 43 courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level. AP’s course teams comprised of educators and disciplinary experts ensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills. AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhance assessment creation and exam analysis. The Math, Computer Science, and Cybersecurity department, which includes precalculus, calculus, statistics, computer science, cybersecurity, and networking is currently comprised of approximately 22 people supporting 6 courses in the AP portfolio.

About the Opportunity

As the Director I, AP Computer Science Principles you will be responsible for preserving and improving the quality and validity of the AP Program’s core deliverables within the subject domain: the exam, the course curriculum, and the professional development content. You are also responsible for item development and management from authoring to administration; training and collaborating with subject-matter experts (SMEs), typically college professors and secondary school teachers. You will ethically and effectively integrate AI technologies in assessment creation and review. This includes judiciously using AI assisted tools to support fairness, validity, and innovation in AP assessments. You will train SMEs on assessment development protocols, translate between academics and technical experts (psychometricians), and collaborate to develop formative assessment materials and resources to support AP Computer Science Principles teachers worldwide. You will serve as a point of contact in AP for committees and communities of subject-matter experts and will be responsible for the curriculum and assessment for AP Computer Science Principles, and, in partnership with other AP teams, further the strategic growth of AP Computer Science Principles across the globe. Additionally, you may have the opportunity to present, speak, and moderate dialogue with academic and membership audiences to ensure that ongoing change and improvement within AP courses and exams is understood, accepted, and supported in secondary and post-secondary educational communities.  

In this role, you will:

Assessment Development and Scoring (45-75%) 

- Serve as an assessment leader for AP Computer Science Principles, with primary responsibility for assessment development for AP Computer Science Principles.

- In partnership with and with support from your manager, lead processes for authoring and revising assessment content, including training educator constituents. Leverages generative AI (as appropriate for subject/discipline) to author and/or review assessment content to improve and/or make more efficient assessment processes and outputs.

- In partnership with and with support from your manager, lead the development and management of assessment content (formative and summative) and scoring materials for AP Computer Science Principles through iterative review stages with multiple internal and external stakeholders, including the AP Computer Science Principles Team, Assessment Production team, Test Development Committee, and the Chief Reader, as appropriate.

- In partnership with and with support from your manager, lead the development of assessment forms for AP Computer Science Principles, ensuring the AP Exam development aligns with approved curricula and test specifications.

- Facilitate (with support from your manager and/or other team members) multiple face-to-face, weekend meetings, and virtual meetings (during work week, evenings, or weekends) annually with the AP Computer Science Principles Test Development Committee.

- Train and directly supervise Test Development Committee members in AP Computer Science Principles as content development contributors and reviewers. With support from your manager, you strategize and develop an agenda and approach to ensure the committee’s meeting time is of the highest productivity; you successfully adapt and pivot during the meeting as needed; and you successfully resolve all post-meeting item content edits. Recruit educators for the AP Computer Science Principles Development Committee and other opportunities to support AP Program.

- Facilitate (with support from your manager and/or other team members) the successful scoring of student responses for AP Computer Science Principles Exams at the annual scoring event in person and online-the “AP Reading”-and produce AP Reading publications materials for teacher and student use. In partnership with and with support from your manager, you plan all-year, with increasing intensity in the months leading up to the Reading, ensuring all workflow steps for this incredibly complex event, as well as all post-Reading activities, are accounted for and successfully executed.

Assessment Quality and Process (10-20%)

- Contribute to current research and best practices in assessment, and engage regularly with AP Curriculum & Assessment colleagues to align on standards and shared principles guiding AP’s assessment directions

- Support assessment workstreams within the AP Math, Computer Science, and Cybersecurity.

- Contribute to processes for efficient, high-quality assessment development.

- Contribute to initiatives to refine and improve question task models as well as exam design in collaboration with AP Curriculum & Assessment leaders and aligned to other College Board initiatives to achieve psychometric and disciplinary best practices on AP Computer Science Principles exams.

- Monitor exam validity, security, reliability, fairness, and quality, as well as reader reliability in accordance with established Program thresholds for AP Computer Science Principles exam, identifying areas for improvement.

- Collaborate with psychometrics and AP Curriculum & Assessment staff to establish fair, reliable, and valid cut scores for AP Computer Science Principles exam.

Course Development, Program Support, and Stakeholder Engagement (5-25%)

- Refine and improve AP Computer Science Principles Course Framework to ensure clear and explicit learning outcomes that align with strategic priorities, including ensuring college/disciplinary standards as well as expanding the scope of reaching a broader audience of AP students.

- Collaborate with AP teams to support the development of new products for AP Computer Science Principles designed to address unmet teacher instructional needs, potentially including developing prototypes, participating in small-scale market-testing, and creating models for subsequent development in conjunction with other AP workstreams. 

- Recruit educators for the AP Computer Science Principles Development Committee and other opportunities to support AP Program.

- Serve as a recognized and trusted resource within the educator community by collaboration and engagement with the community to drive teacher satisfaction with AP Computer Science Principles and its exam.

- Collaborate with the AP Professional learning team to support AP Computer Science Principles consultants and teachers.

- Work with the AP Higher Education team to co-develop and implement plans to raise college and university awareness of AP Computer Science Principles courses and exams, including recruiting college faculty to participate in the AP Reading, co-leading the planning and execution of discipline-specific AP Faculty Colloquia events, and supporting Visiting and Virtual Fellows Programs. 

About You
You (have):

- A Master’s degree in Computer Science or a directly related discipline, and knowledge of current trends in the discipline (required), although a doctorate in the discipline is strongly preferred

- Expertise in Computer Science Principles with at least 5 years of experience in standardized assessment development or related work; experience with digital assessment and teaching preferred

- Strong oral and written communication skills, with solid technical proficiency and a customer-focused mindset

- Excellent organizational and planning skills, with the ability to manage multiple tasks and maintain close attention to detail, including proofreading

- Demonstrated ability to implement processes and procedures, manage project plans and schedules, and maintain tracking documentation

- Strong interpersonal and collaboration skills, with the ability to work effectively across all levels, and engage in giving and receiving constructive feedback

- Ability to travel 6-8 times per year, plus up to two additional weeks for the AP Reading; must be eligible to work in the United States

All roles at College Board require:

- A passion for expanding educational and career opportunities and mission-driven work

- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.

- Clear and concise communication skills, written and verbal

- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.

- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.

- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success

- Authorization to work in the United States

About Our Process

- Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.

- While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.

What We Offer

At College Board, we offer more than a paycheck: we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.

A Thoughtful Approach to Compensation

- The hiring range for this role is $96,000-$135,000.

- Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.

- We aim to make our best offer upfront, rooted in fairness, transparency, and market data.

- We adjust salaries by location to ensure fairness, no matter where you live.

You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more.

#LI-REMOTE
#LI-AP1

REQ002843