Psychometric Extern, Remote

Education is ever-evolving. And so are we.

We seek passionate people from diverse backgrounds who are committed to helping improve the work of schools as a trusted partner in advancing learning. By joining the Cognia team, you will be immersed in a community of energetic and resourceful people dedicated to a common vision to impact and inspire education providers to advance and enable pathways of success for all learners. At Cognia we have developed a holistic approach to education that empowers schools to create real outcomes and optimize learning for students of all backgrounds, servicing more than 36,000 institutions, 5 million teachers, and 25 million students in 85 countries. When you join Cognia, you join a team of experts passionate about our mission and embracing our core values in everything we do.

Cognia is granting up to two (2) externships (i.e., remote internships) for students working toward PhDs in appropriate graduate study programs. The primary focus of the program centers around an appropriate research project that each student chooses in consultation with Cognia psychometricians and researchers.

The externships are targeted for students whose interests focus on psychometric or measurement issues such as equating, item calibration, statistical models, response time, dimensionality issues, and scaling. For example, recent years have included projects on evaluating raters of open-response items, diagnosing student misconceptions on open-response items, modeling response time behavior, detecting unusual item response behavior in alternate assessments, detection of item parameter drift, and accuracy of routing in multistage tests.

An additional important component of the externship program is to help students gain in-depth knowledge and understanding of the daily activities of Cognia psychometricians via a series of seminars that give a systematic deep dive into our psychometric practices.

Externship Overview:

The 14-week externship program will encompass:

• A program designed around accomplishing a research project or application, eligible for submission for presentation at a national conference.
• Regular Zoom meetings with mentors around goal setting, monitoring progress, and ensuring project completion.
• A series of seminars from both Cognia psychometricians and other related groups will provide an in-depth knowledge of how psychometrics is applied in a variety of ways in the educational testing industry. A significant proportion of these seminars will occur during a one-week in-person visit to Cognia offices in Portsmouth, NH.
• Externs would work on projects about 20 hours per week (some weeks more, some less).
• Externs will be provided with access to all needed psychometric resources by use of FTP sites or by use of a Cognia laptop.

Dates, Locations, and Compensation:

The 2025 Cognia Externship is a primarily remote program, apart from the 'Extern Festival Week' during which externs will travel to Cognia's offices in New Hampshire for a few days to engage in seminars, presentations, and in-person networking with each other and Cognia personnel.

Dates:

• Application Deadline: December 8th, 2024
• Decision date: On or before January 17th, 2025
• Externship starts February 3rd, 2025. The duration is 14 weeks with an end date of May 9th, 2025
• Extern Festival Week: One week duration sometime in March or April 2025 when externs travel to Cognia offices for in-person networking and seminars. Exact dates to be determined based on extern availability.

Compensation:

• The full compensation package includes a stipend, as well as transportation, accommodation, and meals during the Extern Festival Week.
• Stipend: $7000

Applications:

Who should apply?

Candidates enrolled in a psychometric, educational measurement, or other related doctoral program at a fully accredited university/college in the United States are encouraged to apply.

Eligibility Requirements:

• Current enrollment in a relevant doctoral program.
• Completion of at least 2 years of coursework toward the doctorate prior to the internship program start date.
• Currently residing in the United States.

What to include in the application:

Applications to the Externship program should include (1) a resume or CV and (2) a cover letter.

The cover letter should include a description of your research interests, which could include topics you have some experience with but could also describe research interests you have not yet had the opportunity to pursue. Descriptions of some projects of interest to Cognia are listed below for reference. You are also encouraged to describe any of your own research interests as we are open to a variety of projects.

Incomplete applications will not be considered.

Project Descriptions:

For the 2025 Cognia Externship program, our psychometrics team has special interests for research in the following areas:

• Application and research around generative AI. Projects in this area might include, but are not limited to:
  1. Using AI to generate responses to new test items.
  2. Evaluation of alignment between item content and performance standards.
  3. Item alignment with performance level descriptors to inform evaluation of the performance level descriptors.
• Aberrant Response Analyses: Using innovative methods to analyze large-scale response data to detect and flag unusual responses or response patterns at the individual and/or group level.
• Technology Enhanced Items (TEI): Projects in this area might include investigation of misfitting TEI items and modelling of these items.
• Research that could use a combination of quantitative and qualitative methods. Topics could include research related to cognitive processes (use of Think-Aloud Protocols and/or interviews), standard setting (alignment to performance expectations), and/or technology-enhanced items and their paper equivalents.

If one or more of the projects above align with your interests, indicate in your cover letter which project(s) and provide some additional details about why you are interested in the project(s) or how you feel you can contribute.

Note: Applicants are NOT required to select any of the above projects. If none interest you, please use your cover letter to describe any other research interests you might have.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy-related conditions), sexual orientation, gender identity, marital status, national origin, age, physical or mental disability, citizenship, protected veteran status, genetic information or any other characteristics protected by local, state, or federal laws, rules, or regulations. Cognia is an Equal Opportunity Employer, and is committed to Diversity, Equity, and Inclusion.