Examination Development Process
Developing a new examination is a rigorous and labor-intensive process. It typically takes two years or longer.
We follow proven methods and widely-used practices for our certification programs, supporting ANSI/ISO 17024 accreditation for many of our specialties.
In-house test development and measurement specialists work to develop every examination with the support and influence of subject matter experts: sonographers, physicians, and medical professionals around the world.
10 steps to bring an exam to life
- New Specialty Proposal: We explore adding a new certification or specialty examination based on changes in medical imaging or a formal petition from an organization or group of medical or healthcare professionals.
- Needs Analysis Study: We conduct a survey of stakeholders to understand if there is a need and support for the new certification.
- Recommendation and Approval: If the Needs Analysis Study confirms support for a new examination, we submit a recommendation to the appropriate Governance Council for approval.
- Assessment Committee (AC): The Governance Council appoints an assessment committee of volunteer subject matter experts. The committee plays an instrumental role in the development, review and editing of test content and questions.
- Practice/Job Task Analysis: To determine the examination’s content, the committee appoints a volunteer-led taskforce to develop an extensive Practice Analysis survey. A large group of subject matter experts weigh in, helping to determine the importance, frequency, and impact of a given task for the specialty in question.We periodically conduct these analyses to ensure every exam reflects the reality of modern practice.
- Examination Content Outline Development: Based on the results of the Practice Analysis, the committee develops a content outline for the new examination.
- Item (Question) Development: Professionals practicing in the specialty train with our test development staff, then volunteer their time and expertise to write and edit items for the new examination, using the content outline as a guide. A separate group of subject matter experts reviews and edits the draft questions and determines which to include in the pilot version of the examination.
- Examination Pilot: We test the test! We offer the pilot version of the new examination over a specified period, without an immediate score.
- Standard Setting Study: Committee members and a diverse task force of other volunteer subject matter experts develop a description of the minimum knowledge, skills, and abilities a candidate needs to pass the examination. We apply this benchmark to a review of the examination pilot results to determine the passing standard. At this point, the pilot test-takers receive their final examination score.
- Examination Form Development: Based on the results of the examination pilot, standard setting study and the input from item writers and reviewers, the committee and task force members begin an ongoing cycle of creating new forms (or versions) of the examination. Forms are statistically equated to control for differences in difficulty, which usually vary from one form to another.