DATA REQUESTS & RESEARCH COLLABORATIONS

NBME collects valuable data and insights through the administration of our assessments and the work of our research teams. To augment the use of these findings, NBME and the USMLE collaborate with national groups conducting research that advances medical education and measurement. 

Because research collaborations are resource-intensive, we typically only enter into these collaborations with national groups and organizations that contribute significant data and methodologic expertise to enhance understanding of topics aligned with our relevant mission, vision, and values. Visit the About NBME page and USMLE.org to learn more. 

These arrangements are expected to involve active collaboration between researchers from NBME and one or more other organizations. Because of this, NBME and the USMLE are unlikely to support data-sharing requests for studies that have the following characteristics: 

• Lacks simultaneous sharing of substantive national-level data 
• Proposes collaboration with individuals or small groups of individual researchers
• Focuses on a single institution or specific residency specialty
• Overlaps substantially with existing research collaborations
• Proposes research with insufficient methodologic rigor (e.g., does not account for nested data structure). 
• Requests data inconsistent with relevant NBME or USMLE policies/principles outlined by governance (e.g., centered on unapproved secondary uses, requesting data not available to score users such as Step 1 scores, methods that allow for unintended identification of persons or institutions).

Process for Requesting Research Collaboration

NBME’s Office of Research Strategy uses an online submission process to evaluate research collaboration proposals utilizing NBME or USMLE-owned data for research purposes. Each proposal is evaluated by NBME Research and Programmatic Staff.

For efficiency in evaluating the research collaboration proposal, please include a detailed study design in your submission which includes the following elements:    

• The purpose of the study and specific research questions or hypotheses
• A study timeline, including all major milestones
• The data variables needed for the research
• The proposed analyses
• The importance, value, or implications of the research, and plans for disseminating results
• All members of the research team, along with their titles, and affiliations
• A statement of each team members role in the study as well as NBME’s proposed role in the research collaboration

Generally, research collaboration proposals are evaluated, and a decision communicated, within 10 business days. Complex proposals or those involving multiple organizations may require additional time to review and/or additional correspondence between the requestor and NBME. Although NBME will facilitate such discussions, it is the requestor’s responsibility to anticipate such needs to allow time for such discussions. Approved research collaborations and data sharing requests will be required to comply with NBME data security requirements. Please contact ors@nbme.org if you have questions.