OpenAI Interest Groups

AI in Higher Education

Caltech CTME & Goldhirsh Foundation

Caltech CTME AI Strategy & AI Executive in Residence @ Caltech CTME & Goldhirsh Foundation

Wharton

Executive MBA Student @ Wharton

Stanford University

Director of Clinical Pathology Informatics @ Stanford University

OpenAI

Human Data / Forum Community Ambassador @ OpenAI

Fiserv

OpenAI Forum Leader | Project Management Advisor – Data Commerce Solutions, Fiserv @ Fiserv

CUNY

Lecturer @ CUNY

Harvard Business School

Student @ Harvard Business School

Professor @ Harvard Business School

Education GTM @ OpenAI

NYU Stern School of Business

Chief AI Architect @ NYU Stern School of Business

We've all seen the research that tests whether AI can pass various exams, but we can genAI make high-quality exam questions for our students? 

In our 

 we demonstrate how to use GPT-4 to generate single-best-answer questions for medical student assessment, using course Learning Outcomes and best-practice guidance. We tested these AI-generated questions alongside human-authored ones and revealed no difference in terms of facility or discrimination index. But beware! We detected some hallucinations; around 30% of questions generated were unusable.



Ahmed, A., Kerr, E. & O’Malley, A. Quality assurance and validity of AI-generated single best answer questions. 

, 300 (2025). https://doi.org/10.1186/s12909-025-06881-w

We also used this research to build a Custom GPT

, so you can create SBA questions based on your Learning Outcomes. I hope you find this useful! Let me know if you have any feedback or use case.

Using genAI to create exam questions

The OpenAI Forum connects members to discuss AGI’s future through events, webinars, and networking. The community aims to help us achieve our mission of building AGI that benefits all of humanity.

OpenAI Forum

Job Title

Login to the OpenAI Forum community to connect with others, attend community events, and more!

Login or Sign Up for even more

To unlock all parts of the community and get the best experience, complete your profile.