Understanding the Role of Temperature in Diverse Question Generation by GPT-4

Authors:
  • AAArav Agarwal
    Arav Agarwal
  • KMKarthik Mittal
    Karthik Mittal
  • ADAidan Doyle
    Aidan Doyle
  • PSPragnya Sridhar
    Pragnya Sridhar
  • ZWZipiao Wan
    Zipiao Wan
  • JDJacob Arthur Doughty
    Jacob Arthur Doughty
  • JSJaromir Savelka
    Jaromir Savelka
  • MSMajd Sakr
    Majd Sakr

Abstract
We conduct a preliminary study of the effect of GPT's temperature parameter on the diversity of GPT4-generated questions. We find that using higher temperature values leads to significantly higher diversity, with different temperatures exposing different types of similarity between generated sets of questions. We also demonstrate that diverse question generation is especially difficult for questions targeting lower levels of Bloom's Taxonomy.
All Related Versions