Mapping the Challenges of HCI: An Application and Evaluation of ChatGPT for Mining Insights at Scale

1. 1Apply a two-step approach using GPT-3.5 to extract candidate challenges from a large scholarly corpus in HCI
2. 2Use GPT-4 to refine and validate the extracted challenges
3. 3Evaluate the effectiveness of ChatGPT in extracting research challenges and identify potential limitations
4. 4Analyze the results to identify key challenges in HCI and their implications for future research

AI engineers and researchers can benefit from this study to improve the application of large language models in real-world tasks, while HCI researchers can gain insights into the challenges in their field

💡 ChatGPT can be effectively used to extract research challenges in HCI, but its effectiveness depends on the quality of the input data and the refinement of the extracted challenges

🤖 ChatGPT can be used to extract research challenges in HCI from large scholarly corpora