Automated Coding of Communication Data Using ChatGPT: Consistency Across Subgroups

arXiv:2510.20584v3 Announce Type: replace-cross Abstract: Assessing communication and collaboration at scale depends on a labor-intensive task of coding communication data into categories according to different frameworks. Prior research has established that ChatGPT can be directly instructed with coding rubrics to code the communication data and achieves accuracy comparable to human raters. However, whether the coding from ChatGPT or similar AI technology perform consistently across different d