Hedging and Non-Affirmation: Quantifying LLM Alignment on Questions of Human Rights

1. 1Develop a systematic framework to measure hedging and non-affirmation in LLM responses
2. 2Evaluate LLM responses regarding various identity groups
3. 3Quantify the degree of hedging and non-affirmation in LLM responses
4. 4Analyze the results to identify areas for improvement in LLM alignment with human rights

AI researchers and engineers working on LLMs can benefit from this framework to improve model alignment with human values, while data scientists and analysts can apply the findings to evaluate model performance

💡 Hedging and non-affirmation behaviors in LLMs can limit clear endorsement of human rights statements, and a systematic framework is needed to measure and improve model alignment

💡 New framework to quantify hedging & non-affirmation in LLMs on human rights questions