CresOWLve: Benchmarking Creative Problem-Solving Over Real-World Knowledge

1. 1Identify the limitations of existing benchmarks for LLMs
2. 2Develop a benchmark that evaluates creative problem-solving over real-world knowledge
3. 3Use CresOWLve to assess the performance of LLMs in combining logical reasoning, lateral thinking, analogy-making, and commonsense knowledge
4. 4Apply the insights from CresOWLve to improve the creative problem-solving capabilities of LLMs

AI researchers and engineers benefit from this benchmark as it evaluates the creative problem-solving capabilities of LLMs, while product managers can use it to assess the potential of LLMs in real-world applications

💡 CresOWLve provides a comprehensive evaluation of LLMs' creative problem-solving abilities, going beyond traditional benchmarks

🤖 CresOWLve: A new benchmark for creative problem-solving in LLMs using real-world knowledge