Human vs Machine Mathematical Difficulty on Project Euler: An Experimental Analysis

1. 1Collect a dataset of human and AI attempts on mathematical problems using platforms like Project Euler
2. 2Measure problem difficulty using metrics like human solve times
3. 3Test a power-law relation between AI effort and human difficulty
4. 4Analyze the success probability of AI systems across different problem difficulties
5. 5Configure and run experiments to validate the findings

Data scientists and AI engineers on a team can benefit from understanding the limitations and potential of AI systems in solving mathematical problems, informing the development of more effective AI models

💡 AI systems' effort and success probability follow a power-law relation with human difficulty, revealing potential limitations and areas for improvement

💡 AI systems' success probability scales with human difficulty on math problems #AI #Math