Do LLMs Understand Limit Order Book Dynamics?
LLMs can generate valid limit order book event sequences but fail to understand underlying dynamics, leading to biased estimates and spurious predictability
- Train an LLM on synthetic limit order book data to generate valid event sequences
- Evaluate the LLM's implicit world model using novel tests to identify potential biases
- Assess the LLM's predictability in forecasting future limit order book events
- Compare the LLM's performance with traditional models to determine its effectiveness
- Refine the LLM's training data and architecture to improve its understanding of limit order book dynamics
Quantitative traders and researchers working with limit order book data can benefit from understanding the limitations of LLMs in this context, as it affects the accuracy of their predictions and trading decisions
💡 LLMs can be biased and predictably incorrect when forecasting limit order book events due to their limited understanding of the underlying dynamics
🚨 LLMs can generate valid LOB event sequences but struggle to understand underlying dynamics 🚨
Key Takeaways
LLMs can generate valid limit order book event sequences but fail to understand underlying dynamics, leading to biased estimates and spurious predictability
Full Article
Abstract:
arXiv:2608.23706v1 Announce Type: new Abstract: A large language model (LLM) trained on synthetic limit order book (LOB) data achieves near perfect scores in generating valid sequences of LOB events. However, the LLM's implicit world model fails to learn the state of the LOB. This deficiency leads to biased estimates and spurious predictability in using the LLM to forecast future LOB events. Our analysis uses novel tests of an LLM's world model, extending prior work from deterministic settings t
Related Videos
You're 1 lesson closer to your goal
Sign in free and we'll turn this lesson into a structured roadmap — starting with ⚡30 free Sparks for your first AI explanation or skill path.
Create free account →No credit card required.
DeepCamp AI