OptiMind: Teaching small language models to think like optimization experts

Key Takeaways

Optimization problems usually start in plain language. Notes, constraints, and ideas written by humans. Turning those into clean, solverready math is often the hardest part. I have the pleasure of working with closely our next speaker Shinshi, a research intern at MSR Redmond and a PhD student at the University of Washington. She will introduce Optim, a specialized language model designed to close that gap by translating natural language problem descriptions directly into formal optimization models. This work pushes the state-of-the-art in AI reasoning while also improving reliability in systems where correctness really matters. Let's dive into the details and new capabilities of Optim. Hi everyone, I'm Shinu, a research intern in the machine learning and optimization group here at Microsoft research and a PhD student at the University of Washington. Optimization is the engine behind the world's most critical systems from global supply chains to logistics planning and vehicle routing. Today I want to introduce Optim, which is our new 20 billion parameter reasoning model designed to translate natural language problems into a mixed integer linear programming formulations and a corresponding solver code. Essentially, it acts like an operations research expert to solve complex tasks in real life. In this project, which was a collaboration with the amazing MLO team here at Microsoft Research, we made two core contributions. First, we develop a way to clean up incredibly noisy optimization data using the expert knowledge. And second, we train a small model that matches the frontier level performance. The task of optim works as follows. A user describes in natural language a problem that involves some decisions that should be optimized. For example, please provide me an optimal production plan to maximize the profits across 6 months given the specific capacity constraints. And the role of the language model is to generate the mathematical formulation corresponding to the problem and in the form of an executable solver code so that the user could run and get an optimal solution. And when we inspect the existing data sets and benchmarks in this domain, we found severe data quality issues. This applies to both the training data set and the benchmarks used for testing. And in fact, we saw some training sets with up to 50% of the problematic instances which include missing constraints, ambiguous descriptions or wrong solutions. While we could manually clean the test benchmarks to ensure rigorous evaluations, fixing the massive training set is much more difficult. Training on the dirty data was like teaching a student with a textbook full of mistakes. So the first research question became with such noisy data, how can we still train a competitive and reliable model? To solve this, we started by analyzing how models fail when answering the training questions. We notice that within specific optimization classes, models make the same structural mistakes repeatedly. Take the traveling salesman problem as an example. Models consistently mishandle the subour elimination constraints. Specifically, they often incorrectly apply the constraints to the starting node and the result this generates infeasible and disconnected loops instead of one continuous route. However, we found that if we add specific hints that could explicitly instruct the model how to handle the starting node, it will fix the logic. The model will follow the hint and generate a correct and feasible formulation. And this gave us a key insight. We don't need to manually fix every data point and instead our experts can identify these failure modes and write a library of expert hints. And think of the hints as a guard rail. Simple instructions like enforcing flow conservation or setting the big M number as the maximum variable instead of a fixed number will warn the model about these specific pitfalls before even starts generating the solution. So we utilize the hints in two workflows. First for data cleaning. We first classify the noisy training data and pair it with the specific hint. We then feed this to a teacher model which uses the hint to reason correctly and regenerate a clean solution. And finally apply majority voting to ensure robustness. This use a rigorous and expert quality data set with minimum human intervention. We then use this clean data to supervise fine-tune our base model which is GPTOSS 20 billion. And crucially we repeat this pipeline at inference time. When the user query comes in, we first classify the problem type by identifying it for example as a traveling salesman problem. We then retrieve the specific expert hint and fit it with both the user's question and the hint um into our model to solve the problem. And if the compute budget allows, we go a step further. We utilize the error messages from the solver to perform the multi-turn selfcorrection, ensuring the final code is executable and valid. So our results are very compelling on the clean benchmarks industry o memo complex and ops mass optim consistently outperform the other open source reasoning models under 32 billion parameters by at least 10%. And when we compare against frontier models like GPT5 and 04 mini, we see that with just five tons of cell correction, we match their performance and sometimes even outperform them. And remember, we achieving this frontier level performance with only 20 billion parameters. The small scale of a model is also critical for local deployments. It allows organizations to keep sensitive supply chain data privately on their own GPUs and it makes the research reproducible and accessible for the community. So to summarize, we prove that you can train a competitive domain specific model starting from the noisy data by first distilling expert knowledge into reusable hints. And we believe that applying optimization in industrial practice should be a community effort. So we have open source our model the clean benchmarks and our examples of expert hints so the others can built on top of optim and looking ahead we're also working on fully automated pipelines using frontier models so this approach can easily adapt to new areas such as cloud efficiency calendar scheduling urban planning and more. While we focus on standard optimization families, we hope the community will use our methods to explore new and less standard optimization domains. So, I would like to thank all of you for tuning into this talk. Here are some resources if you're interested to learn more about this project and start using the models.