Query Your Codebase with DeepSeek V4 and vLLM

Key Takeaways

DeepSeek-V4-Flash has a million token context window. So, let's test it out on a real developer problem. Understanding a huge GitHub repository when you don't know where to start. I'll show you how I served DeepSeek-V4-Flash with vLLM on 2 B 200s, and then use it to analyze a real GitHub repository. I'll also share the code, so you can try this workflow yourself. If you've ever joined a large code base, you know the problem. Docs help, search helps, but what you really want is a system-level explanation. Where do you request flow? Which files matter? Where would I make a change? And more. That's where being able to query the code base helps. DeepSeek-V4-Flash gives us strong reasoning, long context capabilities, and different thinking modes depending on the task. For this demo, I'm using vLLM to serve this 284 B model locally, then using that setup to analyze vLLM's own code base. The serving side is straightforward. vLLM gives me an OpenAI compatible endpoint, tensor parallelism across both GPUs, FP8 KV cache, and support for DeepSeek-V4's tokenizer and reasoning parser. Then the notebook clones the vLLM GitHub repository, packs about 80K tokens of real source context, and asks the model for an architecture map. This is where it gets useful. It explains components, the request life cycle, key abstractions, and extension points. Then I ask for more practical outputs, an entire onboarding guide, where to add a new quantization format, where sampling logic lives, and how to change batching behavior. And because DeepSeek V4 Flash supports thinking modes, I can use fast non-thinking responses for summaries, and then think high for harder questions. As you can see, the result isn't just a generic answer. It shows where to look, what to change, and what not to break. You could adopt the same pattern for code base onboarding, documentation analysis, research assistance, internal tools, or domain-specific co-pilots. That's the bigger takeaway here. This repository analysis workflow is only one example of what you can build with DeepSeek V4 Flash. Check out this VLOM demo here to take a better look at the current setup and outputs. Then swap in your own repository or own workflow, and drop a comment with what you'd want to test with DeepSeek V4.