Back to deep dives

Poolside’s Model Factory, Laguna S, Open Models, and the Race to AGI — Eiso Kant, Poolside AI

  • Agents
  • Open Models
  • AI Infrastructure, Compute, Chips, And Energy
  • Frontier Models And Capabilities
Thumbnail for Poolside’s Model Factory, Laguna S, Open Models, and the Race to AGI — Eiso Kant, Poolside AI
Image: Latent Space

Audio deep dive

Listen to this deep dive

Spotify

IntroductionSection 01

This Recap covers Latent Space’s YouTube interview with Eiso Kant, co-founder of Poolside, an AI lab building models for long, complex coding work; a Baseten interview and Poolside’s own releases add supporting detail. The company recently launched Laguna S 2.1, a coding model released with open weights and designed to reason through difficult tasks over many steps. In the interview, Kant explains the Model Factory—the data, training, evaluation, and engineering system behind Poolside’s models—and Poolside’s philosophy of model building, shaped by years of doing the work. His argument is that open research should share how the factory works and why it was built that way, not just the finished weights and benchmarks.

Eiso Kant founded Poolside after his first code-model startup failedSource4:55

You blew $12 million of investors’ money, which was a lot back then. Yep. You spent years with a group of 40 people obsessing over this problem. Life took a different turn, and family became a focus. I kept my head down. Really, frankly, didn’t really look at language models for the following two years—big mistake. And then ChatGPT came out, and it was like a vindication. People started texting me. I found my old work decks, and throughout that whole journey we had a strong point of view: as you’re building more capable intelligence, it should be open.

Kant traces Poolside back to Sourced, his earlier open-source code-model company. After that company failed, ChatGPT’s release renewed his belief that increasingly capable AI should be open.

  • Sourced spent $12 million and kept about 40 people focused on code models for several years.
  • Kant stepped away from language models for two years before ChatGPT’s release brought him back.
  • He says Poolside made openness part of its mission while the company was still small.
  • Kant says that choice would have become harder after the company accumulated more capital and expectations.

Open model weights do not explain how the model was builtSource11:38

The work you put out is, I think, some of the best. Every few months, you get not only frontier models but also breakdown, blog, paper, technical report. You’re filling that gap too: not only open weight, not Western, but also pretty open research. I appreciate it. I think it’s actually the most meaningful contribution. Weights are a binary; let’s call them what they are. Yes, we can modify them; we can change them. But giving someone the weights does not allow them ultimately to recreate what you’re doing. There’s challenges around releasing data sets, challenges around releasing certain things, but being able to share your research: how did we do it? What are the lessons we learned that we spent tens of thousands of experiments of compute on? I think very much so.

Downloadable weights let people modify a model but do not show how to recreate it, Kant says. Research reports can expose the experiments, data choices, and engineering lessons behind the weights.

  • Poolside built its first training codebase without forking another open-source system.
  • Model releases now take weeks instead of the three years required for Poolside’s first model, according to Kant.
  • Poolside’s supporting release says its weights can be fine-tuned, quantized, and served.
  • Funding expensive training while giving weights away remains an unresolved business problem.

Poolside says model building is 90% engineeringSource17:55

Model building is ultimately 90% engineering. And I think we all know it in the industry, because if you look at where every researcher is spending their time, they’re spending their time writing code, looking at data, and writing code. The state 3 years ago was bash scripts and Slurm and spaghetti code bases for training and data pipelines that were patched together. Ultimately, model building is a process. You’re going from raw data—pre-training raw material, the web, etc. You’re doing a whole bunch of filtering, cleaning, transformations, analyzing. These days that’s far more complex than it was 3 years ago.

Poolside’s Model Factory turns research ideas into traceable experiments and results. Researchers spend much of their time inspecting data and writing code, which is why Kant calls model building 90% engineering.

  • The process covers data preparation, distributed training, post-training, reinforcement learning, and evaluation.
  • Poolside represents experiments as code and can trace data back to its source and code version.
  • Its reinforcement-learning system evaluates checkpoints on sandboxed coding tasks while training continues in parallel.

Laguna S uses persistent reasoning to solve difficult tasksSource38:54

It’s just incredibly persistent. It reasons a lot. I do call that out. We have work to do on making it more efficient. We have work to do on offering different reasoning modes. But this is the model that has been able to do things that I never thought it could do. 118 billion, 8B active model, which is not that large. It fits on a DGX Spark and still runs at 30, 40 tokens a second on a Spark. Is able to solve Erdos 397 independently. It’s able to do complex programming tasks. I asked it this morning to make me a Wi-Fi scanner without using any external libraries on my Mac. And it’s figuring out the core WLAN API by really persistently trying to understand it without access to the internet.

Laguna S solves difficult tasks by checking its work, backtracking, and trying again, Kant says. Poolside’s supporting releases give its architecture, benchmarks, limits, and early usage figures.

  • Laguna S has 118 billion total parameters but activates 8 billion for each token.
  • That persistence helps with mathematics, programming, research, and documentation checks.
  • Poolside also says the model can think for too long without progress and needs better effort controls.
  • OpenRouter traffic was approaching 250 billion tokens that day, Poolside reported, without claiming unique users or revenue.

Poolside wants one continuous training curriculumSource49:00

Mid-training is essentially a two-stage curriculum on the web because we do not have the compute to try to ablate the perfect curriculum. Ultimately, we’re trying to assign a curriculum to the web data that we have to allow the model to learn better.

Model development should become one continuous curriculum instead of several separate training phases, Kant argues. Current compute and organisational limits still force Poolside to use simpler stages.

  • Earlier reasoning training could extract more knowledge from web data than next-token prediction alone.
  • Cheaper models and newer hardware should make training more continuous, Kant expects.
  • Current training combines supervised fine-tuning with reinforcement learning on tasks the model cannot yet solve reliably.

Poolside uses coding to train models for broader tasksSource1:12:01

We’re putting tool calls in between. This is even more about tool calls than MCP, where the model can write the code and interact with the system. Laguna S does this a lot. You’ll see this as well in frontier models. Here, we’re going to stuff 50 tools in the system prompt? No. Here’s a virtual machine with these binaries installed. This code base you can operate in; here’s a folder where you can write your memory if you want to. The model is using code to do complex tasks.

Coding teaches capabilities that transfer to other knowledge work, Kant says. A virtual machine with binaries, a codebase, files, and memory lets the agent build complex actions.

  • Code lets a model combine loops, conditions, files, and memory into longer actions.
  • Laguna S performed useful deep research despite not being trained specifically for it, according to Kant.
  • In Poolside’s supporting test, the model improved an agent harness by 5.2% and cut memory allocation by about 70%.

Poolside is focusing on language and vision, not audioSource1:15:54

Saying no to things means that there’s a researcher and compute that can go to making general progress. Our view is general progress is going to come from the ability to push these models to far more capable reasoning, far longer-horizon tasks. I don’t think audio adds to that. I don’t think it pushes us close to AGI. It is a necessary modality as you get close to AGI. Visual understanding sits in the middle of those things. I think visual understanding can absolutely do so, but it also unlocks capabilities that are valuable today.

With limited researchers and compute, Poolside is prioritising language reasoning and longer tasks. The company has started vision work but does not plan to work on audio soon.

  • Audio may become necessary closer to AGI, but Kant does not see it as a current route toward AGI.
  • Vision could improve general capability while also producing useful features now.
  • Different foundation-model companies can follow different paths; Poolside is concentrating on its own.

The training run costs less than the research and infrastructure behind itSource1:20:57

The training run is not the expensive part. The training run is a very anticlimactic event. We just had a Slack message come up yesterday to say the new model is training, and here are the links so you can follow the evals—that’s it. All the work goes into that moment. Athletes talk: it’s all the preparation, all the going to the gym, and then the game is just a game. I think that’s a little bit like with models. People had over-indexed on DeepSeek being trained for $5 million. There’s the amount of R&D before that, the infrastructure built up, all the things, the data.

The visible training run is small beside the research, data, infrastructure, and preparation behind it, Kant says. A headline training price therefore captures only part of a model’s cost.

  • The new model’s pre-training run was planned for 39 days.
  • DeepSeek showed that a capable model’s final training run need not be extremely expensive, Kant argues.
  • From training start to publication, Laguna S 2.1 took under nine weeks, Poolside reports.
  • A complete Poolside cycle includes pre-training, post-training, and release preparation.

Eiso Kant says open models may need safeguards as their capabilities growSource1:31:56

Yes, there has to be. You cannot sit with a straight face and say this can be open forever in every way, shape, or form. It is just as, I think, egregious as saying the opposite: it all needs to be closed down right now. I think at extremes of spectrums is where we go wrong in society. The answer is always more nuanced and never black and white. As we encounter real-world scenarios where we have to say we have to be more careful, we need to reevaluate. If that means training a model differently, opening it up, having different versions, some things that are restricted, I think that’s totally okay, because I don’t think anyone should be irresponsible.

Rules should not permanently concentrate model building among a few companies, Kant argues. When evaluators identify a capability people can misuse, he says Poolside may need to restrict it or release a different model version.

  • Unilateral decisions by one company create a dangerous concentration of power.
  • International limits on particular capabilities would be better than blanket rules about model availability, in Kant’s view.
  • Broad barriers could entrench incumbents, and Kant acknowledges Poolside’s interest in opposing them.

Hardware and reinforcement-learning limits determine how fast Poolside can train modelsSource1:39:44

And I think one of the best ways to start improving that is the things we’re already seeing in inference, which is the separation of the prefill and decode to different chips to come to reinforcement learning. And I think we’ll be there soon. And I think more people should be working on this, because then we’re able to be way more efficient in how we train RL from a wall-clock time. It’s a race. The race is measured not in how many GPUs, but on calendar time.

Reinforcement-learning throughput and hardware design determine how quickly Poolside can improve its models, Kant says. The main constraint is elapsed training time rather than the total number of GPUs.

  • Reinforcement learning has fewer distinct tasks than web-scale pre-training, which limits useful batch sizes.
  • Lower-precision reinforcement learning on newer Nvidia hardware is one option Poolside is exploring.
  • Frequent smaller training runs let the team test Model Factory improvements and identify what changed.

Tags

  • Coding Agents
  • AI Infrastructure Efficiency
  • Post-Training
  • Open Weights