This is a huge deal. An American open source model that I can run on my local machine and that performs on par with models 10X its size.
Poolside (@poolsideai)
Today we're releasing Laguna S 2.1, our most capable model to date.
It's a 118B total parameter Mixture-of-Experts model with 8B activated per token, a context window of up to 1M tokens, and thinking and no-thinking modes.
Capable enough to hold its own against models many times its size. Small enough to run on a single @NVIDIAAI DGX Spark.
Laguna S 2.1 is fully open under OpenMDW-1.1, with weights available today on @huggingface
poolside.ai/blog/introducing…
Video
— https://nitter.net/poolsideai/status/2079613777343848465#m