Twitter/X

On 2026-08-07, @octralabs published an early demo of onchain LLM inference…

2026-08-07 · 14:40 UTC ·@octralabs ·1 min read

Brief

octralabs announced an early demo (2026-08-07) of onchain LLM inference inside an unencrypted octra circle accessible via webcli and a local URL; a companion post from λ (@lambda0xE) exposes a graph-based LLM v0.0.1 pre-alpha on devnet. The team plans benchmarks, KV-cache tuning, multiple model tiers, agent-tool support, HFHE+CircleGate+Tor internet access, and membranes.

Why it matters

On 2026-08-07, @octralabs published an early demo of onchain LLM inference running inside an unencrypted octra circle; testers should install webcli, run ./octra_wallet, and open http://127.0.0.1:8420/circles.html?uri=oct://oct99BWHFpV5r54DXKc2FhsBmZEaS6Q8zvCQrHRgXUcK4Fk%2Findex.html locally.

Key details

  • λ (@lambda0xE) posted that a graph-based LLM v0.0.1 (pre-alpha) is live on devnet at oct://oct99BWHFpV5r54DXKc2FhsBmZEaS6Q8zvCQrHRgXUcK4Fk/index.html; it is currently slow while they run benchmarks and fine-tune the KV cache mechanism over the next few days.
  • Roadmap items include multiple model sizes, 'agent-tools' support, customizable privacy levels, and optional internet access via HFHE + CircleGate + Tor, plus 'membranes' and additional features for onchain inference.
Source evidence

an early demo of onchain LLM inference inside an octra circle (unencrypted) is now available through webcli.

to test, install webcli, run ./octra_wallet and navigate to:
http://127.0.0.1:8420/circles.html?uri=oct://oct99BWHFpV5r54DXKc2FhsBmZEaS6Q8zvCQrHRgXUcK4Fk%2Findex.html

λ (@lambda0xE)

an early release of the graph-based LLM (v0.0.1 pre-alpha) running on circles is already available on devnet at: oct://oct99BWHFpV5r54DXKc2FhsBmZEaS6Q8zvCQrHRgXUcK4Fk/index.html

give it a try and say hello, it’s still slow, but that’s just a matter of a couple of days while we run benchmarks and fine tune the KV cache mech

the roadmap for this thing is straightforward: various models ranging from simple to complex, "agent-tools" (don't really like that buzzword, but i decided to put it because in rare cases it actually makes sense) that the models can utilize, customizable privacy levels, internet access via HFHE + CircleGate + Tor (optional), membranes, and much more

— https://nitter.net/lambda0xE/status/2085720841279488199#m