FlareStart
HomeNewsHow ToSources
FlareStart

Where developers start their day. All the tech news & tutorials that matter, in one place.

Quick Links

  • Home
  • News
  • Tutorials
  • Sources
  • Privacy Policy

Connect

© 2026 FlareStart. All rights reserved.

Back to articles
Punching Through NVIDIA NemoClaw's Sandbox to Hit Local vLLM on RTX 5090
How-ToDevOps

Punching Through NVIDIA NemoClaw's Sandbox to Hit Local vLLM on RTX 5090

via Dev.tosoy4h ago

Disclaimer: This is an experimental build, not a production setup. NemoClaw is early-stage (v0.0.7), the network hacks are volatile, and I'm documenting this because I couldn't find anyone else trying it. What Is NemoClaw? NVIDIA NemoClaw (OpenShell) is a sandboxed execution environment for AI agents. It runs a k3s cluster inside Docker, creates isolated sandbox namespaces, and lets agents execute code in a locked-down container. The default workflow: your agent talks to NVIDIA's cloud inference API. The sandbox allows outbound HTTPS to integrate.api.nvidia.com and blocks most other traffic. But what if you have an RTX 5090 sitting right there on the host, running vLLM with Nemotron 9B? I wanted to see if I could route the sandbox's inference to my local GPU instead. Spoiler: it works, but the network isolation requires three separate workarounds. The Network Topology WSL2 Host vLLM on 0.0.0.0:8000 Docker bridge: 172.18.0.1 (yours will differ) | openshell-cluster container (172.18.0.2)

Continue reading on Dev.to

Opens in a new tab

Read Full Article
0 views

Related Articles

How I turned my Pixel phone into a genuinely productive desktop computer - for free
How-To

How I turned my Pixel phone into a genuinely productive desktop computer - for free

ZDNet • 23m ago

the world is your oyster - you can just do things.
How-To

the world is your oyster - you can just do things.

Medium Programming • 26m ago

The Sonos Bluetooth Speaker Is $40 Off
How-To

The Sonos Bluetooth Speaker Is $40 Off

Wired • 1h ago

Gemini's Personal Intelligence shocked me with everything it knows - here's how to turn it on (or off)
How-To

Gemini's Personal Intelligence shocked me with everything it knows - here's how to turn it on (or off)

ZDNet • 2h ago

You Don’t Need More Tutorials - You Need Better Problems
How-To

You Don’t Need More Tutorials - You Need Better Problems

Medium Programming • 3h ago

Discover More Articles