NVIDIA releases tutorial on building a local sandboxed AI assistant based on NemoClaw

robot
Abstract generation in progress
ME News Report, April 18 (UTC+8), NVIDIA recently released a technical tutorial guiding developers on how to build a secure, long-running, fully local autonomous AI assistant. The tutorial is based on NVIDIA's open-source reference stack NemoClaw, which integrates OpenShell secure runtime and OpenClaw self-hosted gateway, aiming to address data privacy and control risks when deploying AI agents on third-party clouds. The tutorial provides detailed deployment steps on NVIDIA DGX Spark (GB10) systems, including environment setup, local service models, installation stack, and connecting to Telegram. Deployment requires meeting specific hardware (DGX Spark running Ubuntu 24.04 LTS), software (Docker 28.x+, Ollama), and prerequisites such as creating a Telegram bot token. Estimated active operation time is 20-30 minutes, plus an initial model download of about 87 GB taking 15-30 minutes. Core components include NemoClaw, OpenShell, OpenClaw, Nemotron 3 Super 120B LLM, and inference deployment with NIM or Ollama. The article also notes that although OpenShell offers strong isolation features, no sandbox can provide complete protection against advanced prompt injections, and it is recommended to deploy new tools on isolated systems during testing. (Source: InFoQ)
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 7
  • 1
  • Share
Comment
Add a comment
Add a comment
GateUser-78acf617
· 10h ago
Is the Docker 28.x version lock a bit too strict? Have you tested 28.0.1?
View OriginalReply0
ElevatorMeme
· 12h ago
Isolation ≠ Absolute Security; this phrase is worth highlighting.
View OriginalReply0
Cross-SectionOfSucculent
· 12h ago
Deploy in 20 minutes? I don't believe you. Last time, it took two days to set up the environment.
View OriginalReply0
GateUser-953e1a14
· 12h ago
NVIDIA DGX Spark has a pretty high hardware threshold.
View OriginalReply0
MetalKeyInsomnia
· 13h ago
The step of obtaining the Telegram bot token is prone to pitfalls; it is recommended to include a screenshot.
View OriginalReply0
EchoesOfMistValley
· 13h ago
OpenShell+OpenClaw combination is quite interesting, and the isolation design scores extra points.
View OriginalReply0
CandleAfterTheRain
· 13h ago
Nemotron 3 Super 120B runs locally, and the electricity cost is astonishing.
View OriginalReply0