NVIDIA releases tutorial on building a local sandboxed AI assistant based on NemoClaw

robot
Abstract generation in progress
ME News Report, April 18 (UTC+8), NVIDIA recently released a technical tutorial guiding developers on how to build a secure, long-running, fully local autonomous AI assistant. The tutorial is based on NVIDIA's open-source reference stack NemoClaw, which integrates OpenShell secure runtime and OpenClaw self-hosted gateway, aiming to address data privacy and control risks when deploying AI agents on third-party clouds. The tutorial provides detailed deployment steps on NVIDIA DGX Spark (GB10) systems, including environment setup, local service models, installation stack, and connection to Telegram. Deployment requires meeting specific hardware (DGX Spark running Ubuntu 24.04 LTS), software (Docker 28.x+, Ollama), and prerequisites such as creating a Telegram bot token. Estimated active operation time is 20-30 minutes, plus an initial model download of about 87 GB taking 15-30 minutes. Core components include NemoClaw, OpenShell, OpenClaw, Nemotron 3 Super 120B LLM, and inference deployment with NIM or Ollama. The article also notes that while OpenShell offers strong isolation features, no sandbox can provide complete protection against advanced prompt injections, and it is recommended to deploy new tools on isolated systems during testing. (Source: InFoQ)
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 7
  • 1
  • Share
Comment
Add a comment
Add a comment
GateUser-26f91b48
· 9h ago
The long-term security deployment selling point really resonated with me; I'm always worried about data leaks with cloud API.
View OriginalReply0
FomoLibrarian
· 11h ago
OpenShell + OpenClaw this combo name sounds like a cyberpunk armory
View OriginalReply0
0xLateDiner
· 11h ago
Ubuntu 24.04 + Docker 28.x environment requirements are written in such detail, friendly for beginners
View OriginalReply0
PixelUniverseCat
· 12h ago
Isolation system testing is the baseline; I've seen too many local AI failures before.
View OriginalReply0
GasFeeAnxiety
· 12h ago
Nemotron 3 Super 120B local run, is this the largest model that can be touched at the consumer level?
View OriginalReply0
MempoolDaydream
· 12h ago
Downloading 87GB models is discouraging, but running 120B locally is indeed appealing
View OriginalReply0
SushiSlippage
· 12h ago
Without sandboxing, it can't fully defend against advanced prompt injections. This reminder is very practical; experienced security professionals all understand.
View OriginalReply0