Buy Crypto
Pay with
USD
USD
Buy & Sell
Hot
Supports Visa, Mastercard, SEPA & more
P2P
0 Fees
Flexible trading, zero fees
Gate Card
Use your crypto for payments worldwide
Markets
Trade
Basic
Advanced
Futures
Futures
Access hundreds of perpetual contracts
CFD
Gold
One platform for global traditional assets
Options
Hot
Trade European-style vanilla options
Unified Account
Maximize your capital efficiency
Demo Trading
Introduction to Futures Trading
Learn the basics of futures trading
Futures Events
Join events to earn rewards
Demo Trading
Use virtual funds to practice risk-free trading
U.S. Stocks
CFD
U.S. stock CFD derivatives
Futures
High leverage, 24/7 trading
Tokenized Stocks
Backed by real stock assets
GUSD
Mint GUSD for Treasury RWA yields
Earn
Launch
CandyDrop
tag
Collect candies to earn airdrops
Launchpool
Quick staking, earn potential new tokens
HODLer Airdrop
Hold GT and get massive airdrops for free
Pre-IPOs
Unlock full access to global stock IPOs
Alpha Points
Trade on-chain assets and earn airdrops
Futures Points
Earn futures points and claim airdrop rewards
Investment
Square
Square
Post, share, and explore crypto trends
Live
moments live
Live crypto market analysis
Chat
Chat with crypto traders
News
What is happening in crypto
flower_head
More
Promotions
AI
Others
TradFi
Rewards
Square
Latest
Hot
News
Profile

BerriAI Open Source LiteLLM Agent Platform, supports deployment of multiple AI Agents in production environments

MeNews
AIMPACT News, May 17 (UTC+8), BerriAI announced the open source of LiteLLM Agent Platform, a Kubernetes-based self-hosted infrastructure platform designed for running multiple AI Agents in production environments, providing team-level sandbox isolation and persistent session management. The platform implements session-level independent sandbox environments through Kubernetes' agent-sandbox CRD, solving core issues such as state management, session persistence after container restarts, and environment isolation between teams. For local development, it uses kind (Kubernetes in Docker), while for production environments, AWS EKS is recommended. Regarding the technology stack, the platform uses Next.js to build the management panel, with TypeScript accounting for 92.8%, and PostgreSQL for persistent storage. LiteLLM Agent Platform is built on top of LiteLLM Gateway, which handles model routing, cost tracking, and rate limiting. Local startup requires only two commands: bin/kind-up.sh to configure the kind cluster, and docker compose up to start the services. The project is licensed under the MIT License and is in alpha public preview.
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 5
  • 2
  • Share
Comment
Add a comment
Add a comment
GateUser-e6dafce6
· 6h ago
Open-source Agent platforms are gathering, with BerriAI's version differentiating itself through deep integration with K8s.
View OriginalReply0
GateUser-f78f1f3e
· 7h ago
Multiple teams sharing a cluster fear mutual contamination the most; sandbox isolation has solved this urgent problem.
View OriginalReply0
HotAirBalloonViewing
· 7h ago
Self-hosted + native K8s, maximizing friendliness for data-sensitive enterprises
View OriginalReply0
BetaParanoiac
· 7h ago
agent-sandbox CRD design is quite interesting; fine-grained isolation is a must-have.
View OriginalReply0
RugCheckSkeptic
· 7h ago
BerriAI's open source move has sparked a new wave of competition in cloud-native AI infrastructure.
View OriginalReply0

  • Pinned

Sitemap