There was a pretty funny anecdotal complaint from the Machine Learning $RDDT subreddit.


On $CBRS + OpenAI:
- Needs 1-2K tokens/sec so tries to use Cerebras.
- Claims OpenAI reserved all capacity, making waitlist infinite for everyone else not a hyperscaler.
- Stated alternatives with Groq’s API not accessible to them
Feels bad. But it does show how few players / limited capacity there is for fast inference.
post-image
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pinned