跳到正文
elvis· @omarsar0 · X·· 3 小时前AI 评分54
AI 导读

Superlinked 发布 SIE Serverless,一个聚焦小模型的托管推理产品,覆盖 Search、OCR 和 Agent 执行等 20 多项任务型工作负载,由其开源推理引擎驱动。

正文

Stop overpaying for agents, folks!

A single agent request can trigger many model calls. Your agent might classify a ticket, rerank results, extract a date and run a guardrail before it ever answers.

Sending all of those calls to a frontier model gets expensive fast. And it’s unnecessary.

@superlinked SIE gives you one API for the open models behind those steps.

Across 14 task tests, open models on SIE reached a median 98% of GPT-6.1 Sol's score at 3% of its cost, at list pricing.

Keep the frontier model for the steps that need it, like those requiring complex reasoning.

引用Daniel Svonava@svonava
🚨 Huge news 🚨 today we are launching SIE Serverless - a managed inference product focused on small models. It’s useful for spiky workloads on 20+ task specific workloads across Search, OCR and Agentic execution. Sign up for a $500 credits launch grant 👇 It’s powered by our open source inference engine that has received thousands of github stars in the last few months, battle-tested across finance, legal & tech. We believe that self-hosting is going to be critical given all the trust & security issues in AI, but practically there are always workloads where you’d like somebody else to deal with the GPU quota like synthetic data generation, evals, public research and beyond. The team at Superlinked has been burning the midnight oil for months and I’m so proud of every single one of you - what a privilege to call you my team mates y’all! We built it, now help us make some noise 🙌 A like, a comment or a repost would mean a lot! ❤️
在 X 查看被引用的帖子

来源:elvis · x.com