Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.
External link for Baseten
At Baseten we provide all the infrastructure you need to deploy and serve ML models performantly, scalably, and cost-efficiently. Get started in minutes, and avoid getting tangled in complex deployment processes. You can deploy best-in-class open-source models and take advantage of optimized serving for your own models. We also utilize horizontally scalable services that take you from prototype to production, with light-speed inference on infra that autoscales with your traffic. Best in class doesn't mean breaking the bank. Run your models on the best infrastructure without running up costs by taking advantage of our scaled-to-zero feature.
or
San Francisco, CA, US
New York, NY, US
Baseten reposted this
Baseten is one of the first open model inference providers in OpenAI's new B2B marketplace. This is a huge vote of confidence in open models and in Baseten, and another step toward our mission to help every company own its intelligence. Grateful to the OpenAI team for being great partners, and so proud of the Baseten team that brought this together! https://lnkd.in/gpeMni6V
Baseten reposted this
Two months ago I said the easiest way to use open models in Codex was `brew install baseten-switch`. Starting today you don't need baseten-switch: Baseten is the first inference provider in the new OpenAI B2B Marketplace. Enterprise OpenAI customers can run open models on Baseten natively via Codex and the Responses API. https://lnkd.in/gBA7_HPk
Baseten joined the OpenAI B2B marketplace today as one of the first open-model inference providers. The best AI companies are already running a mix of closed and open models at huge scale. We're excited to give OpenAI enterprise customers the ability to use open models powered by Baseten natively within Codex and through the Responses API. Read more in our announcement: https://lnkd.in/diUMFxSY
We're deeply committed to building safety controls for the open ecosystem across inference, training, and sandboxes. Today we joined NVIDIA's Open Secure AI Alliance, and we're excited to be a launch partner for the Open Agent Safety Platform. We're also introducing a private preview of Carbon: the fourth generation of Blaxel sandboxes, with support for open security controls (like OpenShell) baked in. Read more on our blog: https://lnkd.in/dQFk8zm7
We're proud to be a launch partner for the NVIDIA Open Agent Safety Platform and a member of the Open Secure AI Alliance. Baseten is committed to contributing to the open frontier, including open safety standards and frameworks for inference and training. Two weeks ago, we launched our safety infrastructure research effort with Base Labs. Today, we've contributed to OpenShell and built a template to run it inside our sandboxes. Much more to come.
Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry. Artificial intelligence is extraordinary technology that will advance discovery, productivity, security, health, and prosperity for generations to come. But its full promise can only be realized when people have confidence that AI is being built to be safe and deployed with wisdom and responsibility. NVIDIA Open Agent Safety Platform Reference Design combines NVIDIA OpenShell and NVIDIA Sentry. OpenShell is an open-source secure runtime that gives AI agents clear, enforceable boundaries. It traces their actions and enforces policy as they work. NVIDIA Sentry delivers added layer of security with hardware-based enforcement on NVIDIA BlueField, continuously monitoring agent activity through a trusted telemetry and detection pipeline and enabling millisecond-scale containment and quarantine. This is bigger than a single product. It's the beginning of an open ecosystem to build the trust layer for safe agent systems. Together, we are building the foundation of the AI economy. Trust and innovation are not in conflict. Safety is how trust is earned. We must build not only the most capable AI, but the most trusted AI, so that this extraordinary technology can realize its enormous promise for the world. https://nvda.ws/4hOkDx7
Baseten reposted this
We're officially in our Sheila era. Excited to welcome our new CMO to Baseten! https://lnkd.in/gY4xCQQA
We're officially in our Sheila era. Excited to welcome our new CMO to Baseten! https://lnkd.in/gY4xCQQA
Baseten reposted this
I used to assume Claude and Cursor could fix the code they write when it breaks. This $1.5B founder says that's the most expensive assumption in engineering. Spiros Xanthos spent a decade building the tooling engineers use to monitor production systems, and ran that business at Splunk. Two years ago he left to build the thing that replaces it. His company, ResolveAI, makes agents that do what an on-call engineer does. Something breaks; the agent finds the cause and fixes it. The objection he gets is one I've heard from almost every engineering leader I talk to: if AI already writes my code, why can't it fix my code? His answer is that the code is rarely what's wrong. Sites go down because a database ran out of room, or a setting changed yesterday, or one slow service dragged down everything connected to it. A tool that reads your code can't see any of that. So he's training his own models on the systems themselves. Each one learns a specific company's setup, and he hired one of Meta's top AI researchers to lead that work. He says those models already beat OpenAI and Anthropic at this job. That's an aggressive bet to make when the frontier moves every few months, and I want to hear him defend it. So on September 30th, Spiros is joining us in SF for the next Heavyweights conversation. Corinne Marie Riley, a partner at Greylock Partners, is interviewing him. She backed Resolve AI early, which means she can ask him things a neutral moderator never could. They're getting into: - Why your coding agent can't diagnose the failure it just caused. - Whether on-call still exists as a job in three years. - What it costs to chase frontier performance when nobody knows where the frontier will be. Link to register in the comments!