Activity
7K followers
-
Keerti Melkote reposted thisKeerti Melkote reposted thisToday we're announcing that Nscale has entered into a definitive agreement to acquire Anyscale, the platform built by the creators of Ray that AI engineers use to run workloads across thousands of GPUs. AI is the most consequential build-out of our generation, and it demands infrastructure built from the ground up: energy, data centres, compute, and software, unified under one roof. That has been our conviction since day one, and it is exactly what we have built. Anyscale extends that stack even further, sitting on top of our existing software to give AI engineers everything they need to train, fine-tune, and serve models at scale. We hold a second conviction just as firmly. The market is placing increasing importance on open source models and frameworks to democratise access to intelligence globally, and Nscale will be at the forefront of this effort: accelerating Ray's roadmap development, joining the PyTorch Foundation as a Platinum member, and ensuring Ray remains the default choice for AI engineers. The logic is simple. Neither company has what the other has, and that is what makes this combination so powerful. Together we own the full stack, from power to production AI. And we will lead in open source. Two years ago we were racking our first GPUs. Today we're combining with the team behind the most adopted framework in AI. Our mission is to build the engine of superintelligence. It just got closer. Read more here: https://lnkd.in/dY8Bts_M
-
Keerti Melkote shared thisJoin us for another exciting Ray Summit this year!! Agenda is live now and lots of deep AI talks from practitioners!! Get your early bird registration in soon!🔜Keerti Melkote shared thisEarly bird pricing for Ray Summit 2026 is extended through July 17. $200 for a Summit pass, $250 for Summit + Training, and rates go up after that. The full agenda is live, with teams from Google, Apple, Microsoft, Uber, Spotify, JPMorgan Chase, BMW, and many more. Banking, automotive, ride-hailing, drug discovery, mental health care, and more. Different industries, same scaling problems. San Francisco, Marriott Marquis, August 24–26. Register → https://lnkd.in/gqHdq__N
-
Keerti Melkote shared thisRobert Nishihara says “Inference is a subroutine of larger more complex AI pipelines”. This is a very succinct way to understand what is happening in AI right now. AI projects are graduating from custom inference to custom models. The business imperative is shifting from simply lower costs to owning a moat. The moat is the data and the AI learning loop. Learning loops require complex orchestration of rollouts, data, evals, policy updates and more across a heterogeneous compute estate of GPUs and CPUs. Inference is a subroutine in this context. It’s still critical. But a part of a whole that is more complex. For this new era of AI, composability becomes a key aspect without giving up on performance. Ray is the backbone for this era with Ray Serve as the most ergonomic way for developers to compose model serving as a part of the AI learning loop. But that is not an excuse for lower performance. Performance still matters in this context. This is why we have focused on improving Ray Serve performance 4.4x for prefill and 28x for decode stages. We are excited for what this does to unify the disparate parts of the AI learning loop into a single cohesive AI backbone for all your varied workload needs. Read more about the performance optimizations in this blog: https://lnkd.in/gVdsg7cj Try it out in Ray 2.56 or easier still on Anyscale, and join us on the Ray Slack to share feedback!High Performance Distributed Inference with Ray Serve LLM | AnyscaleHigh Performance Distributed Inference with Ray Serve LLM | Anyscale
-
Keerti Melkote shared thisOne of the biggest shifts happening in AI right now isn't about model intelligence. It's about control. Over the last two years, APIs have been the fastest path from idea to application. They helped organizations experiment quickly and prove value. But as AI moves deeper into production, many enterprises are running into two realities: (1) The capabilities available to them are increasingly defined by model providers. Recent launches have shown how new limits are being put in place to build differentiated AI systems. (2) The economics become harder to predict. As model providers look to monetize beyond infrastructure costs, organizations face rising per-token costs. For many enterprises, the question is shifting from "How do we use AI?" to “How do we own our AI?” The shift from renting to owning intelligence means controlling where models run, where multimodal data is processed, and how costs scale. Ultimately with the goal of creating a competitive advantage. This is exactly why we're excited about the Anyscale on Azure announcement at Microsoft Build. We're already seeing this transition with companies like Xoople and Wayve. These AI-native organizations were among the first Azure customers to move beyond experimentation and build AI platforms that give them full control over their data, models, and infrastructure. Today, more enterprises are following the same path. Anyscale on Azure, now available to all Azure users is the foundation to that path: https://lnkd.in/gCggHp3EAnyscale Launches on Microsoft Azure as a Native Integration for Enterprises to Build Sovereign AI and Take Control of Variable API CostsAnyscale Launches on Microsoft Azure as a Native Integration for Enterprises to Build Sovereign AI and Take Control of Variable API Costs
-
Keerti Melkote reposted thisKeerti Melkote reposted thisWe just published a deep dive on Anyscale on Azure, a new Azure Native integration now in public preview. The way enterprises consume AI is changing. The first wave was about calling externally hosted APIs to run inference. The next is about building AI systems on your own proprietary data, inside infrastructure you control — what's increasingly called sovereign AI. The post covers: - How Anyscale runs as an Azure Native integration, co-engineered with Microsoft, governed by the same Azure RBAC, Entra SSO, and Policy your platform team already uses - Why the full AI lifecycle (data prep, training, and inference) belongs on one compute foundation instead of stitched-together tools - How Wayve and Xoople are already running production AI on Anyscale on Azure, from autonomous driving to planetary-scale satellite imagery Bringing this to public preview took deep work from the engineering team. Special thanks to Aashutosh Khandelwal, Adhip Gupta, Allen Yin, Chris Fellowes, Chris Sivanich, Daniel Arrizza, Dwaipayan Mukhopadhyay, Douglas Strodtman, Elizabeth Hu, Gopal Agarwal, Lanbo Chen, Matt Eshelman, Naila K., Omar Shorbaji, Pei Yang, Sanjeeb Bhanja, Tim Dwyer, Tim You, and Toji George — and many others who helped get it shipped. Read it here: https://lnkd.in/gPD8UsK9
-
Keerti Melkote reposted thisKeerti Melkote reposted thisToday at BUILD we officially announced Anyscale on Azure! This new Azure Native integration gives enterprises a new way to build and operate AI with more sovereignty, efficiency, and reliability. As companies move from AI experimentation to production, many are discovering that relying solely on external AI APIs creates growing cost, governance, and operational challenges. Anyscale on Azure is purpose-built for this shift, giving enterprise AI and platform teams a unified compute foundation for the entire AI lifecycle, not just one stage of it. With Anyscale on Azure, enterprises can run the full AI lifecycle, keep proprietary data, models, and pipelines inside their own Azure environment, and replace unpredictable per-token API costs with governed compute infrastructure. Special thanks to Robert Nishihara, Ion Stoica, Philipp Moritz, Keerti Melkote, Pradeep Iyer, Lanbo Chen, Jooree Na, Julian Forero, Katarina Stanley, Lou Serlenga, Chad Carlisle, Anirudhya (Arnie) Dasgupta, and the entire Anyscale and Microsoft teams for the deep collaboration in empowering the next wave of enterprise AI. Learn more here: https://lnkd.in/gHhwnNsd. And if you’re at Microsoft Build, come connect with us at Booth G201!
-
Keerti Melkote reposted thisKeerti Melkote reposted thisCursor just released a frontier coding model with 4x faster generation. They will be speaking at Ray Summit about their journey building a frontier coding model. - Training on 1000s of GPUs - Scaling 100,000s of sandboxed coding environments - Custom training infrastructure with PyTorch and Ray - Custom MoE kernels, expert parallelism, hybrid sharded data parallelism They'll be speaking in much more detail next week at Ray Summit: https://lnkd.in/gE8pn3sv
-
Keerti Melkote reposted thisKeerti Melkote reposted thisRay Summit is going to be excellent. Can't wait to hear from xAI, Perplexity, Cursor, Thinking Machines Lab, Physical Intelligence, Applied Intuition, Prime Intellect, vLLM, SGLang (sgl-project), and so many others. Some major themes this year that come up over and over - Reinforcement learning infra - Multimodal data (lots of video) - Distributed inference - Scalable agent infrastructure - Robotics / autonomy https://lnkd.in/gE8pn3sv
-
Keerti Melkote reposted thisKeerti Melkote reposted thisThe Ray Summit 2025 agenda just dropped! 🔥 80+ deep technical sessions from Al researchers and builders across every industry from autonomous vehicles to finance and media. 👉 Check out the agenda → https://lnkd.in/e-_Sm2E3 This year’s focus: AI in production Hear from builders at Meta, Netflix, Apple, Cursor, Bridgewater Associates, J.P. Morgan, Adobe, Perplexity, Roblox, Anthropic, NVIDIA, Microsoft, Amazon, Google, Zoox, ByteDance, Coinbase, DataRobot, Autodesk, Grab, Pinterest, Character AI, Physical Intelligence, Applied Intuition and many more as they share how they’re building and scaling the next generation of distributed AI systems. 🗓 November 3–5 • San Francisco We hope to see you there!
-
Keerti Melkote liked thisKeerti Melkote liked thisI'm excited to share that I've joined Fractile as SVP, Systems Engineering. After spending time with several excellent companies over the past few months, I became convinced that Fractile’s inference solution will reset performance/TCO for high volume inference workloads— at the heart of delivering value for Foundation Labs and Hyperscalers. Beyond the technology and the business opportunity, I was struck by the breadth and depth of the Fractile team: people who can partner as equals with Foundation Labs and Hyperscalers on long-term roadmaps. I am joining a team that has already accomplished a great deal in a short time. I will focus on speeding delivery of Fractile’s rack-scale solutions and on building the industry and technology partnerships we need to win in AI infrastructure. Our Bay Area site is on the Playground Global campus in Palo Alto, where we will be ramping up our hiring to staff Fractile’s build-out in the Bay area. I’m glad to be back at it with a great team and a motivating mission!
-
Keerti Melkote liked thisKeerti Melkote liked thisAnyscale is cooking with their KV-aware router. Headline result: maximizing KV-cache hits is not the best routing strategy; trading a little cache reuse for token-load balance materially improves end-to-end performance. The event, request, and data planes remain Ray-native, while leveraging Dynamo’s modular KV indexer, which we worked together to modularize. Awesome work done together with Jeffrey (Yu-Che) Wang, Seiji Eicher, and Kourosh Hakhamaneshi https://lnkd.in/gAdn3bbCOptimizing LLM Serving Efficiency: Moving Beyond KV Cache Reuse to Token-Load Awareness with Ray Serve LLM | AnyscaleOptimizing LLM Serving Efficiency: Moving Beyond KV Cache Reuse to Token-Load Awareness with Ray Serve LLM | Anyscale
-
Keerti Melkote liked thisKeerti Melkote liked thisIn 2018, Roger Federer walked away from a $100M Nike deal. Not for Adidas. Not for Reebok. He bet on a no-name Swiss startup making shoes out of garden hoses. Everyone thought he was crazy, but that move made him a billionaire. Here’s the wildest sports-business bet ever: Federer had been with Nike since 1994. His iconic “RF” logo was everywhere on hats, jackets, and shoes. He had a 10-year, $100M Nike contract that expired in 2018. Nike passed on renewing. They didn’t want to pay more. So Federer walked away. On was founded in 2010 by three Swiss athletes. They weren’t a tennis brand. They weren’t even mainstream. Their shoes had weird hollow soles designed to mimic running on clouds. In 2018, On had no celebrity deals & no performance line for tennis. But Federer saw something. He didn’t just wear the shoes. He became a shareholder. Reports suggest Federer invested up to $54 million in On. He took an active role in product development and global strategy. This wasn’t branding. This was ownership. In 2020, On and Federer co-created The Roger Pro. It launched to massive hype, selling out instantly. But the real move was bigger: On wasn’t building tennis shoes. They were building a global lifestyle brand with Federer as the symbol of elegance, precision, and Swiss cool. In September 2021, On went public on the NYSE. Valuation? $11.3 billion. Federer’s estimated 3% stake? Worth over $300 million overnight. That single investment made him a billionaire. Nike offered money. On offered equity. Most athletes would take the $100M check. Federer took the startup risk and helped build it into a unicorn. As he once said: “You have to think long-term. Not just how much you make today.” Today, On Running is everywhere. • Over $1.8 billion in annual revenue • Growing double digits globally • Backed by innovation, performance tech, and fashion appeal • Seen on runners, celebrities, and pro athletes And Roger Federer’s fingerprint is on all of it. #startup #leadership
-
Keerti Melkote liked thisKeerti Melkote liked thisFidji Simo is joining the Nscale Board of Directors. Fidji has built products used by billions of people. She led the Facebook app through the industry's shift to mobile, took Instacart to profitability and through its IPO as CEO and Chair, and most recently ran ChatGPT as CEO, AGI Deployment at OpenAI. Compute allocation is a product problem as much as a power problem, and that gets more true the further up the stack we build. Very few leaders understand what products at that scale demand of the systems underneath them. Fidji has spent her career on the other side of it. We've built this board deliberately. Fidji is the piece we didn't have. Welcome, Fidji. https://lnkd.in/gzEDBjvUFidji Simo Joins Nscale Board of Directors | NscaleFidji Simo Joins Nscale Board of Directors | Nscale
-
Keerti Melkote liked thisKeerti Melkote liked thisSales tax, solved. It's the AI-native sales tax solution that you've been waiting for, with US and global coverage. Backed by human expertise and white-glove support.
-
Keerti Melkote liked thisKeerti Melkote liked thisFifteen years. It's hard to believe how quickly the time has passed. What started as a journey with Aruba and now HPE, has been filled with incredible opportunities, challenges, friendships, and lessons that have made me who I am today. Looking back, I am grateful for the chance to work alongside so many incredible people, support amazing customers and partners, and be part of a company that continues to innovate and evolve. I want to extend my sincere thanks to Keerti Melkote, Dominic Orr, Zeeshan Hadi, Jodi Moore, Jim Harold, and Trevor Wilson for your leadership, support, mentorship, and belief in me throughout various stages of my career. Your guidance has had a lasting impact on my growth. A special thank you to Todd Clairmont for being an outstanding teammate and trusted resource. It's been a wonderful experience to work with you to support our customers. Also, a very special shoutout to Ziad Hadi - thank you for allowing me to be the brother you never wanted but somehow got anyway! Your friendship and support throughout the years has been memorable. Finally, and most importantly, a huge thank you to all of my colleagues, customers, partners, and friends who have been part of these last 15 years. I am incredibly grateful for the relationships we've built and the experiences we've shared.
-
Keerti Melkote liked thisAn honor to be selected to be on the TIME100 AI list for 2026, and to join the ranks of other NIST’ers who have been on this list prior. Proud of the work that National Institute of Standards and Technology (NIST) ‘s CAISI and ITL do to advance American AI industry. This honor is theirs.Keerti Melkote liked thisUnder Secretary of Commerce for Standards and Technology and NIST Director Arvind Raman was selected by TIME as one of the 100 most influential people in AI, in part for his leadership as Acting Director of the Center for AI Standards and Innovation (CAISI) at NIST. CAISI is just one of the ways by which NIST serves as American industry’s national lab, by supporting the world-leading American AI industry through collaborative research on AI metrology and model evaluations. CAISI staff member Paul Christiano was named to the list in 2023 before he joined NIST, and former staff member Elham Tabassi was recognized that same year while she was Associate Director for Emerging Technologies in NIST’s Information Technology Lab. 🔗 https://lnkd.in/ej8FharW
-
Keerti Melkote liked thisKeerti Melkote liked thisI attended the Ray Summit 2026 organised by Anyscale last week in San Francisco. It was my first time in SF too! Some highlights: - Learned that almost everyone in the industry is using Ray to scale their AI workloads - New features and future direction look very promising! - Just breathing all that Ray-heavy air helped make progress on some Wayve+Ray stuff - Trained my first world model! - Met some of our vendors that led to some fruitful conversations - Visited the Wayve office in Sunnyvale - Caught up with some friends I hadn't seen in years!
Other similar profiles
Explore more posts
Explore top content on LinkedIn
Find curated posts and insights for relevant topics all in one place.
View top content