लॉग इन करासाइन-अप करा
Anyscale
1,936 posts
user avatar
Anyscale
@anyscalecompute
The best way to run @raydistributed, the distributed compute framework for scaling AI workloads.
anyscale.com
September 2019 रोजी सहभागी झाले
3
फॉलोइंग
13K
फॉलोअर्स

X मध्ये नवीन आहात?

स्वतःची वैयक्तिकृत टाइमलाइन मिळविण्यासाठी आता साइन-अप करा!

खाते तयार करा

साइन-अप करुन आपण सेवेच्या अटी आणि गोपनीयता धोरण, ज्यामध्ये कुकींचा वापर समाविष्ट आहे, यांना सहमती दर्शवता।

Terms·Privacy·Cookies·प्रवेशयोग्यता·Ads Info·© 2026 X Corp.
Don't miss what's happening
X वरील लोक माहित असलेले पहिले आहेत.
लॉग इन करासाइन-अप करा
  • user avatar
    Anyscale
    @anyscalecompute
    १३ डिसें, २०२३
    We’re excited to announce the official @MistralAI Mixtral 8x7B model on Anyscale Endpoints, offering the best price on the market with an OpenAI compatible API. 💸 Pricing: $0.5 / million tokens 📆 Coming soon: JSON mode and function calling Try out Mixtral on Anyscale
    547K
  • user avatar
    Anyscale
    @anyscalecompute
    २१ डिसें, २०२३
    📈We’re excited to introduce the LLMPerf leaderboard: the first public and open source leaderboard for benchmarking performance of various LLM inference providers in the market. Our goal with this leaderboard is to equip users and developers with a clear understanding of the
    376K
  • user avatar
    Anyscale
    @anyscalecompute
    १२ डिसें, २०२३
    We're announcing new features and models today. 🔵 JSON mode ⚫️ function calling Try them out with our API.
    Blog | Anyscale
    anyscale.com यांच्याकडून
    174K
  • user avatar
    Anyscale
    @anyscalecompute
    १ जुलै, २०२४
    1/ 🚀 Introducing RouteLLM: a routing framework based on human preference data for routing queries between powerful proprietary LLMs and cost-effective LLMs, developed in collaboration with @lmsysorg . By intelligently selecting the best model for each query, our router models
    20K
  • user avatar
    Anyscale
    @anyscalecompute
    १६ जुलै, २०२०
    Anyscale is honored to have been recognized by Forbes as one of America’s Most Promising Artificial Intelligence Companies anyscale.com/blog/forbes-ai…
  • user avatar
    Anyscale
    @anyscalecompute
    १० जुलै, २०२४
    We’ve recently contributed FP8 support to the @vllm_project in collaboration with @neuralmagic. With this feature, you can see up to a 1.8x reduction in inter-token latency, with >99% accuracy preservation! 1/n
    34K
  • user avatar
    Anyscale
    @anyscalecompute
    २२ डिसें, २०२३
    🔥 Mixtral-8x7B JSON Mode and Function Calling API is now available on Anyscale Endpoints! Empirically, we observed noticeable improvements in response to tool messages by Mixtral MoE, compared @MistralAI 7B. 🚀 👇 Try it out: app.endpoints.anyscale.com
    29K
  • user avatar
    Anyscale
    @anyscalecompute
    २८ मे, २०२४
    Recently, we’ve contributed chunked prefill to @vllm_project, leading to up to 2x speedup for higher QPS regimes! In vLLM, prefilling, which fills the KV cache, and decoding, which outputs new tokens, can interfere with each other, resulting in latency degradation. 1/n
    33K
  • user avatar
    Anyscale
    @anyscalecompute
    ७ डिसें, २०२१
    🎉 We’re thrilled to announce our $100M Series C led by @a16z & Addition + general availability of the Anyscale managed @raydistributed platform! forbes.com/sites/kenrickc… Both are big steps forward in our mission to accelerate the scaling and productionization of #AI apps.
  • user avatar
    Anyscale
    @anyscalecompute
    २२ ऑक्टो, २०२५
    Today we’re donating Ray to The Linux Foundation under the PyTorch Foundation with PyTorch + vLLM, strengthening the open compute fabric for AI. Ensures long-term neutrality, open governance, and ecosystem alignment. Blog: na2.hubs.ly/H01JydX0 Ray Summit (Nov 3–5, SF):
    22K
  • user avatar
    Anyscale
    @anyscalecompute
    १६ जाने, २०२४
    Producing ~1B embeddings can take weeks and cost tens of thousands of dollars ($60K with OpenAI in the example below). We are thrilled to partner with @pinecone on the launch of their new serverless offering! Anyscale + Pinecone reduce the cost of computing these embeddings by
    18K
  • user avatar
    Anyscale
    @anyscalecompute
    ३० जाने, २०२४
    Ready to hear from #RAG experts at @langchain @vercel @pinecone @anyscalecompute and get hands-on with intensive guided trainings? The 2-day RAG Developer Bootcamp is for you! Learn more & register now 👉hubs.ly/Q02j9QmW0 #llm #ml #rag #ai #vectordatabase #ray #pinecone
    57K
  • user avatar
    Anyscale
    @anyscalecompute
    १८ एप्रि, २०२४
    🦙 We're excited to host @Meta Llama-3 8b and 70b on Anyscale Endpoints! ➕ Fine-tuning, JSON mode and function calling support coming soon as well! Pricing: - 8B: $0.15 / Million tokens - 70B: $1.00 / Million tokens
    10K
  • user avatar
    Anyscale
    @anyscalecompute
    ३१ मे, २०२३
    Our Eng team has been learning a lot about managing and scaling open source LLMs, using some great models from @huggingface . We packaged up what we've learned to help you build/deploy your own! Announcing Aviary: Open Source Multi-LLM Serving
    Blog | Anyscale
    anyscale.com यांच्याकडून
    12K