InloggenRegistreren
ray
1,961 posts
user avatar
ray
@raydistributed
A distributed compute framework for scaling AI workloads. Created and developed by @anyscalecompute.
docs.ray.io
Lid sinds August 2019
2
Volgend
11.4K
Volgers

Nieuw bij X?

Registreer nu en krijg je eigen gepersonaliseerde tijdlijn!

Account aanmaken

Door je te registreren, ga je akkoord met de Algemene voorwaarden en het Privacybeleid, inclusief het Cookiegebruik.

Terms·Privacy·Cookies·Toegankelijkheid·Ads Info·© 2026 X Corp.
Don't miss what's happening
Mensen op X zijn als eersten op de hoogte.
InloggenRegistreren
  • user avatar
    ray
    @raydistributed
    11 apr 2023
    Distributed fine-tuning LLM is more cost effective than fine-tuning on a single instance! Check out the blog post on how to fine-tune and serve LLM simply, cost effectively using Ray + DeepSpeed and 🤗
    Blog | Anyscale
    Van anyscale.com
    50K
  • user avatar
    ray
    @raydistributed
    19 apr 2023
    Ray is a powerful ML framework, but with great power comes massive documentation. How can we make it more accessible? Now, using @langchain and Ray, we can build and deploy a doc search engine in about 100 lines of code -- with a self-hosted LLM! 1/n
    63K
  • user avatar
    ray
    @raydistributed
    10 feb 2021
    Announcing a new Ray + 🤗 @huggingface integration! RAG is a new NLP model that uses external documents to augment its knowledge. We’ve integrated Ray with RAG: - 🚄Speeding up retrieval calls by 2x - 💫Improving the scalability of fine tuning Blog:
    Retrieval Augmented Generation with Huggingface Transformers and Ray
    Van medium.com
  • user avatar
    ray
    @raydistributed
    7 apr 2020
    We're releasing RaySGD, a pytorch library that makes distributed training cheap and simple! Features: - fp16 training support - elastic training (automatic fault tolerance) - Integrated distributed HPO (w/ RayTune) - intuitive and pytorch-friendly APIs
    Faster and Cheaper Pytorch with RaySGD
    Van medium.com
  • user avatar
    ray
    @raydistributed
    27 apr 2023
    Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving. 🧠 LLM features 💽 Ray data for ease of use & stability 📊 Serve observability 🤖 RLlib’s module for custom reinforcement learning 🏢Ray scalability for large clusters
    Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving
    Van anyscale.com
    23K
  • user avatar
    ray
    @raydistributed
    1 jul 2020
    ML serving infra has evolved, and there are 3 key requirements - Framework agnostic (@TensorFlow, @PyTorch, pure Python, ...) - Pure Python (intuitive for developers) - Out of the box scalability Why? How does this relate to Ray and @huggingface? 🤗 👇
    The Simplest Way to Serve your NLP Model in Production with Pure Python
    Van medium.com
  • user avatar
    ray
    @raydistributed
    15 aug 2023
    @BytedanceTalk, the company behind TikTok, uses Ray for fast & cheap offline inference with multi-modal #LLMs. They generate embeddings for a staggering 200 TB of image and text data using a model with >10B parameters. anyscale.com/blog/how-byted… 🧵 Thread below 👇
    How ByteDance Scales Offline Inference with Multi-Modal LLMs
    Van anyscale.com
    61K
  • user avatar
    ray
    @raydistributed
    2 nov 2020
    You can now tune your @huggingface transformer Trainer with RayTune (tune.io) in 1 line of code! ⚡️Access Bayesian Optimization, Population-based Training to superpower your model 🧙‍♂️Use Multi-GPU and Multi-node support Blog post: anyscale.com/blog/hyperpara…
  • user avatar
    ray
    @raydistributed
    30 sep 2020
    Ray 1.0 is up on Github and PyPI (w/ new beautiful docs - docs.ray.io/en/latest/inde…)! 🎉This is a huge and important release, with many new APIs and tons of new committers! 🔖 Read about Ray 1.0 on our blog post (anyscale.com/blog/announcin…)
  • user avatar
    ray
    @raydistributed
    20 aug 2021
    🎉 Say hello to Ray Lightning — a faster and simpler path to multi-node distributed training for @pytorchlightnin⚡️. Change 1 line to scale your PyTorch Lightning training to a multi-node GPU cluster. Give it a try and let us know what you think!
    Introducing Ray Lightning: Multi-node PyTorch Lightning training made easy | Anyscale
    Van anyscale.com
  • user avatar
    ray
    @raydistributed
    2 mei 2023
    Part 2 of our Ray + LangChain Series is ready, in this part we’ll show you how to turbocharge generation of embeddings. See the video(9 minutes) at hubs.ly/Q01Np5sh0 and blog post at hubs.ly/Q01Np8090
    lnkd.in
    LinkedIn
    This link will take you to a page that’s not on LinkedIn
    19K
  • user avatar
    ray
    @raydistributed
    7 mrt 2025
    ByteScale is a new LLM training framework - Evaluated 7B to 141B param models - 256K to 2048K context lengths - 12,000 GPUs - Optimized for mixed long and short sequences The crux of it is a much more dynamic parallelism strategy (as opposed to a static mesh) to account for
    18K
  • user avatar
    ray
    @raydistributed
    24 apr 2025
    vLLM + Ray is a powerful combo for post-training.
    user avatar
    vLLM
    @vllm_project
    24 apr 2025
    OpenRLHF is a pioneering framework to use vLLM for RLHF, driving many design and implementation of vLLM's features for RLHF, making vLLM a popular choice for many RLHF frameworks. Learn more about the story at blog.vllm.ai/2025/04/23/ope…
    8.6K
  • user avatar
    ray
    @raydistributed
    26 aug 2020
    hyperparameter tuning for #NLProc is often overlooked, but by using @huggingface transformers + tuning techniques such as PBT, you can increase model accuracy by up to 5% on certain fine-tuning tasks *without increasing your compute budget*! 🔖 read it: medium.com/@amog_97444/c4…