EntraRegistra't
ray
1,961 posts
user avatar
ray
@raydistributed
A distributed compute framework for scaling AI workloads. Created and developed by @anyscalecompute.
docs.ray.io
Data d'incorporació: August 2019
2
Seguint
11.4K
Seguidors

Acabes d'arribar a X?

Registra-t'hi ara per obtenir la teva pròpia cronologia personalitzada.

Crea un compte

En registrar-te, acceptes les condicions del servei i la política de privacitat, incloent-hi lús de galetes.

Terms·Privacy·Cookies·Accessibilitat·Ads Info·© 2026 X Corp.
Don't miss what's happening
Els usuaris de X són els primers a assabentar-se de tot.
EntraRegistra't
  • user avatar
    ray
    @raydistributed
    11 d’abr. del 2023
    Distributed fine-tuning LLM is more cost effective than fine-tuning on a single instance! Check out the blog post on how to fine-tune and serve LLM simply, cost effectively using Ray + DeepSpeed and 🤗
    Blog | Anyscale
    De anyscale.com
    50K
  • user avatar
    ray
    @raydistributed
    19 d’abr. del 2023
    Ray is a powerful ML framework, but with great power comes massive documentation. How can we make it more accessible? Now, using @langchain and Ray, we can build and deploy a doc search engine in about 100 lines of code -- with a self-hosted LLM! 1/n
    63K
  • user avatar
    ray
    @raydistributed
    10 de febr. del 2021
    Announcing a new Ray + 🤗 @huggingface integration! RAG is a new NLP model that uses external documents to augment its knowledge. We’ve integrated Ray with RAG: - 🚄Speeding up retrieval calls by 2x - 💫Improving the scalability of fine tuning Blog:
    Retrieval Augmented Generation with Huggingface Transformers and Ray
    De medium.com
  • user avatar
    ray
    @raydistributed
    7 d’abr. del 2020
    We're releasing RaySGD, a pytorch library that makes distributed training cheap and simple! Features: - fp16 training support - elastic training (automatic fault tolerance) - Integrated distributed HPO (w/ RayTune) - intuitive and pytorch-friendly APIs
    Faster and Cheaper Pytorch with RaySGD
    De medium.com
  • user avatar
    ray
    @raydistributed
    27 d’abr. del 2023
    Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving. 🧠 LLM features 💽 Ray data for ease of use & stability 📊 Serve observability 🤖 RLlib’s module for custom reinforcement learning 🏢Ray scalability for large clusters
    Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving
    De anyscale.com
    23K
  • user avatar
    ray
    @raydistributed
    1 de jul. del 2020
    ML serving infra has evolved, and there are 3 key requirements - Framework agnostic (@TensorFlow, @PyTorch, pure Python, ...) - Pure Python (intuitive for developers) - Out of the box scalability Why? How does this relate to Ray and @huggingface? 🤗 👇
    medium.com
    The Simplest Way to Serve your NLP Model in Production with Pure Python
    From scikit-learn to Hugging Face Pipelines, learn the simplest way to deploy ML models using Ray Serve.
  • user avatar
    ray
    @raydistributed
    15 d’ag. del 2023
    @BytedanceTalk, the company behind TikTok, uses Ray for fast & cheap offline inference with multi-modal #LLMs. They generate embeddings for a staggering 200 TB of image and text data using a model with >10B parameters. anyscale.com/blog/how-byted… 🧵 Thread below 👇
    How ByteDance Scales Offline Inference with Multi-Modal LLMs
    De anyscale.com
    61K
  • user avatar
    ray
    @raydistributed
    2 de nov. del 2020
    You can now tune your @huggingface transformer Trainer with RayTune (tune.io) in 1 line of code! ⚡️Access Bayesian Optimization, Population-based Training to superpower your model 🧙‍♂️Use Multi-GPU and Multi-node support Blog post: anyscale.com/blog/hyperpara…
  • user avatar
    ray
    @raydistributed
    30 de set. del 2020
    Ray 1.0 is up on Github and PyPI (w/ new beautiful docs - docs.ray.io/en/latest/inde…)! 🎉This is a huge and important release, with many new APIs and tons of new committers! 🔖 Read about Ray 1.0 on our blog post (anyscale.com/blog/announcin…)
  • user avatar
    ray
    @raydistributed
    20 d’ag. del 2021
    🎉 Say hello to Ray Lightning — a faster and simpler path to multi-node distributed training for @pytorchlightnin⚡️. Change 1 line to scale your PyTorch Lightning training to a multi-node GPU cluster. Give it a try and let us know what you think!
    Introducing Ray Lightning: Multi-node PyTorch Lightning training made easy | Anyscale
    De anyscale.com
  • user avatar
    ray
    @raydistributed
    2 de maig del 2023
    Part 2 of our Ray + LangChain Series is ready, in this part we’ll show you how to turbocharge generation of embeddings. See the video(9 minutes) at hubs.ly/Q01Np5sh0 and blog post at hubs.ly/Q01Np8090
    lnkd.in
    LinkedIn
    This link will take you to a page that’s not on LinkedIn
    19K
  • user avatar
    ray
    @raydistributed
    7 de març del 2025
    ByteScale is a new LLM training framework - Evaluated 7B to 141B param models - 256K to 2048K context lengths - 12,000 GPUs - Optimized for mixed long and short sequences The crux of it is a much more dynamic parallelism strategy (as opposed to a static mesh) to account for
    18K
  • user avatar
    ray
    @raydistributed
    24 d’abr. del 2025
    vLLM + Ray is a powerful combo for post-training.
    user avatar
    vLLM
    @vllm_project
    24 d’abr. del 2025
    OpenRLHF is a pioneering framework to use vLLM for RLHF, driving many design and implementation of vLLM's features for RLHF, making vLLM a popular choice for many RLHF frameworks. Learn more about the story at blog.vllm.ai/2025/04/23/ope…
    9K
  • user avatar
    ray
    @raydistributed
    26 d’ag. del 2020
    hyperparameter tuning for #NLProc is often overlooked, but by using @huggingface transformers + tuning techniques such as PBT, you can increase model accuracy by up to 5% on certain fine-tuning tasks *without increasing your compute budget*! 🔖 read it: medium.com/@amog_97444/c4…