BejelentkezésRegisztráció
ray
1,961 posts
user avatar
ray
@raydistributed
A distributed compute framework for scaling AI workloads. Created and developed by @anyscalecompute.
docs.ray.io
Csatlakozás dátuma: August 2019
2
követés
11.4K
Követők

Új vagy az X-en?

Regisztrálj most, hogy saját, személyre szabott idővonalad lehessen!

Fiók létrehozása

A regisztrációval elfogadod a Felhasználási feltételeket és az Adatvédelmi irányelveket, beleértve a cookie-k használatát is.

Terms·Privacy·Cookies·Kisegítő lehetőségek·Ads Info·© 2026 X Corp.
Don't miss what's happening
Az X felhasználói tudják meg elsőként.
BejelentkezésRegisztráció
  • user avatar
    ray
    @raydistributed
    2023. ápr. 11.
    Distributed fine-tuning LLM is more cost effective than fine-tuning on a single instance! Check out the blog post on how to fine-tune and serve LLM simply, cost effectively using Ray + DeepSpeed and 🤗
    Blog | Anyscale
    Innen: anyscale.com
    50K
  • user avatar
    ray
    @raydistributed
    2023. ápr. 19.
    Ray is a powerful ML framework, but with great power comes massive documentation. How can we make it more accessible? Now, using @langchain and Ray, we can build and deploy a doc search engine in about 100 lines of code -- with a self-hosted LLM! 1/n
    63K
  • user avatar
    ray
    @raydistributed
    2021. febr. 10.
    Announcing a new Ray + 🤗 @huggingface integration! RAG is a new NLP model that uses external documents to augment its knowledge. We’ve integrated Ray with RAG: - 🚄Speeding up retrieval calls by 2x - 💫Improving the scalability of fine tuning Blog:
    Retrieval Augmented Generation with Huggingface Transformers and Ray
    Innen: medium.com
  • user avatar
    ray
    @raydistributed
    2020. ápr. 7.
    We're releasing RaySGD, a pytorch library that makes distributed training cheap and simple! Features: - fp16 training support - elastic training (automatic fault tolerance) - Integrated distributed HPO (w/ RayTune) - intuitive and pytorch-friendly APIs
    Faster and Cheaper Pytorch with RaySGD
    Innen: medium.com
  • user avatar
    ray
    @raydistributed
    2023. ápr. 27.
    Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving. 🧠 LLM features 💽 Ray data for ease of use & stability 📊 Serve observability 🤖 RLlib’s module for custom reinforcement learning 🏢Ray scalability for large clusters
    Announcing Ray 2.4.0: Infrastructure for LLM training, tuning, inference, and serving
    Innen: anyscale.com
    23K
  • user avatar
    ray
    @raydistributed
    2020. júl. 1.
    ML serving infra has evolved, and there are 3 key requirements - Framework agnostic (@TensorFlow, @PyTorch, pure Python, ...) - Pure Python (intuitive for developers) - Out of the box scalability Why? How does this relate to Ray and @huggingface? 🤗 👇
    The Simplest Way to Serve your NLP Model in Production with Pure Python
    Innen: medium.com
  • user avatar
    ray
    @raydistributed
    2023. aug. 15.
    @BytedanceTalk, the company behind TikTok, uses Ray for fast & cheap offline inference with multi-modal #LLMs. They generate embeddings for a staggering 200 TB of image and text data using a model with >10B parameters. anyscale.com/blog/how-byted… 🧵 Thread below 👇
    How ByteDance Scales Offline Inference with Multi-Modal LLMs
    Innen: anyscale.com
    61K
  • user avatar
    ray
    @raydistributed
    2020. nov. 2.
    You can now tune your @huggingface transformer Trainer with RayTune (tune.io) in 1 line of code! ⚡️Access Bayesian Optimization, Population-based Training to superpower your model 🧙‍♂️Use Multi-GPU and Multi-node support Blog post: anyscale.com/blog/hyperpara…
  • user avatar
    ray
    @raydistributed
    2020. szept. 30.
    Ray 1.0 is up on Github and PyPI (w/ new beautiful docs - docs.ray.io/en/latest/inde…)! 🎉This is a huge and important release, with many new APIs and tons of new committers! 🔖 Read about Ray 1.0 on our blog post (anyscale.com/blog/announcin…)
  • user avatar
    ray
    @raydistributed
    2021. aug. 20.
    🎉 Say hello to Ray Lightning — a faster and simpler path to multi-node distributed training for @pytorchlightnin⚡️. Change 1 line to scale your PyTorch Lightning training to a multi-node GPU cluster. Give it a try and let us know what you think!
    Introducing Ray Lightning: Multi-node PyTorch Lightning training made easy | Anyscale
    Innen: anyscale.com
  • user avatar
    ray
    @raydistributed
    2023. máj. 2.
    Part 2 of our Ray + LangChain Series is ready, in this part we’ll show you how to turbocharge generation of embeddings. See the video(9 minutes) at hubs.ly/Q01Np5sh0 and blog post at hubs.ly/Q01Np8090
    lnkd.in
    LinkedIn
    This link will take you to a page that’s not on LinkedIn
    19K
  • user avatar
    ray
    @raydistributed
    2025. márc. 7.
    ByteScale is a new LLM training framework - Evaluated 7B to 141B param models - 256K to 2048K context lengths - 12,000 GPUs - Optimized for mixed long and short sequences The crux of it is a much more dynamic parallelism strategy (as opposed to a static mesh) to account for
    18K
  • user avatar
    ray
    @raydistributed
    2025. ápr. 24.
    vLLM + Ray is a powerful combo for post-training.
    user avatar
    vLLM
    @vllm_project
    2025. ápr. 24.
    OpenRLHF is a pioneering framework to use vLLM for RLHF, driving many design and implementation of vLLM's features for RLHF, making vLLM a popular choice for many RLHF frameworks. Learn more about the story at blog.vllm.ai/2025/04/23/ope…
    9K
  • user avatar
    ray
    @raydistributed
    2020. aug. 26.
    hyperparameter tuning for #NLProc is often overlooked, but by using @huggingface transformers + tuning techniques such as PBT, you can increase model accuracy by up to 5% on certain fine-tuning tasks *without increasing your compute budget*! 🔖 read it: medium.com/@amog_97444/c4…