[Serve] Add broadcast API for deployment handles that broadcasts the same RPC across all live replicas of a deployment#61472

Merged

kouroshHakha merged 38 commits into

ray-project:masterfrom

Crystora:feat/serve-broadcast-deployment-handle

Apr 7, 2026

Commits on Mar 4, 2026

feat: Add to natively call a method on all replicas of a deployment
bittoby
committed
Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
fix: add tracing context, argument resolution, asyncio.Future support, and event loop safety
bittoby
committed
Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
fix: consistent copy pattern
bittoby
committed
fix: add replica done callbacks, concurrent async gather, defensive arg copies, and request counter
bittoby
committed
Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
fix: consistent same pattern
bittoby
committed
Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
fix: solve lint error
bittoby
committed
fix: aync
bittoby
committed

Commits on Mar 6, 2026

Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
fix: fix Lint error
bittoby
committed
fix: solve docstrong error
bittoby
committed

Commits on Mar 13, 2026

Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
Fix Serve broadcast reliability and add tests
bittoby
committed
Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
Concurrent broadcast result collection and async timeout support
bittoby
committed
fix: broadcast loop lacks exception
bittoby
committed
fix: update exception handerl
bittoby
committed
fix:Fix FakeReplica so broadcast test can hit ActorDiedError
bittoby
committed
fix: resolve broadcast hang on error, black formatting, and test correctness
bittoby
committed
Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
fix: fix lint error
bittoby
committed
fix: solve docstring testing error
bittoby
committed

Commits on Mar 19, 2026

Commits on Mar 20, 2026

Merge branch 'master' of https://github.com/bittoby/ray into feat/serve-broadcast-deployment-handle
bittoby
committed
update
bittoby
committed

Commits on Apr 6, 2026

Fix coroutine single-use bug in broadcast local testing mode and add docs
kouroshHakha
committed