Skip to content

[Serve] Add doc for serve replica scheduling#59114

Merged
abrarsheikh merged 9 commits into
masterfrom
59055-abrar-doc
Dec 12, 2025
Merged

[Serve] Add doc for serve replica scheduling#59114
abrarsheikh merged 9 commits into
masterfrom
59055-abrar-doc

Conversation

@abrarsheikh

@abrarsheikh abrarsheikh commented Dec 2, 2025

Copy link
Copy Markdown
Contributor

https://anyscale-ray--59114.com.readthedocs.build/en/59114/serve/advanced-guides/replica-scheduling.html

  • compact scheduling
  • placement groups/bundles
  • custom resource
  • quick reference guide on when to use what feature
  • working code examples
Signed-off-by: abrar <abrar@anyscale.com>
Signed-off-by: abrar <abrar@anyscale.com>
@abrarsheikh abrarsheikh changed the title 59055 abrar doc Dec 2, 2025
Signed-off-by: abrar <abrar@anyscale.com>
Signed-off-by: abrar <abrar@anyscale.com>
@abrarsheikh abrarsheikh marked this pull request as ready for review December 2, 2025 18:25
@abrarsheikh abrarsheikh requested review from a team as code owners December 2, 2025 18:25
@ray-gardener ray-gardener Bot added the serve Ray Serve Related Issue label Dec 2, 2025
@abrarsheikh abrarsheikh added the go add ONLY when ready to merge, run all tests label Dec 4, 2025
Comment thread python/ray/serve/_private/deployment_state.py
Comment thread python/ray/serve/_private/deployment_state.py
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Signed-off-by: abrar <abrar@anyscale.com>

@edoakes edoakes left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

recommendations look reasonable to me

Comment thread doc/source/serve/advanced-guides/replica-scheduling.md
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Signed-off-by: abrar <abrar@anyscale.com>
Comment thread doc/source/serve/advanced-guides/replica-scheduling.md Outdated
Signed-off-by: abrar <abrar@anyscale.com>
@abrarsheikh abrarsheikh merged commit 7a86dc0 into master Dec 12, 2025
6 checks passed
@abrarsheikh abrarsheikh deleted the 59055-abrar-doc branch December 12, 2025 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

go add ONLY when ready to merge, run all tests serve Ray Serve Related Issue

4 participants