Skip to content

Conversation

@kthui
Copy link
Contributor

@kthui kthui commented Apr 8, 2025

Overview:

Update the --max-local-prefill-length description making it more descriptive on what it does, and align the description style with the --max-prefill-queue-size below.

Details:

N/A

Where should the reviewer start?

N/A

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

  • closes GitHub issue: #xxx

@copy-pr-bot
Copy link

copy-pr-bot bot commented Apr 8, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@kthui kthui enabled auto-merge (squash) April 8, 2025 22:23
@kthui kthui self-assigned this Apr 8, 2025
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Copy link
Contributor

@nnshah1 nnshah1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - and makes it clearer.

Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
@kthui kthui disabled auto-merge April 8, 2025 23:26
@kthui kthui enabled auto-merge (squash) April 8, 2025 23:26
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
@kthui kthui merged commit ce4aab0 into main Apr 9, 2025
5 checks passed
@kthui kthui deleted the jacky-vllm-max-local-prefill-length-docs branch April 9, 2025 00:08
kylehh pushed a commit to kylehh/dynamo that referenced this pull request Apr 11, 2025
…amo#554)

Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
oandreeva-nv pushed a commit that referenced this pull request Apr 22, 2025
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants