vllm-middleware

Here is 1 public repository matching this topic...

longern / vllm-finetune-middleware

vLLM middleware that wrap RunPod-style endpoints so you can proxy fine-tuning requests from OpenAI SDK, launch jobs, and shuttle training artifacts through an S3-compatible store for custom vLLM fine-tuning workflows.

fine-tuning starlette-middleware llm runpod vllm runpod-worker vllm-middleware

Updated Nov 19, 2025
Python

Improve this page

Add a description, image, and links to the vllm-middleware topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vllm-middleware topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

vllm-middleware

Here is 1 public repository matching this topic...

longern / vllm-finetune-middleware

Improve this page

Add this topic to your repo