OCDP/ocdp-workload-manifests
4
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
main
ocdp-workload-manifests/apps/vllm-server/README.md
jackyliu 6465520041 first commit
2026-05-28 07:21:41 +00:00

231 B
Raw Permalink Blame History

vllm-server

OpenAI-compatible model serving with vLLM.

The base is CPU-safe YAML. Add components/gpu-nvidia in environments that provide NVIDIA GPUs, and let the instance overlay patch model name, resources, and cache size.