📄️ Runpod Serverless SGLang
Pre-built Docker image that runs on
📄️ Runpod Serverless vLLM Docker Image
Pre-built Docker image that runs on
📄️ SGLang Docker Image
Pre-built Docker image that runs TheBloke/Mistral-7B-Instruct-v0.2-AWQ on SGLang
📄️ vLLM Docker Image
Docker-compose file that runs vLLM locally.