vLLM Docker Image
Docker-compose file that runs vLLM locally.
Docker-Compose
There is an example of a Docker-compose file in the repository.
Clone the LmScript repository and:
cd docker/sglangdocker-compose up
Docker-compose file that runs vLLM locally.
There is an example of a Docker-compose file in the repository.
Clone the LmScript repository and:
cd docker/sglangdocker-compose up