mistral-llm/old/mistral-llm0.sh

3 lines
248 B
Bash
Raw Normal View History

2026-02-23 15:01:45 +00:00
docker run --rm --gpus "device=0" --name "mistral-llm0" -e CUDA_VISIBLE_DEVICES=0 -p 8000:8000 -v /opt/models/mistral:/models -t mistral-llm:cu122-avx
#docker run --rm --gpus all -p 8000:8000 -v /opt/models/mistral:/models -t mistral-llm:cu122-avx