The model startup using vllm failed.
10
#5 opened about 1 month ago
by
beausoft
can this model be Quantized?
3
#4 opened about 2 months ago
by
tinging
Sadly, Amperes are not supported😢
🚀
😔
3
#3 opened 2 months ago
by
Saaiet
Did someone get it running on 4 NVIDIA RTX PRO 6000 Blackwell (96 GB) GPUs?
👍
4
#2 opened 2 months ago
by
FabianHeller
Aww Man!
20
#1 opened 2 months ago
by
mtcl