rtx-6000

Here are 4 public repositories matching this topic...

capetron / ptg-vllm-deploy

Production vLLM deployment configs for multi-GPU setups. Docker Compose, pipeline parallelism configs for 2/4/6/8 GPU RTX 6000 Pro, H100, and H200 systems. By Petronella Technology Group.

docker-compose nvidia multi-gpu gpu-cluster pipeline-parallelism tensor-parallelism vllm llm-inference h100 ai-infrastructure rtx-6000

Updated Apr 14, 2026
Shell

vcruz305 / Qwen3.8-27B-Ada-RTX-6000

Sponsor

Star

llama.cpp recipe for Qwen3.8-27B GGUF on Ada RTX 6000 (48GB). Measured tok/s. Not Turing, not Blackwell.

ada llama-cpp qwen gguf rtx-6000

Updated Aug 14, 2026
Shell

vcruz305 / turing-rtx-6000-results

Sponsor

Star

Measured llama.cpp and Hermes results on one Quadro RTX 6000 (Turing SM75, 24GB). Not Ada. Not Blackwell.

benchmarks turing llama-cpp qwen gguf nemotron rtx-6000 hermes-agent

Updated Aug 17, 2026
Python

daimonionnn / ik-llama-toolkit

Star

A one-command inference server and benchmark harness for running large language models that don't fit in your GPU's VRAM. Optimized for RTX PRO 6000 and Deepseek v4 flash

cuda nvidia rtx llm llama-cpp deepseek mxfp4 rtx-pro-6000 rtx-6000 deepseek-v4 ik-llama-cpp deepseek-v4-flash qwen3-8-flash-next

Updated Sep 14, 2026
Shell

Add this topic to your repo

To associate your repository with the rtx-6000 topic, visit your repo's landing page and select "manage topics."

Learn more