#infrastructure
Posts tagged infrastructure.
-
A little LLM lab on the DGX Spark
How I set up a self-hosted, OpenAI-compatible LLM on an NVIDIA DGX Spark — SGLang, a LiteLLM gateway, and Grafana dashboards — all driven by one config file and one command.