I measured the actual GPU electricity for eight local models on one RTX 3090 — and the cheapest wasn’t the smallest, nor the priciest the biggest.
The post How Much Does It Actually Cost to Run a Local LLM? (Euros per Million Tokens, Measured) appeared first on Towards Data Science.
