How Much Does It Actually Cost to Run a Local LLM? (Euros per Million Tokens, Measured)

The article presents a practical cost analysis of running local LLMs, measuring GPU electricity consumption for eight models on a single RTX 3090. It reveals that the cheapest model to run is not necessarily the smallest, nor the most expensive the largest, providing insights into cost efficiency per million tokens.