They produced Apertus, and now this for the inference. There's really interesting work getting out of EPFL lately. It all helps toward more ethical and frugal production (and use) of LLMs. Those efforts are definitely welcome.

This is definitely an exciting new option for Python development.

Use the log levels responsibly in your applications. Indeed, what are at most warnings are too often reported as errors.