4846 shaares
Very exciting release. It's nice to see that with care it's possible to build a LLM which is also a common. The production of such models is fully documented and auditable. As far as I can tell the result is free of the usual negative externalities that the industrial complex tends to ignore.
Of course I advise reading the full technical report. It's so refreshing to see where they have good solutions or where they struggle. I can't suffer the "marketing disguised as research" coming from the big companies anymore.
Now looking forward to their 2.0 release, the roadmap is interesting.