Mozilla and Justine Tunney have launched llamafile, a single multi-GB file that allows users to run Large Language Models (LLMs) on their own computers. The file includes both the model weights for an LLM and the code needed to run it. The executable is compiled using Cosmopolitan Libc, enabling it to work on multiple operating systems and hardware architectures.
Read more…
