llama.cpp v0.6.0: Metal Speedups, New Models and APIs
llama.cpp v0.6.0 adds a new batch API, GLM-5.3-Flash support, speculative decoding and major Apple Metal optimizations.
Read More
Browse Tag
llama.cpp
1 Article