Inference · Advanced · by Georgi Gerganov
Port of LLaMA model in pure C/C++ with 1.5-bit to 8-bit integer quantization, running on Apple Silicon Metal, AVX2 x86, and NVIDIA GPUs.
The lessons that explain what this project uses.
Part of the Inference Engineering path.
Add your own repo to earn 150 XP and the Shipper badge. It appears on your profile, so it's ready for your resume.