Hugging Face adds native GGUF support to Transformers

🚀 RELEASES & LAUNCHES

• Hugging Face adds native GGUF support to Transformers
  Hugging Face added native GGUF loading to Transformers.
  • Local AI users on Apple Silicon Macs can run GGUF checkpoints through Transformers.
  • The feature loads Hub GGUF files with from_pretrained and supports standard PyTorch generation APIs.
  • Transformers can serve GGUF models through an OpenAI-compatible API via transformers serve.
  • Quantized files reduce memory needs: Qwen3.5-4B Q4_K_M is 2.74 GB versus 8.42 GB in BF16.
  • The integration gives builders Transformers tooling for debugging, evaluation, and custom generation while reusing ggml kernels on supported Apple Silicon.
  Sources 📄 Source: github.com · 📎 Coverage: huggingface.co · 👁 via r/LocalLLaMA