Catalog / Transformers

5.20.1

Release v5.20.1

todayaddedfixedOriginal notes

Release v5.20.1

Special surprise including the new model Beam from Reflection AI :partying_face:

Beam is a token-efficient, frontier-scale model focused on coding and agentic use cases. It is built for teams that want to run a powerful model on their own hardware, infrastructure, or cloud, and customize it to their specific needs.

Links: Documentation

  • Fix small bug in auto mappings (#49664) by @yonigozlan in #49664

Some real patch fixes

We broke loading models on older torch versions :cry: should be fixed now. But here is the full list of fixes

  • Fix HunYuan-VL image assignment during batched generation (#49557) by @Arnav66692
  • Fix DeepGEMM Mega MoE under expert parallelism(#49428) by @IlyasMoutawwakil
  • Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing (#49652) by @naveecode
  • Make DtensorShardOperation work on torch 2.6 and 2.7 (#49657) by @hazelxue

Full Changelog: https://github.com/huggingface/transformers/compare/v5.20.0...v5.20.1