Issues

• Gpt-Oss-20B follow-up - Yarn embeddings in FMS way

  foundation-model-stack/foundation-model-stack#511 · Filter by author flaviabeo opened on Mar 3, 2026

• Use search instead of match in _hf_to_fms_rope() adapter

  foundation-model-stack/foundation-model-stack#491 · Filter by author rzbhatti opened on Nov 21, 2025
  

• Gpt-Oss-20B follow-up - Implement TPMultiheadAttention support

  foundation-model-stack/foundation-model-stack#480 · Filter by author flaviabeo opened on Oct 17, 2025

• Gpt-Oss-20B follow-up - Add HF equivalency tests

  foundation-model-stack/foundation-model-stack#479 · Filter by author flaviabeo opened on Oct 15, 2025

• Gpt-Oss-20B follow-up - Model unfuse weights

  foundation-model-stack/foundation-model-stack#478 · Filter by author flaviabeo opened on Oct 15, 2025

• Gpt-Oss-20B follow-up - Add optmizations to attention and MoE code.

  foundation-model-stack/foundation-model-stack#477 · Filter by author flaviabeo opened on Oct 15, 2025

• Add support to openai/gpt-oss-20b

  foundation-model-stack/foundation-model-stack#461 · Filter by author flaviabeo opened on Aug 20, 2025

• Migrate to pyproject.toml based packaging of FMS

  foundation-model-stack/foundation-model-stack#450 · Filter by author rzbhatti opened on Jul 14, 2025

• [serialization] no guarantee that dictionary has to or device

  Bug

  foundation-model-stack/foundation-model-stack#443 · Filter by author kcirred opened on Jul 7, 2025
  1

• Add unit tests for the tekken tokenizer class

  foundation-model-stack/foundation-model-stack#439 · Filter by author rzbhatti opened on Jul 2, 2025

• Port mistralai/Mistral-Small-3.1-24B-Instruct-2503 to FMS

  foundation-model-stack/foundation-model-stack#428 · Filter by author rzbhatti opened on Jun 23, 2025
  1

  

• Infer GPTQ model from hf model config

  enhancement
  foundation-model-stack/foundation-model-stack#392 · Filter by author JRosenkranz opened on Apr 8, 2025
  

• Issue loading models from HF Hub on CPU

  foundation-model-stack/foundation-model-stack#376 · Filter by author tdoublep opened on Jan 16, 2025
  2

• Variable naming

  foundation-model-stack/foundation-model-stack#350 · Filter by author abalib opened on Oct 9, 2024

• new llama variants cannot be handled through adapters as the head size is not supported

  foundation-model-stack/foundation-model-stack#344 · Filter by author JRosenkranz opened on Sep 26, 2024

• GPTQ fails with cuda-old kernels

  foundation-model-stack/foundation-model-stack#337 · Filter by author andrea-fasoli opened on Sep 12, 2024

• ghstack conflicts with new DCO checks

  foundation-model-stack/foundation-model-stack#323 · Filter by author ani300 opened on Aug 13, 2024
  

• Roberta loading from HF

  foundation-model-stack/foundation-model-stack#300 · Filter by author JRosenkranz opened on Jul 10, 2024

• Mixtral Loading from safetensors

  foundation-model-stack/foundation-model-stack#299 · Filter by author JRosenkranz opened on Jul 10, 2024

• QKV double-initialization

  good first issue
  foundation-model-stack/foundation-model-stack#298 · Filter by author daviswer opened on Jul 9, 2024

• torch.export integration with FMS

  foundation-model-stack/foundation-model-stack#293 · Filter by author ani300 opened on Jun 27, 2024
  3

  

• Would Be Helpful to Set A & B When Calling trunc_normal_ in Initialization

  foundation-model-stack/foundation-model-stack#289 · Filter by author jasonkrone opened on Jun 21, 2024

• upgrade lm eval script to allow latest version of harness

  good first issue
  foundation-model-stack/foundation-model-stack#276 · Filter by author nairbv opened on May 30, 2024

• AssertionError: Hidden dim must be divisible by world size

  foundation-model-stack/foundation-model-stack#274 · Filter by author MBGub opened on May 27, 2024
  3

• [WIP] Rotated Quantization for Accuracy in Matrix Multiplication

  foundation-model-stack/foundation-model-stack#271 · Filter by author RishiAstra opened on May 23, 2024