Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Oct 23, 2023

• Update requirement.txt (#789)

  xiaoxiawu-microsoft

  authored
  737c674

  Copy full SHA for 737c674

Commits on Oct 17, 2023

• deepspeed-chat: add end-of-text special token (#775)

  Show description for e8d879e
  

  3 peopleauthored
  e8d879e

  Copy full SHA for e8d879e

• deepspeed-chat: fix training stage1 ppl calculation (#773)

  Show description for f7ff9dd
  

  3 peopleauthored
  f7ff9dd

  Copy full SHA for f7ff9dd

• deepspeed-chat: fix bf16 stage2 accuracy for bloom-560m (#772)

  Show description for 185e25c
  

  mosheisland

  and

  Moshe Island

  authored
  185e25c

  Copy full SHA for 185e25c

Commits on Oct 16, 2023

• deepspeed-chat: fix weight decay configuration (#755)

  Show description for 8d850ba
  

  3 peopleauthored
  8d850ba

  Copy full SHA for 8d850ba

• deepspeed-chat: train v_head when only optimizing lora (#758)

  Show description for 5161c0f
  

  3 peopleauthored
  5161c0f

  Copy full SHA for 5161c0f

Commits on Oct 12, 2023

• Resolves the issue with evaluation on step2 for single GPU (#766)

  Show description for 3517c6d
  

  PareesaMS

  and

  mrwyattii

  authored
  3517c6d

  Copy full SHA for 3517c6d

Commits on Oct 11, 2023

• Resolving epochs being hard-coded (#759)

  Show description for 1ba50ed
  

  PareesaMS

  and

  mrwyattii

  authored
  1ba50ed

  Copy full SHA for 1ba50ed

Commits on Oct 9, 2023

• Fix typo (#749)

  Show description for 0855679
  

  xu-song

  and

  tjruwase

  authored
  0855679

  Copy full SHA for 0855679

Commits on Oct 8, 2023

• add the path to load the local dataset (#761)

  ys950902

  authored
  10aef97

  Copy full SHA for 10aef97

Commits on Oct 4, 2023

• deepspeed-chat: support periodic eval in stage2 (#747)

  Show description for bfad08f
  

  3 peopleauthored
  bfad08f

  Copy full SHA for bfad08f

• deepspeed-chat: calculate loss in fp32 (#754)

  Show description for e6f400a
  

  mosheisland

  and

  Moshe Island

  authored
  e6f400a

  Copy full SHA for e6f400a

Commits on Oct 3, 2023

• Update README.md (#757)

  xiaoxiawu-microsoft

  authored
  4364031

  Copy full SHA for 4364031

• Deepspeed-VisualChat (#753)

  Show description for 6c05e03
  

  3 peopleauthored
  6c05e03

  Copy full SHA for 6c05e03

• support `trust_remote_code` in inference test (#709)

  Show description for ca41e8b
  

  3 peopleauthored
  ca41e8b

  Copy full SHA for ca41e8b

• Add default value for tokenizer path (#699)

  Show description for 0d11c63
  

  3 peopleauthored
  0d11c63

  Copy full SHA for 0d11c63

• deepspeed-chat: fix incorrect lr when using lora only (#756)

  Show description for ca03bd7
  

  mosheisland

  and

  Moshe Island

  authored
  ca03bd7

  Copy full SHA for ca03bd7

• deepspeed-chat: support explicit configuration of dropout (#746)

  Show description for 4bf1924
  

  3 peopleauthored
  4bf1924

  Copy full SHA for 4bf1924

• deepspeed-chat: handle overflow for bf16_optimizer (#745)

  Show description for 2f99dcd
  

  mosheisland

  and

  Moshe Island

  authored
  2f99dcd

  Copy full SHA for 2f99dcd

Commits on Oct 2, 2023

• Fix padding and dtype issues (#738)

  Show description for 58e4e9c
  tjruwase

  authored
  58e4e9c

  Copy full SHA for 58e4e9c

• deepspeed-chat: support any model in chatbot (#744)

  Show description for d8f3f73
  

  mosheisland

  and

  Moshe Island

  authored
  d8f3f73

  Copy full SHA for d8f3f73

Commits on Sep 22, 2023

• support bf16 for RLHF training (#733)

  ys950902

  authored
  9b3d898

  Copy full SHA for 9b3d898

• support DeepSpeedChat to run on different device besides cuda (#736)

  ys950902

  authored
  db56381

  Copy full SHA for db56381

• Update README.md (#739)

  NinoRisteski

  authored
  9c94044

  Copy full SHA for 9c94044

Commits on Sep 19, 2023

• Filter transformers version 4.33.2 due to bug (#735)

  Show description for 27b60d2
  lekurile

  authored
  27b60d2

  Copy full SHA for 27b60d2

Commits on Sep 14, 2023

• Update Llama check to use module instead of model (#734)

  Show description for bae2afb
  lekurile

  authored
  bae2afb

  Copy full SHA for bae2afb

Commits on Sep 13, 2023

• FlexGen reference (#730)

  Show description for 0b30bcb
  tjruwase

  authored
  0b30bcb

  Copy full SHA for 0b30bcb

Commits on Sep 12, 2023

• Update README.md to add python formatting in code examples (#729)

  imJunaidAfzal

  authored
  902a0f6

  Copy full SHA for 902a0f6

Commits on Sep 11, 2023

• ZeRO-Inference refresh (#722)

  Show description for 12f78ec
  tjruwase

  authored
  12f78ec

  Copy full SHA for 12f78ec

• Update README.md (#726)

  Show description for 7526d55
  

  NinoRisteski

  and

  tjruwase

  authored
  7526d55

  Copy full SHA for 7526d55

• Update README.md (#727)

  Show description for 44ade96
  NinoRisteski

  authored
  44ade96

  Copy full SHA for 44ade96

Commits on Sep 5, 2023

• Skip hierarchical partitioning ZeRO (hpZ) for single node (#717)

  HeyangQin

  authored
  20f0a85

  Copy full SHA for 20f0a85

Commits on Aug 31, 2023

• Update README.md (#714)

  awan-10

  authored
  6c83ac2

  Copy full SHA for 6c83ac2

• add updates for the new release. (#712)

  awan-10

  authored
  4355784

  Copy full SHA for 4355784

• add mixz script (#711)

  HeyangQin

  authored
  845ac3e

  Copy full SHA for 845ac3e