Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Oct 21, 2021

• add ds example code + a few minor edits

  jeffra

  committed
  3ec9c13

  Copy full SHA for 3ec9c13

• Merge pull request #3 from codedecde/ds-changes

  Show description for fce9b1b
  jeffra

  authored
  fce9b1b

  Copy full SHA for fce9b1b

• Update train_bert.py

  jeffra

  authored
  fffad1f

  Copy full SHA for fffad1f

• Update README.md

  jeffra

  authored
  ee7258b

  Copy full SHA for ee7258b

• Update README.md

  jeffra

  authored
  5edfa02

  Copy full SHA for 5edfa02

• Update README.md

  jeffra

  authored
  20b31f6

  Copy full SHA for 20b31f6

Commits on Oct 20, 2021

• spelling mistakes and typographic edits

  codedecde

  committed
  34c0bab

  Copy full SHA for 34c0bab

• spelling mistakes and typographic edits

  codedecde

  committed
  c7faed8

  Copy full SHA for c7faed8

• spelling mistakes and typographic edits

  codedecde

  committed
  2cabe80

  Copy full SHA for 2cabe80

• spelling mistakes and typographic edits

  codedecde

  committed
  3b70377

  Copy full SHA for 3b70377

• spelling mistakes and typographic edits

  codedecde

  committed
  288ff21

  Copy full SHA for 288ff21

• updated README

  codedecde

  committed
  d5088cc

  Copy full SHA for d5088cc

Commits on Oct 19, 2021

• Update README.md

  jeffra

  authored
  c31e28b

  Copy full SHA for c31e28b

• Merge pull request #1 from codedecde/jeffra/local_rank_patch

  Show description for 2553e90
  codedecde

  authored
  2553e90

  Copy full SHA for 2553e90

• change device to local_rank and simplify fire

  jeffra

  committed
  5b7fcdc

  Copy full SHA for 5b7fcdc

• added test case for train_bert

  codedecde

  committed
  2c6ff0a

  Copy full SHA for 2c6ff0a

• checkpointing

  codedecde

  committed
  b0fc585

  Copy full SHA for b0fc585

• docstrings + black + isort

  codedecde

  committed
  1501876

  Copy full SHA for 1501876

• adding some error catches

  codedecde

  committed
  349e944

  Copy full SHA for 349e944

Commits on Oct 18, 2021

• tutorial work in progress

  codedecde

  committed
  cbd3d7c

  Copy full SHA for cbd3d7c

Commits on Sep 18, 2021

• Add zero stage 2 script

  tjruwase

  committed
  174ae3b

  Copy full SHA for 174ae3b

Commits on Sep 10, 2021

• remove dropout from moe. (#132)

  awan-10

  authored
  24712bd

  Copy full SHA for 24712bd

Commits on Sep 1, 2021

• Disable memory usage profiler (#131)

  tjruwase

  authored
  c1b206c

  Copy full SHA for c1b206c

Commits on Aug 22, 2021

• Fix curriculum learning example config

  Show description for 424cbae
  conglongli

  authored
  424cbae

  Copy full SHA for 424cbae

Commits on Aug 17, 2021

• DeepSpeed MoE Usage Example (#127)

  Show description for 448e191
  

  3 peopleauthored
  448e191

  Copy full SHA for 448e191

Commits on Aug 16, 2021

• Curriculum learning examples (#126)

  conglongli

  authored
  ca278ba

  Copy full SHA for ca278ba

Commits on May 24, 2021

• DS inference examples (#53) (#111)

  Show description for 25d73cf
  

  4 peopleauthored
  25d73cf

  Copy full SHA for 25d73cf

Commits on Apr 29, 2021

• Z3 arg update (#105)

  jeffra

  authored
  1273725

  Copy full SHA for 1273725

Commits on Apr 21, 2021

• 1-bit LAMB optimizer example scripts (#97)

  Show description for f94591e
  conglongli

  authored
  f94591e

  Copy full SHA for f94591e

Commits on Apr 19, 2021

• Add Megatron clarification (#99)

  awan-10

  authored
  d7e23dd

  Copy full SHA for d7e23dd

• ZeRO-Infinity examples (#98)

  Show description for bdf8e59
  

  3 peopleauthored
  bdf8e59

  Copy full SHA for bdf8e59

Commits on Mar 16, 2021

• 1-bit Adam v2 example scripts (#89)

  Show description for 590364d
  conglongli

  authored
  590364d

  Copy full SHA for 590364d

Commits on Mar 10, 2021

• missed PR merge after Init rename (#93)

  

  Shaden Smith

  authored
  20ea07a

  Copy full SHA for 20ea07a

Commits on Mar 8, 2021

• Megatron + ZeRO-3 (#91)

  Show description for 2cd968f
  

  4 peopleauthored
  2cd968f

  Copy full SHA for 2cd968f

Commits on Feb 4, 2021

• Megatron 3D parallelism example (#82)

  

  Shaden Smith

  authored
  1bee84f

  Copy full SHA for 1bee84f