Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Aug 17, 2021

• MoE read the docs update (#1312)

  jeffra

  authored
  9cb64a1

  Copy full SHA for 9cb64a1

Commits on Jul 12, 2021

• [model weights] zero_to_fp32 multiple improvements (#1181)

  Show description for 2a92106
  

  stas00

  and

  tjruwase

  authored
  2a92106

  Copy full SHA for 2a92106

Commits on Jun 23, 2021

• ZeRO 2+3 memory estimators (#965)

  Show description for 0c1802c
  

  3 peopleauthored
  0c1802c

  Copy full SHA for 0c1802c

Commits on May 24, 2021

• formatting fix

  jeffra

  committed
  0449cbd

  Copy full SHA for 0449cbd

• Add inference API to RTD (#1096)

  Show description for 0d701ec
  jeffra

  authored
  0d701ec

  Copy full SHA for 0d701ec

Commits on Apr 21, 2021

• 1-bit LAMB optimizer (#970)

  Show description for 67a48aa
  

  3 peopleauthored
  67a48aa

  Copy full SHA for 67a48aa

Commits on Apr 19, 2021

• assert no Z2/Z3 with pipeline and fix some docs links (#980)

  

  Shaden Smith

  authored
  fbece50

  Copy full SHA for fbece50

• ZeRO-Infinity docs (#979)

  Show description for 11279ae
  

  Shaden Smith

  authored
  11279ae

  Copy full SHA for 11279ae

• ZeRO-Infinity (#976)

  Show description for 0d4a54a
  

  4 peopleauthored
  0d4a54a

  Copy full SHA for 0d4a54a

Commits on Apr 14, 2021

• update lr scheduler doc for doing per step or epoch update (#913)

  Show description for c83e49f
  

  cli99

  and

  tjruwase

  authored
  c83e49f

  Copy full SHA for c83e49f

Commits on Apr 7, 2021

• docs (#909)

  Show description for 3169929
  

  3 peopleauthored
  3169929

  Copy full SHA for 3169929

Commits on Mar 16, 2021

• 1-bit Adam v2 (#817)

  Show description for 68c8481
  

  3 peopleauthored
  68c8481

  Copy full SHA for 68c8481

Commits on Mar 11, 2021

• small tweaks (#839)

  stas00

  authored
  7925d0c

  Copy full SHA for 7925d0c

• Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

  Show description for e0f36ed
  

  cli99

  and

  Shaden Smith

  authored
  e0f36ed

  Copy full SHA for e0f36ed

Commits on Mar 8, 2021

• ZeRO 3 Offload (#834)

  Show description for 599258f
  

  6 peopleauthored
  599258f

  Copy full SHA for 599258f

Commits on Jan 7, 2021

• Add deepspeed.init_distributed to RTD page (#645)

  Show description for 4e2dc4e
  

  jeffra

  and

  tjruwase

  authored
  4e2dc4e

  Copy full SHA for 4e2dc4e

Commits on Dec 15, 2020

• Fixes for RTD build errors (#606)

  Show description for 6380ee3
  

  jeffra

  and

  Shaden Smith

  authored
  6380ee3

  Copy full SHA for 6380ee3

Commits on Oct 30, 2020

• Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)

  Show description for f5aa254
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  f5aa254

  Copy full SHA for f5aa254

Commits on Sep 17, 2020

• readthedocs yaml configuration (#410)

  Show description for 5812e84
  

  Shaden Smith

  and

  jeffra

  authored
  5812e84

  Copy full SHA for 5812e84

Commits on Sep 10, 2020

• readthedocs upgrade (#402)

  

  Shaden Smith

  authored
  c82756c

  Copy full SHA for c82756c

• Pipeline parallel training engine. (#392)

  Show description for 65c2f97
  

  Shaden Smith

  and

  jeffra

  authored
  65c2f97

  Copy full SHA for 65c2f97

Commits on May 29, 2020

• Transformer kernel release (#242)

  Show description for 734d899
  

  8 peopleauthored
  734d899

  Copy full SHA for 734d899

Commits on May 19, 2020

• ZeRO-2 (#217)

  Show description for f2ac7ea
  

  8 peopleauthored
  f2ac7ea

  Copy full SHA for f2ac7ea

Commits on Apr 22, 2020

• README and RTD improvements. (#198)

  

  Shaden Smith

  authored
  dd166ee

  Copy full SHA for dd166ee

Commits on Mar 17, 2020

• drafting Jekyll webpage (#143)

  

  Shaden Smith

  authored
  5042dc0

  Copy full SHA for 5042dc0

Loading