Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Aug 19, 2021

• Add issue templates

  jeffra

  authored
  10b4840

  Copy full SHA for 10b4840

Commits on Aug 18, 2021

• [docs] update moe features and news post

  jeffra

  committed
  6cd5f87

  Copy full SHA for 6cd5f87

• add MoE press release links

  jeffra

  committed
  058ab81

  Copy full SHA for 058ab81

• Updating the torch version check to numeric (#1314)

  pruthvistony

  authored
  e804f15

  Copy full SHA for e804f15

Commits on Aug 17, 2021

• add moe to sidebar

  jeffra

  committed
  e070a09

  Copy full SHA for e070a09

• MoE read the docs update (#1312)

  jeffra

  authored
  9cb64a1

  Copy full SHA for 9cb64a1

• bump 0.5.1, DSE, moe docs

  jeffra

  committed
  a1de767

  Copy full SHA for a1de767

• DeepSpeed MoE (#1310)

  Show description for f284324
  

  10 peopleauthored
  f284324

  Copy full SHA for f284324

Commits on Aug 16, 2021

• Curriculum learning (#1307)

  Show description for b2b34ae
  

  conglongli

  and

  jeffra

  authored
  b2b34ae

  Copy full SHA for b2b34ae

Commits on Aug 10, 2021

• bump to 0.4.6

  jeffra

  committed
  504893a

  Copy full SHA for 504893a

Commits on Aug 6, 2021

• Use correct input size for splits (#1284)

  Show description for c543a41
  tjruwase

  authored
  c543a41

  Copy full SHA for c543a41

• Align gradient partitioning order (#1274)

  tjruwase

  authored
  b1b4175

  Copy full SHA for b1b4175

Commits on Aug 5, 2021

• Update adam.py (#1278)

  Show description for 00320a9
  DT6A

  authored
  00320a9

  Copy full SHA for 00320a9

Commits on Aug 2, 2021

• ZeRO-1 empty grads fix + tests (#1273)

  Show description for adc21a4
  jeffra

  authored
  adc21a4

  Copy full SHA for adc21a4

Commits on Jul 30, 2021

• bump to 0.4.5

  jeffra

  committed
  1ff2574

  Copy full SHA for 1ff2574

• [Doc] round_robin_gradients (#1261)

  Show description for 40c381d
  tjruwase

  authored
  40c381d

  Copy full SHA for 40c381d

Commits on Jul 29, 2021

• query for libaio package using known package managers (#1250)

  Show description for e82060d
  

  adammoody

  and

  tjruwase

  authored
  e82060d

  Copy full SHA for e82060d

Commits on Jul 28, 2021

• Use correct default for round robin gradients (#1258)

  Show description for 97f7ed9
  tjruwase

  authored
  97f7ed9

  Copy full SHA for 97f7ed9

• Fix cudaErrorInvalidConfiguration in attn_softmax() for large seq_length*heads values (#1239)

  Show description for bfe7f0d
  

  3 peopleauthored
  bfe7f0d

  Copy full SHA for bfe7f0d

• Make round robin gradient partitioning configurable (default False) (#1256)

  tjruwase

  authored
  4d420df

  Copy full SHA for 4d420df

Commits on Jul 27, 2021

• ignore overlap/contiguous_gradients if using zero 1 (#1246)

  Show description for 6ae756c
  

  jeffra

  and

  tjruwase

  authored
  6ae756c

  Copy full SHA for 6ae756c

Commits on Jul 26, 2021

• aio: note the reason for compiling with -O0 (#1249)

  Show description for 10cc2c9
  

  adammoody

  and

  tjruwase

  authored
  10cc2c9

  Copy full SHA for 10cc2c9

Commits on Jul 24, 2021

• aio: test link against libaio using distutils (#1247)

  adammoody

  authored
  6ec8496

  Copy full SHA for 6ec8496

Commits on Jul 20, 2021

• Fixing inference api for FP32 and non-masking GPT-based models (#1204)

  Show description for 6ba9628
  RezaYazdaniAminabadi

  authored
  6ba9628

  Copy full SHA for 6ba9628

• [zero2] zero_param_shapes: switch to round_robin_fp16_groups (#1240)

  Show description for 7392e45
  stas00

  authored
  7392e45

  Copy full SHA for 7392e45

Commits on Jul 16, 2021

• [see_memory_usage] fix deprecation (#1234)

  Show description for 32e85ed
  

  stas00

  and

  tjruwase

  authored
  32e85ed

  Copy full SHA for 32e85ed

Commits on Jul 15, 2021

• enable async io op on powerpc architectures (#1224)

  Show description for 89b0fb4
  

  adammoody

  and

  tjruwase

  authored
  89b0fb4

  Copy full SHA for 89b0fb4

Commits on Jul 14, 2021

• [zero3] fix reference counting in backward over multiple forwards (#1227)

  Show description for 3fa2420
  stas00

  authored
  3fa2420

  Copy full SHA for 3fa2420

Commits on Jul 13, 2021

• [zero3] release tmp memory when consolidating fp16 weights take2 (#1223)

  Show description for 8103946
  

  stas00

  and

  tjruwase

  authored
  8103946

  Copy full SHA for 8103946

• Bump addressable from 2.7.0 to 2.8.0 in /docs (#1225)

  Show description for 54bed32
  

  dependabot[bot]

  and

  jeffra

  authored
  54bed32

  Copy full SHA for 54bed32

• ZeRO2-Offload: Disable copy overlapping (#1219)

  Show description for 97207c8
  tjruwase

  authored
  97207c8

  Copy full SHA for 97207c8

Commits on Jul 12, 2021

• formatting fix for release script

  jeffra

  committed
  d1a7a55

  Copy full SHA for d1a7a55

• bump to 0.4.4 + add release scripts

  jeffra

  committed
  dba0f43

  Copy full SHA for dba0f43

• revert part of #1220 (#1221)

  Show description for bc451c0
  stas00

  authored
  bc451c0

  Copy full SHA for bc451c0

• [zero3] release tmp memory when consolidating fp16 weights (#1220)

  Show description for 2660cc4
  

  stas00

  and

  tjruwase

  authored
  2660cc4

  Copy full SHA for 2660cc4