Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on May 5, 2023

• Merge pull request #21 from ROCmSoftwarePlatform/depracate_torch_six

  Show description for 51a356e
  pruthvistony

  authored
  51a356e

  Copy full SHA for 51a356e

• Remove deprecated torch._six

  pruthvistony

  committed
  e174469

  Copy full SHA for e174469

Commits on Mar 1, 2022

• Added scripts to run Megatron-LM GPT2 on 16 GPUs (#20)

  rraminen

  authored
  13dd695

  Copy full SHA for 13dd695

Commits on Dec 7, 2021

• Set train_batch_size=8 (#18)

  rraminen

  authored
  aae9984

  Copy full SHA for aae9984

Commits on Dec 6, 2021

• Merge pull request #17 from rraminen/zero2_8.3B

  Show description for 6851b04
  jithunnair-amd

  authored
  6851b04

  Copy full SHA for 6851b04

Commits on Dec 3, 2021

• Added ds_pretrain_gpt2-zero2_8.3B_params.sh script

  rraminen

  committed
  d019bb7

  Copy full SHA for d019bb7

Commits on Nov 23, 2021

• Merge pull request #16 from rraminen/IFU-master-2021-11-23

  Show description for 206e48b
  jithunnair-amd

  authored
  206e48b

  Copy full SHA for 206e48b

• IFU-master-2021-11-23

  rraminen

  committed
  680f87c

  Copy full SHA for 680f87c

Commits on Nov 22, 2021

• Merge pull request #15 from rraminen/Megatron-LM_zero2_script_update

  Show description for 28749b8
  rraminen

  authored
  28749b8

  Copy full SHA for 28749b8

• Added missing code in PR 14

  rraminen

  committed
  09aaeee

  Copy full SHA for 09aaeee

• Merge pull request #14 from rraminen/Megatron-LM_zero2_script_update

  Show description for 9d7eb21
  jeffdaily

  authored
  9d7eb21

  Copy full SHA for 9d7eb21

• Created ds_pretrain_gpt2-zero2_pipeclean.sh

  rraminen

  committed
  5721615

  Copy full SHA for 5721615

Commits on Nov 18, 2021

• Enabled Megatron-LM-v1.1.5-ZeRO3-8.3B_param model on 8 GPUs and MP_SIZE=1 (#13)

  rraminen

  authored
  a62a5b9

  Copy full SHA for a62a5b9

Commits on Nov 16, 2021

• Update documentation about Megatron examples (#141)

  Show description for 1fed12e
  

  conglongli

  and

  jeffra

  authored
  1fed12e

  Copy full SHA for 1fed12e

Commits on Nov 13, 2021

• add autotuning hf examples (#146)

  Show description for 2467552
  cli99

  authored
  2467552

  Copy full SHA for 2467552

Commits on Oct 30, 2021

• CL code/doc update (#142)

  conglongli

  authored
  e4d1096

  Copy full SHA for e4d1096

Commits on Oct 25, 2021

• curriculum learning fix (#139)

  conglongli

  authored
  11ca395

  Copy full SHA for 11ca395

Commits on Oct 22, 2021

• fix breaking api (#138)

  conglongli

  authored
  8d01699

  Copy full SHA for 8d01699

Commits on Oct 21, 2021

• rename beginner tutorial

  jeffra

  committed
  255e9ee

  Copy full SHA for 255e9ee

• minor edits to beginner example

  jeffra

  authored
  b33a211

  Copy full SHA for b33a211

• Add self contained beginner example (#137)

  Show description for 269b508
  

  jeffra

  and

  codedecde

  authored
  269b508

  Copy full SHA for 269b508

Commits on Oct 4, 2021

• Megatron-LM v1.1.5 ZeRO2 10B model (#12)

  Show description for 5455dfb
  rraminen

  authored
  5455dfb

  Copy full SHA for 5455dfb

Commits on Sep 22, 2021

• Merge pull request #7 from ROCmSoftwarePlatform/ROCmExamples

  Show description for 6495c60
  jithunnair-amd

  authored
  6495c60

  Copy full SHA for 6495c60

• Merge pull request #11 from rraminen/Megatron-LM_zero2_script_update

  Show description for 0608bca
  jithunnair-amd

  authored
  0608bca

  Copy full SHA for 0608bca

• Updated Megatron-LM gpt2 ZeRO 2 script

  rraminen

  committed
  5a9d3f3

  Copy full SHA for 5a9d3f3

Commits on Sep 18, 2021

• Add zero stage 2 script

  tjruwase

  committed
  174ae3b

  Copy full SHA for 174ae3b

Commits on Sep 14, 2021

• Merge pull request #10 from ROCmSoftwarePlatform/IFU-master-2021-09-14

  Show description for b96fb6a
  jithunnair-amd

  authored
  b96fb6a

  Copy full SHA for b96fb6a

• Merge pull request #9 from rraminen/update_GPT2_LR

  Show description for 7c15c7e
  jithunnair-amd

  authored
  7c15c7e

  Copy full SHA for 7c15c7e

• lowering the LR helps avoid NANs in loss

  rraminen

  committed
  93dfa9c

  Copy full SHA for 93dfa9c

• Merge remote-tracking branch 'upstream/master'

  

  github-actions

  committed
  4e7614f

  Copy full SHA for 4e7614f

Commits on Sep 10, 2021

• remove dropout from moe. (#132)

  awan-10

  authored
  24712bd

  Copy full SHA for 24712bd

Commits on Sep 1, 2021

• Disable memory usage profiler (#131)

  tjruwase

  authored
  c1b206c

  Copy full SHA for c1b206c

Commits on Aug 24, 2021

• Merge pull request #8 from ROCmSoftwarePlatform/IFU-master-2021-08-17

  Show description for 8e60df7
  jithunnair-amd

  authored
  8e60df7

  Copy full SHA for 8e60df7

Commits on Aug 22, 2021

• Fix curriculum learning example config

  Show description for 424cbae
  conglongli

  authored
  424cbae

  Copy full SHA for 424cbae

Commits on Aug 17, 2021

• Merge remote-tracking branch 'upstream/master'

  

  github-actions

  committed
  3a0fdb1

  Copy full SHA for 3a0fdb1