Remove unused import of ssl.OP_ENABLE_MIDDLEBOX_COMPAT (deepspeedai#1601

)

Several fixes for our read-the-docs build (deepspeedai#1579)

Fix 1bit extra issue (deepspeedai#1542)

Prevent creation of local temp directory (deepspeedai#1494)

Co-authored-by: Olatunji Ruwase <[email protected]>
Co-authored-by: Jeff Rasley <[email protected]>

Fix the workspace allocation for the transformer kernel (deepspeedai#…

…1397)

* fix the workspace allocation for the transformer kernel

* change layer-id type & rm one unit test due to OOM

[zero_to_fp32] adapt to 4-bytes alignment in z2 (deepspeedai#1372)

Co-authored-by: Olatunji Ruwase <[email protected]>

Update setup.py (deepspeedai#1361)

updated classifiers

Reducing the memory-overhead of creating model for multi-GPU run (dee…

…pspeedai#1244)

Co-authored-by: Jeff Rasley <[email protected]>

DeepSpeed MoE (deepspeedai#1310)

Co-authored-by: Alex Muzio <[email protected]>
Co-authored-by: Ammar Ahmad Awan <[email protected]>
Co-authored-by: Conglong Li <[email protected]>
Co-authored-by: Felipe Cruz Salinas <[email protected]>
Co-authored-by: Jeff Rasley <[email protected]>
Co-authored-by: Reza Yazdani <[email protected]>
Co-authored-by: Samyam Rajbhandari <[email protected]>
Co-authored-by: Shaden Smith <[email protected]>
Co-authored-by: Young Jin Kim <[email protected]>
Co-authored-by: bapatra <[email protected]>
Co-authored-by: Samyam Rajbhandari <[email protected]>
Co-authored-by: Shaden Smith <[email protected]>
Co-authored-by: Young Jin Kim <[email protected]>

Use correct input size for splits (deepspeedai#1284)

* Use correct input size for splits

* Use smarter partitioning