v0.17.5 Patch Release

What's Changed

• Update version.txt after v0.17.4 release by @loadams in #7460
• Update README.md by @PKUWZP in #7465
• Add getter APIs for TP/PP/DP ranks in DeepSpeedEngine by @WoosungMyung in #7427
• fix issues raised by Coverity scans by @NirSonnenschein in #7431
• Fix all-gather duplicate params and wrong dtype by @eternalNight in #7462
• fix #7188 by @lpnpcs in #7371
• add --bind_cores_to_rank to zero offload tutorial by @delock in #7474
• Add blog for ZenFlow by @Antlera in #7463
• Fix cpu CI by @sfc-gh-truwase in #7481
• fix deepspeed --venv_script by @stas00 in #7469
• Modal CI by @sfc-gh-truwase in #7289
• [UlyssesSPDataLoaderAdapter] fix iterator reset by @stas00 in #7472
• [TiledFusedLogitsLoss] support inference by @stas00 in #7477
• Fix pre-compile on cpu-only machines by @AlongWY in #7168
• Enable forked PRs by @sfc-gh-truwase in #7486
• fix xpu device_id AttributeError issue by @yao-matrix in #7488
• Add Zenflow code for Stage 1 & 2 by @Antlera in #7391
• Fix invalid f-strings by @cyyever in #7457
• Fix DeepCompile for PyTorch v2.8 by @tohtana in #7496
• Reduce performance impact of compiler.enable decorator by @deepcharm in #7498
• Add index to HPU devices by @deepcharm in #7497

New Contributors

• @WoosungMyung made their first contribution in #7427
• @eternalNight made their first contribution in #7462
• @lpnpcs made their first contribution in #7371
• @Antlera made their first contribution in #7463
• @AlongWY made their first contribution in #7168
• @yao-matrix made their first contribution in #7488
• @cyyever made their first contribution in #7457

Full Changelog: v0.17.4...v0.17.5

v0.17.4 Patch Release

What's Changed

• Update version.txt after 0.17.3 release. by @loadams in #7455
• Fix: UnboundLocalError for variable 'dim' about issue by @weeknan in #7449
• adding TiledFusedLogitsLoss by @stas00 in #7437
• TiledFusedLogitsLoss bug fix by @stas00 in #7459

New Contributors

• @weeknan made their first contribution in #7449

Full Changelog: v0.17.3...v0.17.4

v0.17.3 Patch Release

What's Changed

• [TiledMLP]: fix for bs>1 by @stas00 in #7412
• Update version.txt after v0.17.2 release. by @loadams in #7417
• Enable torch version dependent compilation of record_module and iter_params by @deepcharm in #7362
• [BUGFIX] Reset bucket.elements after reduction in ZeRO Stage 3 by @rahul713rk in #7418
• Align missing argument in AllReduceCoalescedHandle by @deepcharm in #7414
• Improvements to Communication Logger by @alexk101 in #7404
• trying to fix nv-accelerate-v100.yml CI job by @stas00 in #7424
• fix: Propagate strip_tensor_paddings by @saforem2 in #7426
• Use past_key_value when provided by @deepcharm in #7428
• set device_id in torch's init_process_group by @stas00 in #7266
• [Ulysses-ALST] add FA3 support by @stas00 in #7430
• TiledMLP + SequenceTiledCompute: improve the bs>1 use-case by @stas00 in #7422
• Remove unused yaml test configurations and update README by @loadams in #7441
• [ALST] fix typo in the url by @stas00 in #7444
• [ALST] fix typo in the url part2 by @stas00 in #7446
• Remove additional unused tests (human-eval) by @loadams in #7445
• Fix: Adapt Llama injection policy for newer transformers versions by @huanyuqu in #7443

New Contributors

• @rahul713rk made their first contribution in #7418
• @huanyuqu made their first contribution in #7443

Full Changelog: v0.17.2...v0.17.3

v0.17.2 Patch Release

What's Changed

• Update version after 0.17.1 release by @loadams in #7345
• s/UlyssesPlus/Arctic Long Sequence Training (ALST)/ by @stas00 in #7348
• Don't break set_start_method by @tjruwase in #7349
• Fix error of <glog/logging.h> by @Freed-Wu in #7351
• Improve padding util for compile by @tohtana in #7355
• Fix 404s by @tjruwase in #7363
• Fix tutorial title by @stas00 in #7365
• Restore real inputs for recompilation by @tohtana in #7356
• Fix(scheduler): WarmupLR inherits optimizer lr when not specified by @Flink-ddd in #7360
• sequence parallel default dtype by @stas00 in #7364
• Enable torch.autocast with ZeRO by @tohtana in #6993
• add Arctic Long Sequence Training paper reference by @stas00 in #7372
• Flops profiler support for F.interpolate by @sfc-gh-truwase in #7353
• Relax tolerances for FP8 unit test only for ROCm + FP16 by @rraminen in #7373
• Update latest news with DeepNVMe by @loadams in #7375
• Fix release of IPG buffer by @tohtana in #7376
• fix wandb.log() call by removing sync kwarg by @ned2 in #7383
• Fix dtype mismatch in TestParamPartitioningSkipInit by @tohtana in #7377
• Add support for ws=1 scenario by @NirSonnenschein in #7379
• fix(inference): Add missing dtype attribute to ParameterBase setter by @Flink-ddd in #7378
• add blog link by @stas00 in #7385
• fix broken url by @stas00 in #7390
• add support for CUDAtk12.9 by @loscrossos in #7394
• Fix unbound local error for return_val by @HollowMan6 in #7395
• Fix ZeRO stage 1 and add stage 2 support with DeepCompile by @tohtana in #7366
• Improve coverage of DeepCompile by @tohtana in #7386
• Added device detection to communication logging by @alexk101 in #7398
• fix: Add csrc/compile to include paths for DeepCompile builder by @HollowMan6 in #7401
• fix: DeepCompile for torch 2.8 by @HollowMan6 in #7402
• fix(comm): Expose GradBucket in deepspeed.comm API by @Flink-ddd in #7400
• fix: fix FileNotFoundError for build_win.bat by @gjj2828 in #7399
• fix: engine initializes optimizer attributes at the beginning by @HollowMan6 in #7410

New Contributors

• @Freed-Wu made their first contribution in #7351
• @Flink-ddd made their first contribution in #7360
• @ned2 made their first contribution in #7383
• @alexk101 made their first contribution in #7398
• @gjj2828 made their first contribution in #7399

Full Changelog: v0.17.1...v0.17.2

v0.17.1 Patch Release

What's Changed

• Update version.txt after v0.17.0 release by @loadams in #7326
• Ulysses Plus Docs by @stas00 in #7331
• UlyssesPlus Docs take 2 by @stas00 in #7332
• Improve Ulysses Plus Docs by @cynricfu in #7335
• Update config_utils.py by @qgallouedec in #7333
• Fix pytest version to 8.3.5 in hpu-gaudi actions by @raza-sikander in #7337
• Fix issue with symint input by @tohtana in #7243
• fp16 optimizer timers fix - TypeError: 'NoneType' object is not callable by @rraminen in #7330
• DeepNVMe update by @tjruwase in #7215
• fixed: Modified the topkgating function and modified the test_moe file for testing by @xiongjyu in #7163
• Fix LoRA arxiv reference by @emmanuel-ferdman in #7340
• Update folder name by @sfc-gh-truwase in #7343
• Improve overflow handling in ZeRO by @tjruwase in #6976
• Fix docs that are rendering Incorrectly by @felixgondwe in #7344
• Move pytest pinning from individual tests to requirements-dev.txt until fixed. by @loadams in #7327

New Contributors

• @cynricfu made their first contribution in #7335
• @xiongjyu made their first contribution in #7163
• @sfc-gh-truwase made their first contribution in #7343
• @felixgondwe made their first contribution in #7344

Full Changelog: v0.17.0...v0.17.1

DeepSpeed v0.17.0

What's Changed

• Update next version in version.txt after 0.16.9 release. by @loadams in #7306
• Update COMMITTERS.md by @PKUWZP in #7305
• Fix AutoTP gathering replaced layer params when bias is not None by @HollowMan6 in #7257
• Fix the GPU memory usage of ZeRO-Offload (only update stage_1_and_2.py) by @arminzhu in #7309
• Fix: Update grad norm calculation for CPU offload by @therealnaveenkamal in #7302
• CI: prefer bf16 over fp16 by @stas00 in #7304
• tests/conftest.py: automatically add local deepspeed repo when running tests by @stas00 in #7317
• Update gaudi2 nightly,ci to latest 1.21.0 build by @raza-sikander in #7313
• anchor transformers version by @stas00 in #7316
• fix asymmetric in dequantize by @pencil-hub in #7283
• Ulysses SP for HF Integration by @stas00 in #7268
• Fix ci hang in torch2.7& improve ut by @inkcherry in #7321
• Bump to v0.17.0 by @sfc-gh-mwyatt in #7324

New Contributors

• @PKUWZP made their first contribution in #7305
• @arminzhu made their first contribution in #7309
• @therealnaveenkamal made their first contribution in #7302
• @pencil-hub made their first contribution in #7283
• @sfc-gh-mwyatt made their first contribution in #7324

Full Changelog: v0.16.9...v0.17.0

v0.16.9 Patch Release

What's Changed

• Update patch version after 0.16.8 release by @loadams in #7296
• Avoid graph break by removing another redundant requires grad false by @deepcharm in #7263
• Add qwen3 meta loading for AutoTP by @delock in #7293
• Modernize system executable detection across components by @emmanuel-ferdman in #7290
• Enable ZeRO set/get APIs for NVMe offload by @tjruwase in #7046
• Add qwen3moe meta loading for AutoTP by @ranzhejiang in #7297
• disable license check until the new license situation has been sorted… by @stas00 in #7301
• Fix extra_repr_str when weight is None / in zero-3 by @HollowMan6 in #7254
• [XPU] Support XCCL on deepspeed side by @ys950902 in #7299

New Contributors

• @emmanuel-ferdman made their first contribution in #7290

Full Changelog: v0.16.8...v0.16.9

v0.16.8 Patch Release

What's Changed

• Update version.txt after 0.16.7 release by @loadams in #7232
• Recommend using latest by @tohtana in #7233
• [NFC] Fix comment related to SP group by @c8ef in #7234
• Add cpu accelerator fp16 dtype support by @Yejing-Lai in #7207
• Update CPU torch version to 2.7 by @loadams in #7241
• Update README.md by @jizhang02 in #7246
• Fix compile error for nv_bloat162 by @loscrossos in #7248
• add Makefile to ease maintenance by @stas00 in #7267
• Fix fp8 gemm by @RezaYazdaniAminabadi in #7265
• [XPU] update xpu-max1100 CI workflow to torch 2.7 by @Liangliang-Ma in #7284
• Fix issues XPU tests hit with extra-index-url by @loadams in #7291
• Temporarily skip AIO tests due to an issue with runners by @loadams in #7288
• rollback #6726 by @delock in #7258

New Contributors

• @jizhang02 made their first contribution in #7246
• @loscrossos made their first contribution in #7248

Full Changelog: v0.16.7...v0.16.8

v0.16.7 Patch Release

What's Changed

• Update version.txt after 0.16.6 release by @loadams in #7218
• Fix release links by @tjruwase in #7219
• Fix pass for z3 and profiler by @tohtana in #7222
• Fix build on AMD GPUs (related to DeepCompile) by @HollowMan6 in #7224
• Add defence for DeepCompile w/o optimizer by @HollowMan6 in #7225
• Pass with_cuda arg for jit_load in OpBuilder by @HollowMan6 in #7226
• Make sure it's not None before offloading contiguous_grad_buffer by @HollowMan6 in #7227

Full Changelog: v0.16.6...v0.16.7

v0.16.6 Patch Release

What's Changed

• Update version.txt after 0.16.5 release by @loadams in #7180
• Cross layer overlapping for domino by @hwchen2017 in #7178
• async tp allreduce by @inkcherry in #7115
• Fix issue #5242 grad_norm and loss is nan by @Glaceon-Hyy in #7171
• Add qwen3 autotp support by @Yejing-Lai in #7187
• Update to new torch grad hook API: BF16Optimizer and Stage2 by @deepcharm in #7189
• Reland perf fix for nan inf check by @nelyahu in #7184
• Update to fix pydantic warning by @loadams in #7193
• update dependencies version info by @inkcherry in #7206
• HPU accelerator memory mapping is broken because of torch fill uninit memory by @oelayan7 in #7209
• Support complicated use cases with TiedLayerSpec by @limjcst in #7208
• Add defence for offload_states and reload_states w/o optimizer by @HollowMan6 in #7211
• DeepCompile for enhanced compiler integration by @tohtana in #7154

New Contributors

• @Glaceon-Hyy made their first contribution in #7171
• @limjcst made their first contribution in #7208

Full Changelog: v0.16.5...v0.16.6