Issues · pytorch/torchtitan · GitHub

Labels Milestones New issue

Checkponter: `async_with_pinned_mem` results in <class 'type'> error

#3476

· Andrei-Aksionov opened

on Jun 1, 2026

[MoE] Qwen3 MoE with TP+EP fails: "histogram_cpu" not implemented for torch.int64

#3465

· yichuan-w opened

on May 31, 2026

HybridEP DispatchHandle not working with torch.compile

module: torch.compile

#3439

· chelsea0x3b opened

on May 28, 2026

`LoRAConverter` silently leaves non-Linear parameters trainable

#3438

· yh8899 opened

on May 28, 2026

[gpt_oss] Avoid materialising `(x_linear + 1)` intermediate in `swiglu` to reduce activation memory

#3437

· janbernloehr opened

on May 27, 2026

RFC: Graph-Based EP Overlap For GraphTrainer

#3434

· sanketpurandare opened

on May 27, 2026

torch.compile fails with MoE + EP: PendingUnbackedSymbolNotFound on DTensor .view(-1, dim)

#3409

· acisseJZhong opened

on May 20, 2026

[TensorParallel] NoParallel does not handle multi-output modules

#3374

· aditvenk opened

on May 16, 2026

[question] Why is the load balancing disabled for multi-mask models

#3368

· francesco-bertolotti opened

on May 15, 2026

Proposal: async and load-balanced Muon/SOAP-style optimizers for TorchTitan

#3353

· liangyuwang opened

on May 14, 2026

torch.compile fails with TP + sparse-MoE gate with AssertionError: Node ... was invalid, but is output

module: torch.compile

#3345

· mreso opened

on May 13, 2026

RuntimeError: aten.add.Tensor got mixed torch.Tensor and DTensor when using Context Parallel SDPA

#3340

· francesco-bertolotti opened

on May 13, 2026