[Common][PyTorch] Add SiTU-GLU activation - #3402

Merged

timmoon10 merged 8 commits into

NVIDIA:mainfrom

harryzhou2000:hhanyu/situglu

Aug 21, 2026

Commits on Aug 19, 2026

[Common][PyTorch] Add SiTU-GLU activation
harryzhou2000
committed
2292bb7
[PyTorch] Remove unsupported SiTU-GLU recompute option
harryzhou2000
committed
10f3e9a
[PyTorch] Reject unsupported scaled GLU recompute
harryzhou2000
committed
7e5c061
[PyTorch] Complete grouped SiTU-GLU fusion coverage
harryzhou2000
committed
730c0c1
[PyTorch] Consolidate grouped SiTU-GLU detection
harryzhou2000
committed
909e4db

Commits on Aug 20, 2026

[Common] Normalize gated activation derivatives
harryzhou2000
committed
15dd10f
Avoid implicit cast from bool to float
timmoon10
authored
9323eb0
[Common] Fix scaled activation scale-gradient tests
harryzhou2000
committed
8f7e7e0