how to

activations

Jul 10, 2025
langspythonpytorch
1 Minutes
22 Words

nn.Mish()

  • 非单调,0 附近下沉,比 SiLU 更低. nn.SiLU()
  • 非单调,0 附近下沉
Article title:activations
Article author:Julyfun
Release time:Jul 10, 2025
Copyright 2025
Sitemap