schihei/pangu-weather
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #3 from 198808xc/bkf-huawei-patch-1

Browse Source 
Update pseudocode.py, add a possible implementation for ScheduledDropPath
This commit is contained in:
Lingxi Xie
2023-03-29 16:13:11 +08:00
committed by GitHub
parent cf3547114d 62acbda2c4
commit d9f2964faf
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
pseudocode.py
+1
View File
@@ -13,6 +13,7 @@ from Your_AI_Library import Linear, Conv3d, Conv2d, ConvTranspose3d, ConvTranspo
# GeLU: the GeLU activation function, see Pytorch API or Tensorflow API # GeLU: the GeLU activation function, see Pytorch API or Tensorflow API
# DropOut: the dropout function, available in all deep learning libraries # DropOut: the dropout function, available in all deep learning libraries
# DropPath: the DropPath function, see the implementation of vision-transformer, see timm pakage of Pytorch # DropPath: the DropPath function, see the implementation of vision-transformer, see timm pakage of Pytorch
# A possible implementation of DropPath: from timm.models.layers import DropPath
# LayerNorm: the layer normalization function, see Pytorch API or Tensorflow API # LayerNorm: the layer normalization function, see Pytorch API or Tensorflow API
# Softmax: softmax function, see Pytorch API or Tensorflow API # Softmax: softmax function, see Pytorch API or Tensorflow API
from Your_AI_Library import GeLU, DropOut, DropPath, LayerNorm, SoftMax from Your_AI_Library import GeLU, DropOut, DropPath, LayerNorm, SoftMax