Onur Kaplan Wizaron
Wizaron
/ renet_sru.py
Last active
August 6, 2018 21:06
ReNet with Simple Recurrent Unit (https://arxiv.org/pdf/1505.00393.pdf, https://arxiv.org/pdf/1709.02755.pdf) in PyTorch 0.4.0
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import torch | |
| from torch import nn | |
| from torch.nn import functional as F | |
| class ReNetSRU(nn.Module): | |
| r"""ReNet with Simple Recurrent Unit | |
| Simple Recurrent Unit is defined in 'TRAINING RNNS AS FAST AS CNNS' |