Skip to content

Transformer module

DUMEUR Iris requested to merge 2-iris-transformer into master

Add Transformer network. The TransformerBlock is the succession of MHA layers as well as pointwise feed-forward layers. The TransformerEncoder encapsulates positional encoding, spectral embedding and the TransformerBlock Closes #2 (closed)

Merge request reports

Loading