CS6140 Machine Learning
HW7 - Attention, Tranformer
Make sure you check the syllabus for the due date.
To setup: see the README, get the data, get the code : training, data_utils, evaluate.
In these problems below you will train and evaluate for translation from English to Spanish
PROBLEM 1 Transformer NN [50 points]
Starting Code for Pb3
Complete the code using the "nn.TransformerEncodinglayer" and "nn.TransformerDecodingLayer" built-in blocks
PROBLEM 2 Transformer NN : Build your own blocks [optional, no credit]
Starting Code for Pb4
Code your own EncodingBlock, DecodingBlock, and Transformer