CS6140 Machine Learning
HW7 - Attention, Tranformer
Make sure you check the syllabus for the due date.
PROBLEM 1 Transformer NN [50 points]
Starting Code for Pb3
Complete the code using the "nn.TransformerEncodinglayer" and "nn.TransformerDecodingLayer" built-in blocks
PROBLEM 2 Transformer NN : Build your own blocks [optional, no credit]
Starting Code for Pb4
Code your own EncodingBlock, DecodingBlock, and Transformer