CS6140 Machine Learning

HW7 - Attention, Tranformer

Make sure you check the syllabus for the due date.




PROBLEM 1 Transformer NN [50 points]

Starting Code for Pb3
Complete the code using the "nn.TransformerEncodinglayer" and "nn.TransformerDecodingLayer" built-in blocks


PROBLEM 2 Transformer NN : Build your own blocks [optional, no credit]

Starting Code for Pb4
Code your own EncodingBlock, DecodingBlock, and Transformer