I created the tokenizer which can be used to convert text into an array of indexes and then convert the indexes the model outputs back into text.

I converted audio into values which were passed into the model as training data, and the outputs of the model were converted back to music.

I used the CUDA framework to hand code an LLM which used the transformer architecture to generate python code based on a user input.