Investigating the inner workings of prominent language models involves scrutinizing both their architectural design and the intricate training methodologies employed. These models, often characterized by their extensive size, rely on complex neural networks with a multitude of layers to process and generate textual content. The architecture itself