# A Deep Dive into Modern Transformers: RoPE, Activation Functions, Quantization

#86 Jan 26 Inference

https://www.aibutsimple.com/p/pro-a-deep-dive-into-modern-transformers-rope-activation-functions-quantization