Tag: FLOPs

All the articles with the tag "FLOPs".

• Estimating Transformer Model Properties: A Deep Dive

  Published:Dec 7, 2024 |  at 05:44 AM |  in 8 min read

  In this post, we'll explore how to estimate the size of a Transformer model, including the number of parameters, FLOPs, peak memory footprint, and checkpoint size.