Posts

All the articles I've posted.

• Feeding the Beast - Data Loading Secrets for Hungry Neural Networks

  Published:Dec 3, 2024 |  at 02:53 AM |  in 11 min read

  Data loading is a critical part of training deep learning models. In this post, we'll explore the best practices for loading data into neural networks, with a focus on PyTorch.

• Large-Scale Neural Network Training

  Published:Dec 2, 2024 |  at 01:58 AM |  in 23 min read

  Large-scale neural network training is a critical component of modern machine learning workflows. This post provides an overview of the challenges and solutions for training deep learning models at scale.

• Can AI Write about AI Personality With Personality?

  Published:Nov 23, 2024 |  at 07:33 AM |  in 31 min read

  Should AI have "Personality" or will "Bland and Mid" suffice?

• o1 and Reasoning

  Published:Nov 20, 2024 |  at 12:53 AM |  in 62 min read

  Organizing research presumably related to OpenAI's o1 reasoning model.

• All you need (to know) about attention

  Published:Nov 4, 2024 |  at 02:35 AM |  in 34 min read

  A highly compressed quide to quickly refresh (mostly) all you need to know about attention mechanisms in deep learning.

• Byte Pair Encoding Tokenizer

  Published:Oct 28, 2024 |  at 01:37 AM |  in 6 min read

  An in-depth exploration of the Byte Pair Encoding (BPE) tokenizer, its mechanics, and its applications in natural language processing.