
Part 2: Image Generation Guesses the "Noise" or the "Token" — TXT2IMG Training Data and Captions
Image generation comes in lineages — GAN, autoregressive (token) type, and diffusion — and today's mainstream is diffusion models like Stable Diffusion. The diffusion type learns to "guess the added noise" rather than "draw the image directly," while the autoregressive type guesses the "next image token" like an LLM. Part 2 covers gathering image-text pairs, CLIP quality filtering, and the training data for both approaches — with minimal code. Part 2 of a 5-part series.