No, this technology has been around for many decades, since the early days of computing. It is nothing new. The only thing that has changed is the volume of data and computing power.
OP, do you think autocomplete was invented by the people who talked about autocomplete on Twitter? I just want to know how this fits together in your mind
Hahaha right? It’s the inventors of autocomplete that he should be crediting here for this thought to make any sense.
Modern Internet users in a nutshell. 😅
Im fascinated with the history of image AI as just some algorithms to help clean up noisy photos. Eventually they advanced enough that you just feed it complete noise, tell it what its an image of, and it just “gets rid of the noise”
Wait is that how image generation works? Denoising a random noise seed?
Yes! It’s called “stable diffusion”, and it’s how you get a unique image everytime.
Yeah thats the mechanism its generating with, and why every generation is different in some way. Theres a lot more cool components to the whole process and history tho. Tying language models into image recognition models, and then the image generation algorithm has an arms race with the image recognition, where the image generation is learning by trying to deceive image recognition, and image recognition is trying to distinguish between generated images and real images its also being fed.
This is where it all began https://en.m.wikipedia.org/wiki/Perceptron
Once back propagation was discovered we got neural networks.
They are just variations of that tuned for a specific task.
The original LLM.