Wonder where chatgpt will get its training data in the future, as it’s known not to extrapolate well. Where will it learn new frameworks, languages, … from?
I doubt it ever scraped SO, otherwise all the answers would be smth along the lines: “I cannot answer this question due to low quality effort!” closes browser window
That works when the docs are good and clear. Otherwise, we’ll have to revert to communicating with each other for brief periods while the chat-bots train themselves on the new data.
Somebody already did that but it wasn’t with chat GPT and honestly the docs were fine.
It didn’t do that thing that a lot of humans do when writing documentation which is just declare that something is true without explaining why it is true. So you end up in random PHP like land, when things just work like that okay.
Wonder where chatgpt will get its training data in the future, as it’s known not to extrapolate well. Where will it learn new frameworks, languages, … from?
I doubt it ever scraped SO, otherwise all the answers would be smth along the lines: “I cannot answer this question due to low quality effort!” closes browser window
The docs. It’s what it does now a lot of the time I’ve noticed.
That works when the docs are good and clear. Otherwise, we’ll have to revert to communicating with each other for brief periods while the chat-bots train themselves on the new data.
Auto generated docs since devs don’t document?
Yeah the smaller the project the less effective this is.
But even learning from the source code is pretty effective.
Chatgpt, look at this repo and write docs
Somebody already did that but it wasn’t with chat GPT and honestly the docs were fine.
It didn’t do that thing that a lot of humans do when writing documentation which is just declare that something is true without explaining why it is true. So you end up in random PHP like land, when things just work like that okay.
A lot of models are being trained on “synthetic” data now, right?
Even when a parrot learns to parrot a parrot, the first parrot still has to be taught.
Armies on paid personal generating content?
I see absolutely no problem with that.