Does it really though? It seems to me that once you nail the general intelligence, you’ll just need to provide the supplemental information (e.g. new documentations) for it to give an accurate response.
Bing already somewhat does this by connecting their bot to internet searches
What if the documentation is lacking? Experienced users will still know how a library works because they’ve tried some things, but that information won’t be available if they never talk about it online
I can think of four aspects needed to emulate human response: basic knowledge on various topics, logical reasoning, contextual memory, and ability to communicate; and ChatGPT seems to possess all four to a certain degree.
Regardless of what you think is or isn’t intelligent, for programming help you just need something to go through tons of text and present the information most likely to help you, maybe modify it a little to fit your context. That doesn’t sound too far fetched considering what we have today and how much information are available on the internet
I can think of four aspects needed to emulate human response: basic knowledge on various topics, logical reasoning, contextual memory, and ability to communicate; and ChatGPT seems to possess all four to a certain degree.
LLM’s cannot reason, nor can they communicate. They can give the illusion of doing so, and that’s if they have enough data in the domain you’re prompting them with. Try to go into topics that aren’t as popular on the internet, the illusion breaks down pretty quickly. This isn’t “we’re not there yet”, it’s a fundamental limitation of the technology. LLM’s are designed to mimick the style of a human response, they don’t have any logical capabilities.
Regardless of what you think is or isn’t intelligent, for programming help you just need something to go through tons of text and present the information most likely to help you, maybe modify it a little to fit your context. That doesn’t sound too far fetched considering what we have today and how much information are available on the internet.
You’re the one who brought up general intelligence not me, but to respond to your point: The problem is that people had an incentive to contribute that text, and it wasn’t necessarily monetary. Whether it was for internet points or just building a reputation, people got something in return for their time. With LLM’s, that incentive is gone, because no matter what they contribute it’s going to be fed to a model that won’t attribute those contributions back to them.
Today LLM’s are impressive because they use information that was contributed by millions of people. The more people rely on ChatGPT, the less information will be available to train it on, and the less impressive these models are going to be over time.
I was working on a hobby project where I used a niche framework in a somewhat uncommon way. I was stuck on a concept that I think the documentation didn’t explain well enough, at least for me, and I couldn’t find any resource on it aside from the docs.
I asked Bing to write a piece of code that does what I wanted and explain each line. It was perfectly working and the explanation was also understandable. All it did was search for its official documentation. It really blew my mind.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !programming@programming.dev
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person’s post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Rules
Follow the programming.dev instance rules
Keep content related to programming in some way
If you’re posting long videos try to add in some form of tldr for those who don’t want to watch videos
Does it really though? It seems to me that once you nail the general intelligence, you’ll just need to provide the supplemental information (e.g. new documentations) for it to give an accurate response.
Bing already somewhat does this by connecting their bot to internet searches
That’s not happening anytime soon.
LLMs do not relate to general intelligence in any manner.
how do people still have this much faith in the tools humans build after seeing the climate change caused by the industrial revolution.
What if the documentation is lacking? Experienced users will still know how a library works because they’ve tried some things, but that information won’t be available if they never talk about it online
We’re not able to properly define general intelligence, let alone build something that qualifies as intelligent.
I can think of four aspects needed to emulate human response: basic knowledge on various topics, logical reasoning, contextual memory, and ability to communicate; and ChatGPT seems to possess all four to a certain degree.
Regardless of what you think is or isn’t intelligent, for programming help you just need something to go through tons of text and present the information most likely to help you, maybe modify it a little to fit your context. That doesn’t sound too far fetched considering what we have today and how much information are available on the internet
LLM’s cannot reason, nor can they communicate. They can give the illusion of doing so, and that’s if they have enough data in the domain you’re prompting them with. Try to go into topics that aren’t as popular on the internet, the illusion breaks down pretty quickly. This isn’t “we’re not there yet”, it’s a fundamental limitation of the technology. LLM’s are designed to mimick the style of a human response, they don’t have any logical capabilities.
You’re the one who brought up general intelligence not me, but to respond to your point: The problem is that people had an incentive to contribute that text, and it wasn’t necessarily monetary. Whether it was for internet points or just building a reputation, people got something in return for their time. With LLM’s, that incentive is gone, because no matter what they contribute it’s going to be fed to a model that won’t attribute those contributions back to them.
Today LLM’s are impressive because they use information that was contributed by millions of people. The more people rely on ChatGPT, the less information will be available to train it on, and the less impressive these models are going to be over time.
I was working on a hobby project where I used a niche framework in a somewhat uncommon way. I was stuck on a concept that I think the documentation didn’t explain well enough, at least for me, and I couldn’t find any resource on it aside from the docs.
I asked Bing to write a piece of code that does what I wanted and explain each line. It was perfectly working and the explanation was also understandable. All it did was search for its official documentation. It really blew my mind.