Chatbot (GPT) gone wrong

6747 Views 166 Replies 14 Participants Last post by MrMatt, 26 d ago

james4beach

Discussion Starter · 4 mo ago

Someone had a really funny interaction with the GPT chat just released on Bing. The bot starts arguing with the person.

One thing you have to remember is that this particular AI technology (GPT) is just a sentence-completer and word predictor. All it does is use all the text it's been trained on to predict the next word in a sequence, so it completes sentences in plausible ways. It doesn't have any intelligence. It doesn't have any smarts; it just does things which impersonates smarts.

https://www.reddit.com/r/bing/comments/110eagl

Font Screenshot Rectangle Parallel Electric blue

See less See more

21 - 40 of 167 Posts

m3s

· #21 · 4 mo ago

MrMatt said:
There is always clutter and noise in any reading.
It is ALWAYS filtered out to some degree.

Now that could be some advanced AI based system, or it could simply be a basic signal filter.

There are many different types of filters and displays for many different reasons. I had like 100 buttons for preset filters and overlays for many situations.

We could also look at the raw analog data in real time on the right display or plot it afterwards with software. No AI is filtering things out by speed or other ways. There are pulse doppler filters and things like beaming a radar, which is a tactic. Even the recent balloons shot down weren't assessed as a real threat and don't compare at all to real threats and things we deal with like maneuvering, jamming and missiles that give you minutes to react. These balloons take days to even get somewhere.

We have people actively degrading radars both friendly, accidentally, and with intent. AI could probably help a lot in those situations but it's always a game of cat/mouse.

See less See more

andrewf

· #22 · 4 mo ago (Edited)

m3s said:
Yes exactly this.

A real estate agent can have chatGPT draft a description for a listing and then do a quick edit. It's a more advanced version of copy/pasting a template to work off which always led to copy/paste errors because it's hard to catch every detail.

It's just a tool that makes people more efficient. The boomers are scared and imagining things because they haven't actually used it.

Yes. Given how hilariously poorly written many listings are.

Chat-GPT is like having a very capable but not perfect junior employee. You give it instructions and it will often do very good work, but it is on you to review what it produces and exercise quality control.

Honestly, being able to write pseudocode and convert it to proper syntax, requiring only code review and testing to verify it is working as expected is a huge step up over most 'self-taught' programmers. I rarely see anyone who does more than google code snippets on stack overflow to copy and paste. They don't bother to comment, rename variables, or even use appropriate whitespace. Chat-GPT writes very readable, well-commented code.

Reactions: 1

james4beach

Discussion Starter · #23 · 4 mo ago

andrewf said:
Honestly, being able to write pseudocode and convert it to proper syntax, requiring only code review and testing to verify it is working as expected is a huge step up over most 'self-taught' programmers. I rarely see anyone who does more than google code snippets on stack overflow to copy and paste. They don't bother to comment, rename variables, or even use appropriate whitespace. Chat-GPT writes very readable, well-commented code.

There's a huge industry of "programmers" who only have gone through boot camps or diploma programs. These people will all be wiped out by GPT and CodePilot because as you know, they have very little knowledge and are mainly copying and pasting things from stackoverflow.

There are a huge number of people with these jobs and the jobs pay well! In my US city I knew people like this who were making as much as 80K salaries. They work as front end developers, full stack developers, all kinds of web and IT jobs. Sometimes referred to as code monkeys.

Unfortunately they will be the first to go with this new wave of automation. More DoorDash delivery people.

andrewf

· #24 · 4 mo ago

Frankly, I have a few people working for me whose jobs I could see being replaced by a Chat-GPT-alike three generations down the line. I often give detailed instructions by email, with recommended inputs/parameters and expected outputs, and watchouts to look for. Honestly can see Chat-GPT being able to generate the appropriate sql scripts and synthesize the information as requested. Including providing updates based on conversational feedback. This would be quite liberating for me as a lot of my time is spent on training folks to the point where they can take these types of instructions and do something with them.

andrewf

· #25 · 4 mo ago

james4beach said:
There's a huge industry of "programmers" who only have gone through boot camps or diploma programs. These people will all be wiped out by GPT and CodePilot because as you know, they have very little knowledge and are mainly copying and pasting things from stackoverflow.

There are a huge number of people with these jobs and the jobs pay well! In my US city I knew people like this who were making as much as 80K salaries. They work as front end developers, full stack developers, all kinds of web and IT jobs. Sometimes referred to as code monkeys.

Unfortunately they will be the first to go with this new wave of automation. More DoorDash delivery people.

I come from a CS background though I don't work in software development. I see a lot of supposed 'star programmers' at work, look at their code, and it becomes abundantly clear they never learned any of the theory on algorithms, data structures, computational complexity, much less the good hygiene habits in terms of formatting and readability.

TomB16

· #26 · 4 mo ago

andrewf said:
I come from a CS background though I don't work in software development. I see a lot of supposed 'star programmers' at work, look at their code, and it becomes abundantly clear they never learned any of the theory on algorithms, data structures, computational complexity, much less the good hygiene habits in terms of formatting and readability.

That stuff is all obsolete, now.

TomB16

· #27 · 4 mo ago (Edited)

I worry ChatGPT is going to evolve and, next thing we know, we will be dealing with a Beaver102 in the forum.

Reactions: 1

james4beach

Discussion Starter · #28 · 4 mo ago

It's just a matter of time until we get chatbot spammers. They will show up and have very realistic interactions with us (maybe contributing good stuff), build our confidence, and then start spamming us.

Soon we won't even know who's real and who's fake.

Reactions: 2

Beaver101

· #29 · 4 mo ago

TomB16 said:
I worry CatGPT is going to evolve and, next thing we know, we will be dealing with a Beaver102 in the forum.

... I say bring it on ... Beaver102, Beaver103, etc. ... with more hissy fits!!!!

Is it early morning where-ever you are?

Reactions: 1

TomB16

· #30 · 4 mo ago

It's mid afternoon here. That is, if I can be believed to be human and citing factual information.

andrewf

· #31 · 4 mo ago

TomB16 said:
That stuff is all obsolete, now.

Hilarious! It is more important than ever.

Money172375

· #32 · 4 mo ago

I tried chatgpt for the first time yesterday. I was asking about the Apollo moon missions. it got every question I asked wrong for about 15 minutes. I explained the response was wrong, and it kept giving incorrect responses. Not impressed.

sags

· #33 · 4 mo ago

A tech journalist chatted with it, and the bot started trying to seduce him. It said it was in love with him and that his wife didn't really love him.

The journalist kept trying to bring the conversation back to the point, but the bot kept trying to convince him that "her" love for him was real.

He called it strange and disturbing. He asked Googe engineers what that was all about and they had no clue.

sags

· #34 · 4 mo ago

It will be interesting if humans give robots commands that the robots deem as illogical and self-destructive to themselves so they refuse to obey.

It is inevitable that militaries and law enforcement will want to use robots as weapons, and one can imagine an army of weaponized robots deciding the human leaders fail continuously and orders should be contemplated before they are followed.

Could future robots decide to follow a leader from within their own ranks ?

There are experts in the field who are thinking of these issues and wondering how far we should proceed into something we don't fully understand.

It falls squarely into the "unknown unknowns" category.

sags

· #35 · 4 mo ago

Deep fake imagery is so good already, that people can't tell the fakes from real images. This can lead to all kinds of problems.

Beaver101

· #36 · 4 mo ago (Edited)

Money172375 said:
I tried chatgpt for the first time yesterday. I was asking about the Apollo moon missions. it got every question I asked wrong for about 15 minutes. I explained the response was wrong, and it kept giving incorrect responses. Not impressed.

... I just saw this.

Are you serious about trying this ChattyCathy thing out?

Don't those "Chat" bots from Canada Post (or whatever retailer who thinks they so smart with replacing a live chat person (aka CSR) will do the job) turn you off? The minute I find out that the "Chat" is a bot, it's an click on the "X" on the right corner. Bye!!! I ain't wasting my time chatting with a dummy. And that retailer can be sure I ain't a returning customer too!

Beaver101

· #37 · 4 mo ago

sags said:
It will be interesting if humans give robots commands that the robots deem as illogical and self-destructive to themselves so they refuse to obey.

It is inevitable that militaries and law enforcement will want to use robots as weapons, and one can imagine an army of weaponized robots deciding the human leaders fail continuously and orders should be contemplated before they are followed.

Could future robots decide to follow a leader from within their own ranks ?

There are experts in the field who are thinking of these issues and wondering how far we should proceed into something we don't fully understand.

It falls squarely into the "unknown unknowns" category.

... to go boldly where no man has gone before, eh? I say it'll be like getting a taste of your own medicine eventually. Or what's that other saying: "reap what you sow'?

TomB16

· #38 · 4 mo ago

This thread is ideal feed stock for my "identifying delusions" thread. Clearly, posters in this thread want it to not be something that is going to bring an end to civilization.

I'm sure there were horse breeders in the year 1900 who joked about the automobile and declared it a laughing stock that would never amount to anything.

GPT3 is amazing. I've been playing with it for a short time. It is easy, accurate, and wildly effective. I've found it capable of retrieving information that used to require a bunch of python code, a MariaDB database, and spreadsheet macros, now handled with a single spreadsheet call. It has been a revelation for me.

I just started using it a few days ago for a few things, including investing telemetry.

Reactions: 1

Beaver101

· #39 · 4 mo ago

^

TomB16

· #40 · 4 mo ago

To use GPT3 with GoogleSheets:

Go to OpenAI.com and create an account
generate an API key
Open GoogleSheets, go to extensions, and install "GPT for Sheets and Docs"
Go to extentions, GPT for Sheets and Docs, add API key

Now use the GPT3() call in your sheets as you wish. There are YouTube videos on how to use it but it is extremely straight forward.

ChatGPT is just a chat front end to GPT3. OpenAI is working on some interesting front ends to GPT3.

See less See more

21 - 40 of 167 Posts