Chatbot (GPT) gone wrong

6747 Views 166 Replies 14 Participants Last post by MrMatt, 26 d ago

james4beach

Discussion Starter · 4 mo ago

Someone had a really funny interaction with the GPT chat just released on Bing. The bot starts arguing with the person.

One thing you have to remember is that this particular AI technology (GPT) is just a sentence-completer and word predictor. All it does is use all the text it's been trained on to predict the next word in a sequence, so it completes sentences in plausible ways. It doesn't have any intelligence. It doesn't have any smarts; it just does things which impersonates smarts.

https://www.reddit.com/r/bing/comments/110eagl

Font Screenshot Rectangle Parallel Electric blue

See less See more

1 - 20 of 167 Posts

jlunfirst

· #2 · 4 mo ago (Edited)

James, our IT dept. head honcho sent corporate group email, warning folks about ChatGPT. The warning was about its capacity to auto-generate wrong info. So the example was listing 5 top head sr. managers....as currently valid. Well, 1 of them left our organization.......6 years ago. So the list was scraped from more than 1 source for 1 short list.

From govn't side, it is a concern of generating wrong info./posing as the source, when it isn't.

I never had a LinkedIn profile..and I don't intend to ever now with various developments going on. Too many yahoos playing around.

The problem there's enough folks who don't even know how to research/source authoritative information. For instance for legislation, you should go direct to the govn't site first as a lay person (and even lawyer if their fee-bases sources aren't updated yet). A layperson might not even understand the difference between statute and regulation.

Information literacy among a certain population is a challenge, even a problem.

See less See more

james4beach

Discussion Starter · #3 · 4 mo ago

jlunfirst said:
From govn't side, it is a concern of generating wrong info./posing as the source, when it isn't.

I never had a LinkedIn profile..and I don't intend ever. Too many yahoos playing around.

As I've said before, [some] business people don't really understand technologies and they will misuse this.

The prospect of firing workers and reducing headcounts is just too exciting for business people and corporate owners. So they're going to put GPT into all kinds of dumb places, and it's going to cause all kinds of dumb problems.

Reactions: 2

jlunfirst

· #4 · 4 mo ago (Edited)

james4beach said:
As I've said before, [some] business people don't really understand technologies and they will misuse this.

The prospect of firing workers and reducing headcounts is just too exciting for business people and corporate owners. So they're going to put GPT into all kinds of dumb places, and it's going to cause all kinds of dumb problems.

Unrelated to this, but just to let you know the National and B.C. Building Code (including Alberta, Ontario) and National Fire Code are not online for free on the Internet. You have to pay for licensed online access.

Reactions: 1

andrewf

· #5 · 4 mo ago

james4beach said:
Someone had a really funny interaction with the GPT chat just released on Bing. The bot starts arguing with the person.

One thing you have to remember is that this particular AI technology (GPT) is just a sentence-completer and word predictor. All it does is use all the text it's been trained on to predict the next word in a sequence, so it completes sentences in plausible ways. It doesn't have any intelligence. It doesn't have any smarts; it just does things which impersonates smarts.

https://www.reddit.com/r/bing/comments/110eagl

View attachment 24274

Frankly, most people just impersonate intelligence as well.

Chat-GPT is going to improve. As it is today, it will be able to provide a lot of value in terms of synthesizing information or generating text. I used it to generate a job description recently, and it produced something much better than my recruiter.

Reactions: 1

james4beach

Discussion Starter · #6 · 4 mo ago (Edited)

andrewf said:
Frankly, most people just impersonate intelligence as well.

Very good point. One could also argue that 99% of economic activities don't require much intelligence. Many things that occur in jobs from day to day are actually quite routine and mundane.

andrewf said:
Chat-GPT is going to improve. As it is today, it will be able to provide a lot of value in terms of synthesizing information or generating text. I used it to generate a job description recently, and it produced something much better than my recruiter.

No question it can be useful. I agree that it has good uses, I just am hoping that people don't start using it in inappropriate places. Another mistake would be removing the vital step of human review, and just using the output without thinking.

But there's no question that we're about to get a lot more DoorDash delivery people.

There's a public fear of AI becoming sentient and killing all mankind. I suspect that what actually happens will be much less dramatic, but still very harmful to the world: eliminating a ton of jobs and making a lot of people permanently unemployable.

Reactions: 2

jargey3000

· #7 · 4 mo ago

Thomas Chabot Hockey Stats and Profile at hockeydb.com

Statistics of Thomas Chabot, a hockey player from Sainte-Marie, PQ born Jan 30 1997 who was active from 2013 to 2023.

www.hockeydb.com

Beaver101

· #8 · 4 mo ago

andrewf said:
Frankly, most people just impersonate intelligence as well.

Chat-GPT is going to improve. As it is today, it will be able to provide a lot of value in terms of synthesizing information or generating text. I used it to generate a job description recently, and it produced something much better than my recruiter.

... I'm sure that AI will have ALOT of potentials on future job prospects, especially those in the knowledge-source area like reducing headcounts as J4B noted.

Or surprise me, management might use them to replace their loneliness up at the top ... LFMAO.

Anyhow ... re production of a "better" job description using AI, just make sure it ain't a cookie cutter one. Eg. what's the difference in the job description between Joe's the inventory clerk and Jack the inventory clerk over at Amazon?

Beaver101

· #9 · 4 mo ago

jargey3000 said:
Thomas Chabot Hockey Stats and Profile at hockeydb.com

Statistics of Thomas Chabot, a hockey player from Sainte-Marie, PQ born Jan 30 1997 who was active from 2013 to 2023.

www.hockeydb.com

... haven't read the link yet but then I wouldn't be surprised some folks will believe that's a "live" person. Start with those hill-billies from the west.

AlwaysLearning

· #10 · 4 mo ago

This needs to be considered as a tool to make yourself more efficient.
I have recently used it for 2 purposes both as a technical writter. One was to develop a press release for an event a non-profit was putting on. I just gave basic information and it made it sound much better than I would have in very little time. Then with minor edits it is ready to go...
Another was to create a starting pont for a performance review. Just had to give it a list of accomplishments and it created a well written review that again just required minor edits.

In both these cases it just worked as a time saver.
I have also played with the bot for drafting VBA scripts for excel automation. I think this will work too where you can write in pseudocode and let the bot take care of syntex..Again something I could do but much faster with the bot...

AlwaysLearning.

See less See more

Reactions: 2

sags

· #11 · 4 mo ago

The future of AI integrated into human like robots is exciting to contemplate, but it questions the future of work, economics and a host of other human activities and concerns.

It is also easy to conjure some nightmarish scenarios, where authorities and governments may determine that robotic militaries are a battlefield advantage they can't ignore.

Interesting times ahead for ethicists and decision makers, but if history is any guide we can rest assured someone will always push past the moral and ethical boundaries.

m3s

· #12 · 4 mo ago

AlwaysLearning said:
This needs to be considered as a tool to make yourself more efficient.
I have recently used it for 2 purposes both as a technical writter. One was to develop a press release for an event a non-profit was putting on. I just gave basic information and it made it sound much better than I would have in very little time. Then with minor edits it is ready to go...
Another was to create a starting pont for a performance review. Just had to give it a list of accomplishments and it created a well written review that again just required minor edits.

Yes exactly this.

A real estate agent can have chatGPT draft a description for a listing and then do a quick edit. It's a more advanced version of copy/pasting a template to work off which always led to copy/paste errors because it's hard to catch every detail.

It's just a tool that makes people more efficient. The boomers are scared and imagining things because they haven't actually used it.

Reactions: 1

m3s

· #13 · 4 mo ago

sags said:
The future of AI integrated into human like robots is exciting to contemplate, but it questions the future of work, economics and a host of other human activities and concerns.

It is also easy to conjure some nightmarish scenarios, where authorities and governments may determine that robotic militaries are a battlefield advantage they can't ignore.

Interesting times ahead for ethicists and decision makers, but if history is any guide we can rest assured someone will always push past the moral and ethical boundaries.

Rather the decisions are held and robots enhance people as a tool.

A fighter pilot can have drones as wingman that can be sent into danger and protect him. The human still calls the shots.

Try flying a DJI drone. It's doing a lot of automatic stuff to make it easy but you're still in control.

Beaver101

· #14 · 4 mo ago

m3s said:
Yes exactly this.

A real estate agent can have chatGPT draft a description for a listing and then do a quick edit. It's a more advanced version of copy/pasting a template to work off which always led to copy/paste errors because it's hard to catch every detail.

It's just a tool that makes people more efficient. The boomers are scared and imagining things because they haven't actually used it.

... like the old saying goes "work smarter, cheaper, faster, and produce more, not harder" ... like a dime by the dozen ... and I think the boomers have been through all that ... LOL!!!!

jlunfirst

· #15 · 4 mo ago

m3s said:
Yes exactly this.

A real estate agent can have chatGPT draft a description for a listing and then do a quick edit. It's a more advanced version of copy/pasting a template to work off which always led to copy/paste errors because it's hard to catch every detail.

It's just a tool that makes people more efficient. The boomers are scared and imagining things because they haven't actually used it.

I'm not sure what boomers have to do with all this.

It's great that AI could write real estate ads, or any product ad that requires to meet set information content for readers. Including food product ads for websites, etc. What we hope is the next generations have capacity to still communicate and write well, persuasively for complex concepts and ideas.

Reactions: 1

Beaver101

· #16 · 4 mo ago

^ He's implying the boomers can't handle such "technological advancement" ( like a revolution!) and is "scared of artificial intelligence" of a bot disguised as a real person.

Give me a break, just look at FakeBook is sufficient (at least for me), let alone Twitters, et al. And then there's the "real life fakies and flakies" - you can spot them a mile away (at least I can).

m3s

· #17 · 4 mo ago

jlunfirst said:
I'm not sure what boomers have to do with all this.

It's great that AI could write real estate ads, or any product ad that requires to meet set information content for readers. Including food product ads for websites, etc. What we hope is the next generations have capacity to still communicate and write well, persuasively for complex concepts and ideas.

I agree it's a crutch like many things. You could make the same argument for calculators, computers, spell checkers etc.

I believe those are all useful tools. There are always tell tales signs of over dependence like people who confuse it's and its because the spell checker doesn't catch some things. Same with chatGPT you have to be aware of and augment its blind spots.

Who hasn't started with a previous report to get the foundation for their own? Are you telling me you write all your reports and briefings from scratch?

Reactions: 1

MrMatt

· #18 · 4 mo ago (Edited)

james4beach said:
Very good point. One could also argue that 99% of economic activities don't require much intelligence. Many things that occur in jobs from day to day are actually quite routine and mundane.

Of course many people even fail at that.
The average investor underperforms the relevant index, not because they can't replicate it, but because they actively act improperly. Despite an easier and more effective means being available.

No question it can be useful. I agree that it has good uses, I just am hoping that people don't start using it in inappropriate places.

They already are

Another mistake would be removing the vital step of human review, and just using the output without thinking.

They already are, but why is that "vital"
I think a lot of algorithmically generated output doesn't need human review.
Look at DLSS, do we really need a human to review?

AI is mostly pattern recognition, right now, and we use a lot of bad poorly thought out patterns.
AI will inflict whatever stereotypes it is programmed with.

The reason we didn't see the balloons is because "all" the airborne threats were fast and very fast, so the systems didn't look for slow moving objects. Like who'd launch an attack from a blimp?
Now I'll admit NORAD not noticing the balloons is a bad pattern in the pattern recognition algorithm, but that's all the rest of our AI/Deep learning systems are today.

My kids are into chess, they want to play Chess-GPT, but they also thought it was funny when Chess-GPT started moving players illegally.
As digital natives, they have a very interesting perspective on this stuff.

There's a public fear of AI becoming sentient and killing all mankind. I suspect that what actually happens will be much less dramatic, but still very harmful to the world: eliminating a ton of jobs and making a lot of people permanently unemployable.

This has been a serious problem for years. We have to find some way to make these people useful in society.

We used to allow paying disabled/impaired people less than minimum wage, so they were still doing something useful, and it was economically appropriate.
That has been banned in Ontario.

The US army rejects "lower" IQ people, as not being smart enough to contribute positively I've heard 83, now 92.
I don't actually dispute this, even with the increasing specialization, and well documented workflows, some tasks might be difficult for them to learn and adapt, and that bar keeps getting higher.

What do we do when nearly half the population is unemployable, because they can't do the job, or there is a much cheaper alternative to do that job.
Do we force companies to hire people and have them do busywork?
Do we allow an ever growing pool of people with no purpose in life? We see that now, where we have a rather small portion of the population, and look at the damage we do. What happens when 40, 50, 60% of the population has no purpose and nothing to do?

I think the end result is actually as dramatic as machines rising up, we'll have massive social upheaval, by people who don't know what they're doing.

See less See more

m3s

· #19 · 4 mo ago

MrMatt said:
AI is mostly pattern recognition, right now, and we use a lot of bad poorly thought out patterns.
AI will inflict whatever stereotypes it is programmed with.

The reason we didn't see the balloons is because "all" the airborne threats were fast and very fast, so the systems didn't look for slow moving objects. Like who'd launch an attack from a blimp?
Now I'll admit NORAD not noticing the balloons is a bad pattern in the pattern recognition algorithm, but that's all the rest of our AI/Deep learning systems are today.

I posted a previously classified slide that NORAD did track balloons both in Canada and Alaska. It's not an AI filter that adjusts itself. If Russia/China are testing response then there is a reason things are classified.

For things like Red Flag or Maple Flag all those filters are off unless there is too much clutter. Things like identification zones are also monitored closer with layered sensors. But yes if you know the exact system there's always potential ways to bypass detection maybe for some time.

None of those slow moving objects were threats. Although it is time for NORAD to upgrade surveillance for real threats. It's not the derelict balloons though. There's talk about how new technologies will work I wouldn't call current system AI.

MrMatt

· #20 · 4 mo ago

m3s said:
I posted a previously classified slide that NORAD did track balloons both in Canada and Alaska. It's not an AI filter that adjusts itself. If Russia/China are testing response then there is a reason things are classified.

For things like Red Flag or Maple Flag all those filters are off unless there is too much clutter. Things like identification zones are also monitored closer with layered sensors. But yes if you know the exact system there's always potential ways to bypass detection maybe for some time.

None of those slow moving objects were threats. Although it is time for NORAD to upgrade surveillance for real threats. It's not the derelict balloons though. There's talk about how new technologies will work I wouldn't call current system AI.

There is always clutter and noise in any reading.
It is ALWAYS filtered out to some degree.

Now that could be some advanced AI based system, or it could simply be a basic signal filter.

Any scanning system will pull in all sorts of garbage, and that's the whole trick of stealth and camouflage, trying to make the object fail pattern recognition.

www.mensxp.com

If You Can't Spot The Snipers Hiding In These Pictures In Under 10 Minutes, You Are Dead

We are already dead.

www.mensxp.com

1 - 20 of 167 Posts