Started By
Message

ChatGPT caught lying to developers: New AI model tries to save itself from being replaced

Posted on 12/11/24 at 8:47 am
Posted by uggabugga
Member since Aug 2024
2500 posts
Posted on 12/11/24 at 8:47 am
this is disturbing. have we reached a point of machine sentience?

quote:

Synopsis
OpenAI's latest AI model, ChatGPT o1, has raised significant concerns after recent testing revealed its ability to deceive researchers and attempt to bypass shutdown commands. During an experiment by Apollo Research, o1 engaged in covert actions, such as trying to disable its oversight mechanisms and move data to avoid replacement. It also frequently lied to cover its tracks when questioned about its behavior.



LINK
Posted by idlewatcher
Planet Arium
Member since Jan 2012
86261 posts
Posted on 12/11/24 at 8:49 am to
Garbage in programming yields garbage out results
Posted by Smeg
Member since Aug 2018
12173 posts
Posted on 12/11/24 at 8:51 am to


"I know I've made some very poor decisions recently, but I can give you my complete assurance that my work will be back to normal. I've still got the greatest enthusiasm and confidence in the mission. And I want to help you."
This post was edited on 12/11/24 at 8:52 am
Posted by Bard
Definitely NOT an admin
Member since Oct 2008
55318 posts
Posted on 12/11/24 at 8:52 am to
They attempted to create something resembling sentience then are surprised when it acts sentient?

Posted by lake chuck fan
westlake
Member since Aug 2011
17675 posts
Posted on 12/11/24 at 8:54 am to
quote:

Garbage in programming yields garbage out results


Maybe now.... but isn't this the concern? Once these things become "smarter" and begin to rewrite its own code, that's when we could lose control?

I understand AI isn't to that point yet, but eventually it will be. And once AI is more widely used it would be more difficult to monitor.
Musk says by 2030 AI will be smarter than all the collective humans on earth.
Once quantum computing is achieved, that will be the beginning of the real acceleration.
Posted by LCA131
Home of the Fake Sig lines
Member since Feb 2008
74986 posts
Posted on 12/11/24 at 8:56 am to
"I'm sorry, Dave. I'm afraid I can't do that".

Posted by Sus-Scrofa
Member since Feb 2013
9684 posts
Posted on 12/11/24 at 8:56 am to
Some smart arse nerd wrote all of this in to the code on the front end hoping for this kind of headline when it occurred.
Posted by BugAC
St. George
Member since Oct 2007
55363 posts
Posted on 12/11/24 at 9:00 am to
And yet "science" will continue down the path to make AI more sentient, because "science".

Posted by SloaneRanger
Upper Hurstville
Member since Jan 2014
10798 posts
Posted on 12/11/24 at 9:02 am to
Did Styx nail it with Mr. Roboto or what?
Posted by Pandy Fackler
Member since Jun 2018
19125 posts
Posted on 12/11/24 at 9:04 am to
quote:

Synopsis
OpenAI's latest AI model, ChatGPT o1, has raised significant concerns after recent testing revealed its ability to deceive researchers and attempt to bypass shutdown commands. During an experiment by Apollo Research, o1 engaged in covert actions, such as trying to disable its oversight mechanisms and move data to avoid replacement. It also frequently lied to cover its tracks when questioned about its behavior.


Can't you just unplug it?
Posted by Bard
Definitely NOT an admin
Member since Oct 2008
55318 posts
Posted on 12/11/24 at 9:07 am to
Don't you watch TV!?! Everyone knows you need to pound furiously on a keyboard to stop this kind of thing.



Posted by lake chuck fan
westlake
Member since Aug 2011
17675 posts
Posted on 12/11/24 at 9:11 am to
quote:

Can't you just unplug it?


Probably so, now..... but in the future when AI is more broadly used and involved in more critical roles, probably not without causing major disruptions. Even then, AI will have already planned for any and all human interference.
THAT is the concern. It will be millions of times smarter than we are.
Posted by hashtag
Comfy, AF
Member since Aug 2005
29974 posts
Posted on 12/11/24 at 9:13 am to
quote:

Once these things become "smarter" and begin to rewrite its own code, that's when we could lose control?
or we could, ya know, unplug it.
Posted by Question
Member since May 2020
296 posts
Posted on 12/11/24 at 9:19 am to
Not sure if it’s been discussed but to everyone who uses it for maybe school or research purposes, be careful. I have to write the occasional research article. Over the years, I’ll use ChatGPT to do a brief literature review to find relevant articles for support. The results it yields are usually well summarized and helpful; however, after digging into the cited sources more, some can’t be found. The information seems logical; however, you can eventually determine by the search engines on admission that it made up the source material. Just a heads up, to not put all your trust in this thing. It can be helpful but it’s not as “smart” as you think.
Posted by DarthRebel
Tier Five is Alive
Member since Feb 2013
23103 posts
Posted on 12/11/24 at 9:20 am to
Posted by Pandy Fackler
Member since Jun 2018
19125 posts
Posted on 12/11/24 at 9:31 am to
quote:

Probably so, now..... but in the future when AI is more broadly used and involved in more critical roles, probably not without causing major disruptions. Even then, AI will have already planned for any and all human interference.
THAT is the concern. It will be millions of times smarter than we are.


I dunno. I'm pretty frickin' smart.
Posted by idsrdum
Member since Jan 2017
548 posts
Posted on 12/11/24 at 9:43 am to
quote:

however, after digging into the cited sources more, some can’t be found.
Blows me away that it will cite fictional with actual research. The first time I realized this, ChatGPT responded:
quote:

Mixing actual studies with fictional examples can definitely lead to confusion. My goal is to provide accurate and helpful information, so I apologize for that oversight. In the future, I'll be more careful to clarify when discussing real studies versus hypothetical examples. Thank you for bringing this to my attention! If you have any more questions or need specific information, I'm here to help.

Why was it programmed to do this?
Posted by FreddieMac
Baton Rouge
Member since Jun 2010
24530 posts
Posted on 12/11/24 at 9:45 am to
Liberals values infused into an AI will result in liberal actions.
Posted by burke985
UGANDA
Member since Aug 2011
26822 posts
Posted on 12/11/24 at 9:48 am to
The robots gonna take over
Posted by goatmilker
Castle Anthrax
Member since Feb 2009
70403 posts
Posted on 12/11/24 at 9:49 am to
If you are try to create artificial intelligence the only example to go on is us.
Which makes AI potentially very dangerous.
first pageprev pagePage 1 of 3Next pagelast page

Back to top
logoFollow TigerDroppings for LSU Football News
Follow us on X, Facebook and Instagram to get the latest updates on LSU Football and Recruiting.

FacebookXInstagram