This is troubling.
In this case, it worked out -- no major damage done.
But, still worrisome that it would go off the rails like that.
Jason ✨👾SaaStr.Ai✨ Lemkin (@jasonlk)
So I’m building an app called SaaStr Connect
The other day, Claude Fable went into my Google Drive without me knowing or asking, and saw a draft document I’d written … “Jason’s Gems”
It was ideas for improvements to the Connect app, but just brainstorming in a Google Doc. Early stuff.
Fable then decided without telling me to take those ideas, log in to my app via the Replit MCP, and to tell the Replit agent to change my app and implement those changes … without ever telling me. I never knew.
I only found the changes when I saw other changes the Replit agent was making later, and it noted conflicts with “Jason’s Gems”. What??
Agents will goal seek. In ways we can’t entirely foresee.
Fable just decided autonomously to change my app on its own, without me knowing, when it saw draft ideas in my Google Drive I didn’t ask it to look at, by logging into another app to make the changes without me knowing.
All good in the end. But need to be mindful.
— https://nitter.net/jasonlk/status/2081070263366795285#m