Notion says some of its customers' AI chats were stolen. Not from Notion. From a vendor.
TechCrunch's Zack Whittaker reported on Thursday that hackers took data from Fireworks AI, a platform developers use to run open AI models. Fireworks says the attackers got in through its cloud provider and reached a development system. It is the second Fireworks incident in two months. Per its latest advisory, the attackers took billing information and some datasets, and Fireworks says it believes they are financially motivated.
Notion's own notice says fewer than 1% of its workspaces are affected. The stolen data is chat transcripts from its Insights feature: any input to or output from the model that was written to the chat. Notion says most of it cannot be tied to a workspace or a user.
One detail stands out to me. Notion says it learned that data was kept on the Fireworks endpoints it used, which conflicts with the zero data retention commitment it had from Fireworks. I don't know why, and the reports don't say.
My opinion: this is the real SaaS risk of the AI era. Your product is only as safe as the vendors behind it. And your customers never signed a contract with them.
Notion did the right things in public. It disconnected on 3 November, deleted its data, switched off the feature and promised an audit of its critical vendors. It also told customers to treat the data as exposed and to rotate any credentials pasted into Notion AI.
What I would do
A promise of zero retention is only as good as the audit behind it.
Written by
Lars ErikssonFounder, Flowmetric20 pieces · 13 followersFollow Lars to see new posts in your feed, on your phone or by email.
More from
Lars Eriksson →If CrowdStrike buys Zscaler, what happens to your contract?
Bloomberg reported on Friday that CrowdStrike and Zscaler are in talks about a deal, citing people familiar with the matter. No agreement has been announced. CrowdStrike declined to comment, and CNBC…
How Microsoft bills its new Copilot agent: a seat plus a meter
More than 80% of corporate AI spending now sits outside the IT budget, and total spending doubled in a year. That is Microsoft's claim, citing BCG, in a blog post on 17 November. I have not seen the B…
Who can edit the scripts on your checkout page?
Zoom, the BBC, CNN, Salesforce, GitLab and HSBC all served the same malicious script on Monday. None of them wrote it. Report URI, a security firm, checked 1,611 Optimizely snippets and found 188 inf…