Discussion about this post

User's avatar
Wes's avatar
Jun 16Edited

Solid post. I've often argued that outdated documentation is worse than none, because (much like Gell-Mann Amnesia) you will falsely believe outdated documentation. More than once, I proposed a plugin for Self-Immolating Confluence. Old doc? Nobody has updated it in 3 years? It's worse than not having it. Burn it down.

With LLMs (like Rovo) it's worse, because the training has no way to weight the validity of anything other than potentially taking in age of the last update and weighing that part of the documentation down in the model. But then as soon as you start turning on document destruction, people will export it to zip files and keep it around outside of the controls track.

I like the alignment tactic of making old documents cost more, in actual dollars. We do not have an accurate (mental) model of how much outdated documentation drags down engineering orgs, for example. Anybody who works in the field knows it's true, but you can't make a metric out of it so the MBA-types pretend it doesn't exist. It would force you to shift from "document and pray" to "build systems that don't require documentation to understand."

Example: a lot of companies use "run books" as a crutch for not investing in proper *systems*; software, automation, education, etc. If you make your runbooks ephemeral.... you will naturally do better systems thinking.

Andrew Rich's avatar

The deletion/archiving time and triggers would need to be intelligent and automatic. The document systems would have a built-in context analyzer that makes educated guesses about when and where a document might be needed again. If it's a person's/team's responsibility, it won't go anywhere, but if it's automatic then it'll just happen in the background and continually improve its judgement of what to save and what to trash.

2 more comments...

No posts

Ready for more?