At ChaosSearch search, we have a mantra.
Keep all your data.
Why?
Because more often than not data has value has meaning certainly at some point in time and until that moment, it can look worthless, even chaotic without the right context.
A perfect example is the Rosetta stone.