An excerpt from Daniel Dennett’s Point of Inquiry interview “Tools for Thinking”

Very relevant:

Take…one out of every million pixels…I can [use the D-Wave to] reconstruct the original object with near-perfect fidelity… This…doesn’t work with random objects. If I were to take a completely random image this will fail. It works somehow because the objects that we care about in video, or pictures, or text, or whatever - they have structure in them and it’s somehow tied to the fact that we wrote them down at all… So there’s something about the way that we interact with the world that makes it so that the things we care about, we write about, we talk about, these are all compressible in the sense that they don’t have a lot of information content in them.
Geordie Rose

Also:
Andrew Ng: Deep Learning, Self-Taught Learning and Unsupervised Feature Learning