What Can't Fossils Tell Us