Eric, I don't think you're too optimistic; I think some scholars have done exactly as you suggest. However, we're building two models at once -- that of psychological adaptations and that of selective pressures. The whole thing becomes a work of art.
I also like to think in terms of multiple EEAs; that we carry features from the time we spent as frogs. Our preferences for blue corresponds nicely to neurons in frog brains. Likewise for our bug detectors.
Thanks for looking up this site.