True models, predicitve models, and consistent Bayesian state-space estimators for chaotic dynamics

ResearchBlogging.org

I recently posted about a reply to a PNAS paper in which we show that, contrary to the claim in the original publication, the “true” model does by no means delivers worse predictions for chaotic population dynamics than time-series methods without any specific mechanism underlying, provided appropriate statistical estimation methods are used. To be clear, I use “true” as a shorthand for a mechanism very close to the data-generating process, fully acknowledging that there is likely no “true” model in the philosophical sense in the real world. The reply was now accepted by PNAS and should appear soon. In the meantime, you can already read the author’s response, which was also posted on the arXiv.

I might or might not comment on this response in more detail at a later point – I suppose the question Perretti et al. pose in their response, namely whether we should search for a mechanistically correct model in the first place, or whether we should go straight for “predictive, model-free methods” (basically ecology goes machine learning) is quite different from the claim made in the original paper. It is actually a question that could and has been extended to many other situations beyond the chaotic dynamics that were the original topic. However, I have so far not seen any consensus on this question, and maybe there can be none, as different people do science to different ends, so I am not sure whether it’s really worth diving into this discussion again (see also related posts here, here or here).

Just to say where I am standing though: I believe science is about more than making good prediction. Predictions get obsolete with new data and time, but mechanisms stay. So, call me a lost reductionist soul, but I’m not afraid to say that I don’t care which model predicts better, I’m still more interested in finding the “true” model (and I maintain that this model should also have the best fit to the data on the long run) 🙂

References

Florian Hartig, & Carsten F. Dormann (2013). Does “model-free” forecasting really outperform the “true” model? A
reply to Perretti et al arXiv arXiv: 1305.3544v1

Charles T. Perretti, Stephan B. Munch, & George Sugihara (2013). Reply to Hartig et al. [arXiv:1305.3544]: The “true model” myth arXiv arXiv: 1307.5747v1

3 thoughts on “True models, predicitve models, and consistent Bayesian state-space estimators for chaotic dynamics

  1. Pingback: Why ecologists might want to read more philosophy of science | Dynamic Ecology

  2. Pingback: What’s in a name? Female hurricanes are deadlier than male hurricanes | theoretical ecology

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s