I mean, there are some predictions like this [0], but I don't know how credible they are. It is true though, that a transient spike or dip in temperature could cause famine, and the like. The Little Ice Age and other similar natural oddities are evidence of that.

Not sure how well we'll deal with that.

[0] http://www.wired.co.uk/article/mini-ice-age-earth-sunspots