What’s the difference between speculative fiction and science fiction?

I’ve rarely seen the term “speculative fiction” being used, so I don’t really have an idea of what it encompasses. Would someone care to explain? I remember “Anathem” being described as such - and by the way: what an amazing book! I recommend it to all nerds, in particular those into history/philosophy/scifi.