How can a stone structure burn down?

I always hear of ancient temples and buildings being destroyed in a fire. If the temple is made of marble or granite or something, how exactly does it "burn down"?