A contrary thing is the opposite to another thing.
It isn’t warm outside at all. On the contrary, it is quite cold.