Originally is used in place of “in the beginning” or “when something first happened or began.”
This building was originally a bank.