To borrow something is to take it and then give it back later.
Can I borrow a pencil to use today? I’ll give it back to you tomorrow.