Me and My fiance just took in a 3-4 year old cat. He acts very scared and hides everywhere he can?

We took in a cat today, we brought him home from a little old lady that could not care for them anymore. He is very attentive and always is looking but he still hides he will literally dig himself into a corner of a wall. He wont accept food water and barley thinks anything of petting. Don't know if it matters but we had to take a freeway home. We did bring him home in a cat carrier. Its just me and my fiance here. He went right up on the counter and hid behind the mixer. He does not want to come out. I just really want to know what I can do or not to do. Any help is greatly appreciated