Why do people believe in the old testament?

I think the entire thing is rubbish, but they are caught by the fact that their new testament is based on the old one, so they can't reject the old without also rejecting the entire foundation for their beliefs.