Aw joanne, you need to tell him that it is very obvious to you that he is not being honest. Give him a chance to explain. You knoe him well enough to know that his behaviour is unusual and a little defensive, so ask him why.
If he can't give you a reasonble explanation, you need to seriously think about if it is worth the extra stress on top of having a young child. If he DOES offer you any explanation, you need to work out how it makes you feel and where you want to go from there.
x