I work as software developer for a small company and two weeks ago we got a new colleague, he was hired to work on the same team as me and our interactions so far have been friendly, he is a nice guy, polite and helpful.
I just now noticed that he always double checks everything I say. It first happened when he asked me to explain how the database entities of one of our costumers worked, I happily explained and he confirmed he understood. The next morning I find him asking the same question to our senior, I initially thought I may have explained poorly or he wanted a more in-deep explanation so I didn't pay much attention to it, but recently he double checks everything I say. He asks me something and then a couple moments later he ask the same question to another person, he did so even when asking questions about a software that I am the lead programmer right now and multiple people told him he should ask me, not them.
He is a friendly person, so I gave him the benefit of the doubt but today he asked me a simple 'yes or no' question, and yet there he went to double check what I said with another colleague.
Despite it looking like he doesn't do it to intentionally hurt me, this started to hurt me badly especially because I am the only woman of the team and casually the only person he seems to double check the information, and all the times he double checked, people answered the same thing I had previously said so it's not like I'm giving the wrong answers.
How do I casually talk about this situation with him, with out sounding like I'm punishing him for asking, but pointing out that his constant double-checks are hurting me? We are both colleagues, same age, I'm not his manager or superior or anything.