So I asked him out for lunch...?

I think he is considering what his plans were and whether to accept your offer. It wasn't a flat-out no, so that's good. Lunch at a mall might be good, then you can shop at the same time and it gives you something to do.