You know,

you could say (nicely and politely),

"No thanks, I'd rather not, I don't have the time."

Instead of,

"I will catch up with you tom. then."

And then don't.