If the answer is No, then say No and be done. You do not need to follow it with excuses, or an explanation. No is a complete sentence.