Not answering will have an effect in Firewatch, but I've never actually tried it. There is a little countdown bar for you to respond after Delilah finishes talking, you can just let it run down to ignore her.
Minutus cantorum, minutus balorum,
Minutus carborata descendum pantorum.