The mental mess that a reluctant yes can leave you with can be uncomfortable to say the least.