It seems The Empty City doesn't trust me. It won't let me out until I kill him. It doesn't trust me not to just leave without killing him if it gives me an exit. So looks like I'll have to help him overpower it in order to do as it asked. That's kind of counter intuitive.