You can always say no, Ned.
He's never been a bastard. He's the heir to the Iron Throne
On my honor as a Tully, on my honor as a Stark, let him go, or I will cut your wife's throat
I don't know how to ride a dargon
