On my honor as a Tully, on my honor as a Stark, let him go, or I will cut your wife's throat
Walder Frey is a dangerous man to cross
Do you think she would risk her life, her son's life, if she wasn't certain her husband was murdered?
You can always say no, Ned.