I'm not entirely sure what you mean, do you mean I should speak to him but not talk about our relationship? Do you mean I need to forget about our relationship and walk away? 
Advice on how to do either would be appreciated, but I'm not ready to walk away.