Have you got any way of soaking to his work and organising a surprise holiday to see you. Once he's away and relaxed you might feel better able to approach him.

I am not advocating this but you could consider moving back and giving up your job.