This has now worked.

I had to get inside the network so my new version of Outlook (that supports multiple profiles) could sort its shit out then I could add the OWA profile.

I left the network and it seemed to sync as it should. I'll find out for sure once I get home.

Yep, tethered on the train and it's synced up. Bye bye god awful OWA.