Just discovered that there is an option per user in WordPress to disable the visual editor

So if you can't see the advanced editor buttons you need to click on "Users => Your Profile" and uncheck "Disable the visual editor when writing"