Actually turned out to be a lot simpler.
What I'd done was just use Class relationships and whilst Entity Framework was happy enough with that, MvcScaffolding didn't recognize the relationships.
Once I'd added a backing Id field and a ForeignKey attribute to the actual type, MvcScaffolding picked it straight up.