I found a newbie workaround to my question, it might not be suited to all situations, but I get it to work.
- I export an .rtf from Access.
- I open Word, and go to the menu "View", and then select "Outline".
- Press "Show document".
- You now get to insert subdocuments by using the "Insert" button.
The report wont update automatically, but it makes it somewhat less of a hassle to update the report manually..