The issue that I was having was with my TestAssemblies element, updating it to the following has resolved the issue:
<TestAssemblies Include="..\**\bin\*\*.Tests.dll" />
I think something other my intended 'test' dlls were being picked up, which was causing xunit to look for xunit.dll.