Figured it out. The trick was to call Import-VM and specify a path to the .exp which comes with the labs.
Import-VM -Path $expfile
This post really helped: http://vniklas.djungeln.se/2012/04/04/importing-vm%C2%B4s-with-powershell-into-win8-hyper-v-3-0/