no, not through a direct link.
"Loading" a folder from a git repo only means sparse checkout (partial clone).
Any other solution would indeed mean building an artifact and upload it.
Update August 2016 (2 years later): you can have a look at this answer and the DownGit project, by Minhas Kamal.