So I think I can do what I want to do with AngularJS Directives.
However, the reason why the javascript wasn't executing was because AngularJS (based on jqlite) doesn't see the < script> tags as special - so the solution is to just include the full version of jQuery before AngularJS (source).