I believe you can, but to do so you have to bring about the mapping pieces of EF. Because of that I'm not sure how much you would gain over not using EF in your code. But it's definitely possible, it's just tied to the mapping constructs and context.
One can also use RH (RoundhousE) RefreshDatabase with just SQL files if you want to go that route.