LINQPad maintains the AppDomain between runs, so everything that's static will remain in memory. You can change this behavior by going to Edit > Preferences > Advanced > Always use fresh application domains.
While the above is true, it seems string interning is performed at a process level (see here). So there's no way to reset that besides restarting.