One way would be to use :jar-exclusions
or :uberjar-exclusions
in project.clj
to exclude your config files:
;; to exclude all .conf files from jars:
:jar-exclusions [#".*\.conf"]
You could also simply not put those files in the resources directory and tell your application where to look for them using, say, an environment variable.