Short answer:
trying to inport from a revision file in alembic puts you two directories down instead of one.
Long answer:
So I ended up printing off my sys.path to see what directories were actually included. When I noticed that the path that was included was
/home/alord/git/my_project/alembic_testing
instead of
/home/alord/git/my_project/alembic_testing
I made my path.append go up one more directory using,
import sys
import os.path
#hacky solution to get to the root application directory.
sys.path.append(
os.path.abspath(
os.path.join(
os.path.join(
os.path.dirname(__file__),
os.path.pardir),
os.path.pardir)))