Using "-p" when compiling (or when building a spec file) will add additional paths to python's path.
pyinstaller -p any_path/Automation/Packages script1.py
This mimics the behavior of sys.path.append().
Thanks to the guys at PyInstaller for the solution:
sys.path.append does not work when compiling with PyInstaller 2.1