If your file is not big you can basically cat first file twice:
cat file.1 file.1 file.2 | sort -n | uniq -u | cat > file.3
but this is expensive for big files.
or using grep you can achieve this (thanks to @tripleee):
grep -F -x -v -f file.1 file.2 > file.3