git line endings - can't stash, reset and now can't rebase over spurious line endings commit

Question

I have a repo I added a gitattributes to it and was working on it fine. I sync it via dropbox to another machine. When I opened it to the other machine a bunch of files suddenly appeared on the unstaged area as total diffs (all the file a huge diff which means line endings diff) - my crlf endings are basically .* text=auto and I am working on windows. I tried to stash the changes, reset the branch etc. At long last I decided to commit the files and then made some other commits I wanted to reorder (and squash) before the line endings commit. When I try rebasing I get a :

error: Your local changes to the following files would be overwritten by merge
        # those same files
Please, commit your changes or stash them before you can merge.
Aborting
Could not apply 89b25b81fff1a1e7893319e123aaaca9c4162a95... <commit message>

Of course stash does not work

Is it a bug ?

Related:

• How do I fix line ending issues after migrating from SVN to git? (yes mine is a git-svn clone, but I do not think it is really important)
• Can't seem to discard changes in Git (yep and I want to know why)
• git thinks files have changed
• Can someone explain to me what difference git diff is seeing here?

EDIT Nothing to do with machines - on the same machine some (...) operations just make those files (they are on the .gitattributes as text) appear in the "changed" section. The only workaround that seems to exist is:

git rm --cached -r .
git reset --hard

USE CAREFULLY

EDIT: hack above moved to alias status:

[alias]
     crlf = !git rm -r . --cached -q && git reset --hard

---

UPDATE 2015.09.30: I have a git repo in an NTFS partition I use from windows 7 and arch linux in a dual boot environment. When I shut windows down and I boot into arch two files (html) show as total diffs (line ending diffs). The above workaround does not work - unless you apply it several times refreshing the gui in between...

My .gitattributes:

* text=auto

*.py text diff=python
*.html text
.project text
*.pkl -text

# M$ files
*.bat text eol=crlf

# UNIX files
**/generate_second_post text eol=lf

# git files - have them with LF, as I edit them via the shell (echo etc)
*.gitignore text eol=lf
*.gitattributes text eol=lf

NB: linux will let me commit, switch branches etc but won't let me rebase - plus those diffs always appear in gitk/git gui.

2018/12/14 moved to mac and my workaround does not work anymore. I posted a message to the git mailing list: https://marc.info/?l=git&m=154482149623324&w=2

Let's hope this will get some attention

$ git --version
git version 2.19.2

Answer 1

Finally after 5 years here is a complete answer, thanks to Torsten Bögershausen.

The way to debug this eol situation is to investigate using the --eol switch to git ls-files added by Torsten Bögershausen. Turns out that the file(s) in question were committed with CRLF while the .gitattributes file added later specified text for these files. This results in an "illegal state". Nothing to be done, for old commits.

What should be done is git add --renormalize . so the files are added with correct (lf) line endings and then reset --hard to have those lineendings in the working tree.

Now this won't help with old commits, however (the commits that are in this illegal state, so between the files were committed with wrong line endings and the gitattributes commit) - checking those out will probably lead to those unresetable changes. The fix for this is provided by the answer by @iKlsR:

$ cat .git/info/attributes
"Mopy/Docs/Bash Readme Template.html" -text

the reason being that:

When deciding what attributes are assigned to a path, Git consults $GIT_DIR/info/attributes file (which has the highest precedence), .gitattributes file in the same directory as the path in question, and its parent directories up to the toplevel of the work tree [ect]

(emphasis mine)

Just be sure to add the line after you renormalise, otherwise the file(s) won't be added to the renormalise commit!

Answer 2

We ran into this issue today where it seemed the problem stemmed from some CRLF-related issues related to a newly added .gitattributes file with a single line * text=auto. When you rebased or created a new branch, said file would follow you and ruin any changes that came after along with preventing you from leaving that branch without first committing it.

We initially fixed this by checking out a temporary branch, reverting the file back to a sane state (before modifications), committing and then doing a rebase on the entire branch back to the oldest commit to make it look like master. That worked for a while but a similar file popped up after that and the same fix didn't work again.

What we eventually went with was similar to what op shared in his update.. a single line inside .git/info/attributes with file-to-remove -text seems to mitigate the problem. I say mitigate because I'm not sure if there are any adverse implications to doing this, this was also for one file so might not work as well if at all.

Answer 3

The same issue happened with me today. Try this

git config --local core.fileMode false

as discussed here: How do I make Git ignore file mode (chmod) changes?

Answer 4

Have you tried this?

git add -u .
git reset

Answer 5

A re-write of @Mr_and_Mrs_D's excellent answer above:

git add --renormalize .  
git reset --hard   
git ls-files --eol | grep 'crlf' |  awk '{print $5 " -text"}' > .git/info/attributes  
git reset --hard  
git pull  
rm .git/info/attributes

I'm not certain if both resets are necessary. Also, be careful with the git ls-files line - I've got it filtering for crlf anywhere, so this might pick up files that have crlf in their name; there's probably a cleaner way to do this. It will also truncate .git/info/attributes if you already have one; modify with >> if required, and edit the file manually afterwards to remove those lines if you need.

Answer 6

Same issue here, I am using Win7, sourceTree v3.0.9, git v1.9.5

In repo root, when .gitattribute file has text=auto, it shows a lot of local file changes about line ending and it prevents me from doing anything. After I set text=crlf, all local changes are gone.

Previously I tried to adding "[core] autocrlf = false" in config file, but it didn't help.

Updated on 12/06/2018: My SourceTree was using embedded git with old version, just update it in SourceTree and everything works now with "text=auto" in .gitattributes

Answer 7

None of this works on my Windows 10 WSL, I had diff in README.md and was not able to pull changes, so I've did this from

echo README.md >> .gitignore # not sure if this is needed
rm README.md # this need to be rm without git
git pull
git checkout .gitignore # to remove the change

I think that it will also work if you just do:

rm file
git checkout <branch>

but I'm not able to test because my repo is working now.