.a
or .lib
extension is not a matter of Windows vs Linux. It's a matter of gcc vs msvc.
Typically, you will find the same thing inside, but if you try to link with it using msvc, you will encounter mangling problems.
More info on: Convert from MinGW .a to VC++ .lib