Are you publishing the PDB files with your NuGet package? If so, Visual Studio is doing the expected behaviour of allowing you to step in.
If you definitely want to include the PDB, you'll need to add the [DebuggerStepThrough]
attribute to every class in your assembly. This will however make debugging a nightmare for you, unless you use a #if BLAH
hash-define condition to only do this in Release mode.
My suggestion would be to not include the PDBs in your NuGet package, then you don't need to amend your code at all.