As the author of the "technical debt" post that you linked in your question, I'd say that in your case it's probably not worth converting the project from VB .NET to C#.
In our case, the entire team had made the decision to move away from Visual Basic and had already started writing many newer portions of the system in C#. We were all capable of working with either language but preferred C# and hated having to remember to chop the semicolons off of the end of each line when we needed to dip into the VB portion of the code. ;-)
As I pointed out in my post, I once made the decision against converting a VB .NET project at a previous job because I didn't feel like it was a justifiable cost to the project as a whole. In that case the code wasn't in great shape to begin with and we would have had a "garbage in, garbage out" effect if we did a conversion. Instead, we focused on fixing the issues with the VB .NET and that turned out to be a much better way for us to spend our time and energy. From reading your question it sounds like you are in the same boat. You are better off spending time addressing the issues in the existing code base than trying to convert it.