The size of the files should not impact the query time on the directory.
If you want to test it yourself check out the Measure-Command cmdlet. It will show you the amount of time it takes to execute a command.
Measure-Command {dir C:\LargeFolderStructure -Filter '*.txt' -rec }