Why is setting open_files_limit making MySQL slow?

Question

We noticed that adding open_files_limit in /etc/my.cnf is making server slow.

Reference : What variable(s) to look to maintain MySQL speed of scanning through all database tables while it starts?