Interfaces are implemented (exposed) by the components.
Other components reference this interfaces and use them to create objects, invoke methods, etc. This relationship between a component and the interface it uses is called dependency.
The more interfaces you have in your system, the complexer your system is.
Actually, the factor that influences the complexity much more than pure interface count is the nature and the structure of just mentioned dependencies. A solid system architecture has low number of dependencies, organized in a clear, clean and simple manner.
Especially dangerous are so called circular dependencies. They should be fully avoided.
A simple example: