Why granularity?

In a discussion with a coworker, it came up that teams of different sizes need different organizational structures. So may be that's why I feel that granularity is needed for managing software applications that reach a certain complexity?
