minutes

Outsmarting Metcalfe's Law: how successful companies scale development without chaos

In my professional life, working on innovation and software projects, everything always revolved around time (money), deadlines and quality.

Since software development is a creative field, many things are unpredictable. And who likes unpredictability? My search for coping with the unpredictability that consequently leads to project delivery disasters led me to renowned engineer and software architect Fred Brooks. He once said "adding manpower to a late software project makes it later". The reasons for that "fact" have been partly uncovered by Robert Metcalfe, calling it Metcalfe's Law. I'm combining his analysis of communication complexity with our own experience at Eli5, to give insights on ways to execute software projects better.

After reading this article, readers will understand that the exponential growth in communication complexity represents the primary force driving software projects over budget and beyond deadlines.

Picture this: your software project starts with five dedicated team members, each brilliant in their domain. Communication flows smoothly, decisions happen quickly, and progress feels tangible. Then, driven by deadline pressure or scope expansion, three more people are added. Suddenly, what felt manageable becomes chaotic. Meetings multiply, progress slows, and the project that seemed on track begins its descent into the familiar hell of missed deadlines and budget overruns.

This scenario plays out across thousands of organizations daily, yet most project managers treat it as bad luck rather than understanding the underlying mechanics. Software project failures follow patterns encoded in the mathematics of human communication itself, following a principle that makes success increasingly improbable as projects grow.

In this article, I go over the three main components of communication complexity and human bias that, in my opinion, are the primary causes that lead to software project failures.

Part I: Metcalfe's Law
the mathematical foundation of project complexity

Metcalfe's Law, originally formulated by telecommunications pioneer Robert Metcalfe in 1980, states that the value of a network is proportional to the square of the number of connected users (n²). When applied to project teams, this reveals a challenging reality: as team size increases linearly, communication complexity increases exponentially.

A team of two people has only one communication channel. Add two more people, and you have six channels. Double again to eight people, and you're managing 28 communication pathways. At ten team members, you're dealing with 45 potential communication routes.

Managing twice as many people all communicating with one another is not twice as much work. It's four times as much. Tripling the size of a project multiplies the communication challenge nine-fold.

Metcalfe's Law reveals the mathematical complexity growth in communication channels, and the human element transforms this potential complexity into operational challenges.

Stakeholders have different communication preferences, information processing styles, and expectation frameworks. Some prefer detailed technical documentation, others want high-level summaries. Some need frequent updates, others find constant communication disruptive.

As communication channels grow exponentially, the probability that all stakeholders maintain aligned expectations decreases significantly.

Part 2: The inverted U-curve
more communication destroys performance

Recent academic research has discovered an inverted U-shaped relationship between communication network density and project performance. This finding reveals a counterintuitive truth: there's an optimal level of communication, beyond which additional communication actually reduces performance. Increasing the frequency of interactions among members may bring excessive information processing pressure to core members, leading to negative effects of information overload.

Too little communication leads to:

  • Coordination failures
  • Missing requirements
  • Duplicated effort
  • Technical incompatibilities

Too much communication creates:

  • Information overload
  • Decision paralysis
  • Productivity-destroying overhead
  • Communication bottlenecks

There is consensus in studies showing correlation between project success and team size, with smaller teams consistently outperforming larger ones: teams of 5-9 members had the highest productivity, while larger teams saw productivity decreases due to communication overhead.

Most project managers don't recognize they're crossing the critical threshold until it's too late. By the time communication overhead becomes visibly destructive, the project has usually moved beyond the point of recovery.

Part 3: The senior engineer bias
overestimating the speed of delivery

The effects of communication challenges are amplified by a human bias in an inherently subjective activity: estimating what one can accomplish within a certain time frame.

Senior engineers, despite their extensive experience and technical expertise, consistently overestimate their delivery capacity. This bias stems from several cognitive factors that become more pronounced in complex team environments. First, the planning fallacy affects even experienced professionals. When estimating task completion, senior engineers focus on best-case scenarios and fail to adequately account for the inevitable interruptions, dependencies, and edge cases that emerge during implementation.

The expertise curse compounds this problem. Senior engineers possess deep technical knowledge, which creates confidence in their ability to solve problems quickly. However, this confidence doesn't account for the communication overhead that grows exponentially with team size. A senior engineer might accurately estimate the time needed to write a piece of code, but underestimate the time required to coordinate with other team members, participate in meetings, review pull requests, and handle the constant context switching that larger teams demand.

The interconnected nature of modern software systems makes individual estimates increasingly unreliable. A senior engineer might complete their assigned module perfectly and on time, but delays in dependent components, integration challenges, or changing requirements from stakeholders can render their estimates meaningless. The more people involved in a project, the more these interdependencies multiply, creating a cascade of estimation errors that compound over time. When you combine overconfident time estimates with exponential communication complexity, project timelines become fundamentally unrealistic from the start.

The path forward
coping with constraints

The mathematics of Metcalfe's Law suggest that traditional approaches to software project management (adding resources, scaling teams, coordinating stakeholders) create fundamental compatibility issues with reliable delivery. The exponential growth in communication complexity makes project challenges significantly more likely as teams grow beyond optimal sizes. We need to design around communication complexity rather than fighting it:

  • Accept exponential communication costs as a fundamental constraint, not a solvable problem.
  • Design for communication limits by keeping core decision-making teams below critical thresholds.
  • Partition complex projects into genuinely independent modules with minimal inter-team communication requirements.
  • Establish communication hierarchies that prevent full network connectivity between all team members and stakeholders.
  • Measure communication overhead explicitly and treat it as a leading indicator of project risk.

The biggest takeaway is that communication complexity needs to be treated as a structural constraint rather than a coordination challenge, otherwise software projects will continue facing these patterns with predictable regularity.

To conclude, I want to show one simple example from our daughter company Noco.agency where they intervened in the exponential growth of communication channels by killing (almost) all group meetings and going for asynchronous communications as the primary way of communicating. Messaging via Slack, but foremost: sharing updates and progress through recorded videos (talking and showing), so the whole team can stay informed without the exponential meeting overhead that traditionally destroys productivity.

Traditional companies add people and watch productivity crash. We added people and eliminated the communication patterns that cause the crash. Async video updates, clear documentation, and zero unnecessary meetings. It's not rocket science, but it works”
Ian, CEO of Noco
current