ISP Hierarchy, WAN/MAN Infrastructure, and Data Transit

The global internet is often perceived as an invisible, atmospheric entity where data floats effortlessly through the air between mobile devices and satellites. In reality, modern computer networking relies on a massive, physical, hardwired infrastructure consisting of subsea fiber-optic cables, localized landing stations, and a strictly structured hierarchy of Internet Service Providers (ISPs). Understanding how packets traverse boundaries—from a local network interface to transoceanic fiber backbones—is foundational for system design, network engineering, and production DevOps.

1. The Myth of the Wireless Planet: How Internet Actually Travels

A widespread misconception among end users is that the internet operates predominantly over the air. The ubiquity of consumer Wi-Fi, 4G/5G cellular towers, and satellite constellations (such as SpaceX's Starlink) leads many to believe that when a user in Pune transmits a message to a recipient in New York or Canada, the data flies directly into space, bounces off a satellite, and descends onto the destination device.

In production reality, wireless transmission represents merely the last few meters or miles of the journey. The overwhelming majority (over 95-99%) of all intercontinental internet traffic travels through physical glass cables laid deep along the ocean floor.

Note: Wi-Fi and mobile data networks are simply access technologies. They exist solely to bridge the short physical gap between a client device and the nearest hardwired telecommunications exchange.

2. Why Satellites Are Not the Primary Global Backbone

While satellite communication is viable for remote, maritime, or disaster-stricken environments, it is fundamentally unsuited to act as the core transit pipeline for the global internet economy due to orbital mechanics, propagation delays, and throughput constraints.

The Physics of Latency

The speed of electromagnetic radiation in a vacuum is $c \approx 3 \times 10^8 \text{ m/s}$. However, the propagation delay ($t$) is a direct function of physical distance ($d$):

1. Geostationary Satellites (GEO):

   • Orbit altitude: $\approx 35,786 \text{ km}$ above the Earth.
   • A single round-trip signal up to a GEO satellite and back down covers at least $71,572 \text{ km}$.
   • Theoretical one-way latency exceeds $240 \text{ ms}$; realistic round-trip times (RTT) easily surpass $600 \text{ ms}$. This introduces unacceptable latency for real-time systems, financial transactions, database replication, and streaming protocols.

2. Low Earth Orbit Satellites (LEO):

   • Orbit altitude: $\approx 500 \text{ km} - 1,200 \text{ km}$ (e.g., Starlink).
   • While LEO reduces physical distance significantly, orbital mechanics dictate that these satellites move at roughly $27,000 \text{ km/h}$ relative to the surface.
   • Continuous ground handoffs, atmospheric weather attenuation (rain fade), high rocket launch costs, and severe bandwidth limits per satellite prevent LEO constellations from replacing high-density transoceanic fiber trunks capable of moving hundreds of terabits per second.

3. The Geopolitical and Terrestrial Limitations of Land Routes

If aerial transit is sub-optimal, why not lay terrestrial cables across landmasses to connect continents? Connecting regions via purely overland routes encounters critical engineering and geopolitical blockers:

• Geopolitical Boundaries and Borders: Terrestrial cables must cross national frontiers, passing through politically unstable regions, disputed territories, and disparate sovereign jurisdictions. Securing continuous right-of-way (ROW) permits and military clearances across dozens of contiguous nations is legally and operationally precarious.
• Topographical and Environmental Hazards: Laying high-capacity terrestrial fiber requires trenching across mountain ranges (e.g., Himalayas, Alps), dense forests, and deserts. These routes are continuously vulnerable to civil construction accidents (backhoe fade), earthquakes, soil erosion, and human sabotage.
• Maintenance Complexities: Repairing terrestrial lines running through foreign sovereign soil requires diplomatic coordination, visas, and cross-border transport of specialized engineering equipment.

To bypass terrestrial friction and geopolitical checkpoints, telecommunication consortia route the core backbone through international waters.

4. The Subsea Backbone: Undersea Fiber-Optic Cables

Undersea cables—known as Submarine Communications Cables—form the nervous system of the modern interconnected world.

The Submarine Cable Network

A review of global maritime connectivity maps (such as the Submarine Cable Map) reveals hundreds of multi-fiber conduits threading the seabed:

• Transatlantic Corridors: Linking New York/New Jersey to the United Kingdom, France, and Spain.
• Transpacific Corridors: Linking the US West Coast (California, Oregon, Washington) to Japan, Taiwan, and Australia.
• Eurasian/African Routes: Linking Mumbai and Chennai across the Arabian Sea, Red Sea, and Mediterranean into Europe, or wrapping around the Cape of Good Hope.

When an engineer in Mumbai pushes code to a GitHub repository hosted in a US-East AWS data center, or sends a message to a colleague in Ethiopia or Canada, the payload does not travel through space. It is converted into modulated photonic bursts (light pulses) and shot through transoceanic fiber strands resting along the ocean seabed.

5. Physical Architecture: Standalone Nodes vs. The Global Mesh

To understand what the internet fundamentally is, one must deconstruct the system to its barest technical components.

• Standalone Devices: A computational unit operating in total isolation. It has its own CPU, memory, and local storage, but cannot transmit state, synchronize clocks, or deliver payloads to other nodes.
• Networked Devices: Two or more computational nodes linked by a shared transmission medium capable of interpreting signaling protocols.
• The "Source" of the Internet: The internet has no central physical core, single database, or single originating battery. It is an arbitrary collection of private, public, academic, and governmental networks linked through standard physical interfaces and unified by common protocols (TCP/IP, BGP). The physical infrastructure—the physical fiber, switches, and optical repeaters—is the internet.

6. The Topological Hierarchy: From Planet to Home

Global communication operates via concentric rings of network topology. Structurally, the network descends from transoceanic aggregates down to private consumer nodes:

Network Classifications by Scope

1. Wide Area Network (WAN): Spans transoceanic distances, entire countries, or continents. WANs connect regional networks using submarine cables, fiber trunks, and core carrier switches.
2. Metropolitan Area Network (MAN): Encompasses an entire city or metropolitan region. MANs interconnect local exchanges, data centers, and cable landing stations back to the WAN.
3. Local Area Network (LAN): Confined to a discrete physical geography: a home, an office floor, or an enterprise campus. Traffic within a LAN travels through local switches and wireless access points without reaching external transit providers unless bound for external addresses.

7. The Tiered ISP Transit Model

The physical cables traversing oceans and continents are owned by commercial consortia, telecommunications giants, and multinational tech conglomerates. To move data across these systems, the industry uses a hierarchical three-tier provider architecture:

Tier Classifications

1. Tier-1 ISPs (Backbone Operators):

   • Do not pay for internet transit within the global routing core.
   • Enter into reciprocal settlement-free peering agreements with other Tier-1 operators, agreeing to carry each other's traffic across backbones at parity.
   • Own, operate, and maintain the subsea fiber cables and continental fiber backbones (e.g., Lumen, Tata Communications, Telia Carrier, NTT, AT&T).

2. Tier-2 ISPs (Regional and National Operators):

   • Cover national or multi-state footprints (e.g., Reliance Jio, Bharti Airtel, Comcast, British Telecom).
   • Maintain their own regional backbones and peer with other Tier-2 providers at Internet Exchange Points (IXPs) to keep local traffic local.
   • Must purchase IP transit from Tier-1 ISPs to access destinations on external continents or networks outside their peering footprint.

3. Tier-3 ISPs (Last-Mile Retailers):

   • Local internet service providers delivering services to retail end users and local businesses.
   • Do not own transit networks; they purchase upstream bandwidth from Tier-2 or Tier-1 providers and manage physical cabling (Fiber to the Home - FTTH, DSL, Cable coaxial) directly to user buildings.

8. Physical Data Transit: The Mechanics of Light and Latency

Data does not traverse fiber-optic cables instantaneously. The speed of light in a vacuum is $c \approx 300,000 \text{ km/s}$. However, fiber-optic cores are made of silica glass ($SiO_2$), which has a refractive index of approximately $n \approx 1.468$.

Calculating the Speed of Light in Fiber

The velocity of light within a fiber core ($v_{\text{fiber}}$) is reduced according to the refractive index:

This equals approximately $204,360 \text{ km/s}$, or roughly two-thirds of the speed of light in a vacuum.

Calculating One-Way Cable Latency

Consider a direct subsea cable running between Mumbai, India, and Marseille, France, measuring a fiber length of approximately $7,000 \text{ km}$:

A theoretical round trip (RTT) strictly based on photon propagation time would be:

Note: In production, actual RTT is higher (often $90 - 110 \text{ ms}$) due to:

1. Optical-Electrical-Optical (OEO) Regeneration / Amplification: Optical signals degrade over distance and require periodic amplification via Erbium-Doped Fiber Amplifiers (EDFA) along the sea floor.
2. Router Hop Processing: Serialization delay, queueing delay, and route lookup within intermediate core routers.
3. Non-linear Cable Routing: Submarine cables curve along continental shelves and marine trenches rather than running in geometric straight lines.

9. End-to-End Data Transit Lifecycle

To trace how high-level application code maps to the physical infrastructure, follow the lifecycle of a single network request: an end user in Pune, India, hits an API server hosted in North Virginia, USA.

[ Pune, India: Client Device ]
        |
        | 1. App serializes payload into HTTP/TCP/IP packets
        | 2. Wi-Fi chip modulates packet into 5 GHz RF wave
        v
[ Home / Office Wi-Fi Router ]
        |
        | 3. Converts RF to light pulses over FTTH fiber drop
        v
[ Tier-3 Local Access Node / OLT ]
        |
        | 4. Multiplexed into high-capacity municipal fiber line
        v
[ Tier-2 Regional Point of Presence (PoP) in Mumbai ]
        |
        | 5. Core router evaluates Border Gateway Protocol (BGP) tables
        v
[ Mumbai Cable Landing Station (CLS) ]
        |
        | 6. Optical Line Terminal equipment pushes packet into Subsea Fiber
        v
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   INDIAN OCEAN / ARABIAN SEA / ATLANTIC TRANSIT (Submarine Cable)
   Photons travel at ~204,000 km/s through silica glass on sea floor.
   Erbium-Doped Fiber Amplifiers boost signal intensity every ~80 km.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        v
[ US East Coast Cable Landing Station (e.g., New Jersey/Virginia) ]
        |
        | 7. Optical signal demodulated into electrical signals
        v
[ Tier-1 Core Backbone Network ]
        |
        | 8. High-speed multi-terabit MPLS routing to cloud data center
        v
[ AWS us-east-1 Data Center / Server Rack ]
        |
        | 9. NIC offloads packet; kernel inspects TCP sequence
        v
[ Backend Application Server (e.g., Go / Java / Node.js Process) ]

10. Industry Reality: Redundancy, Cable Cuts, and BGP Failover

Because the global economy rests on physical undersea conduits, infrastructure engineers and DevOps teams must account for real-world physical failure modes:

• Anchor Drags and Seismic Activity: Commercial fishing vessels, ships dragging anchor, and underwater earthquakes sever submarine cables multiple times every month worldwide.
• BGP Anycast and Autonomous System (AS) Rerouting: The internet does not rely on a single cable run. When a subsea cable in the Red Sea is severed, core routers running the Border Gateway Protocol (BGP) detect packet dropouts or path withdraw announcements.
• Automatic Route Convergence: Traffic is automatically rerouted across alternative geographic paths (e.g., swinging transpacific traffic across Europe or down through southern Africa).

DevOps engineers observing latency spikes in telemetry pipelines (e.g., Datadog, Prometheus) during regional disruptions are often seeing the direct performance impact of packets being rerouted thousands of kilometers around physical cable breaks.

Summary and Key Takeaways

• The Internet is Fundamentally Physical: Despite consumer reliance on Wi-Fi and cellular access, over 95% of international internet traffic flows through physical cables laid on the ocean floor, not through satellites or the atmosphere.
• Satellites Have Extreme Physics Trade-offs: Satellites cannot easily match the aggregate throughput and low propagation delays of subsea optical fiber. Geostationary orbits suffer from high latency ($>600 \text{ ms}$ RTT), while LEO constellations face line-of-sight transit and handoff limits.
• Undersea Routes Avoid Overland Friction: Submarine fiber deployment bypasses complex geopolitical border controls, international right-of-way licensing disputes, and accidental terrestrial trenching cuts.
• The Internet Has No Single Source: The internet is an interconnected mesh of physical networks. Without physical interconnection media, compute devices remain isolated standalone machines.
• Hierarchical Network Scope: Data transitions seamlessly across geographic topologies, moving from Local Area Networks (LAN) to Metropolitan Area Networks (MAN) to Wide Area Networks (WAN).
• The Three-Tier ISP Architecture: Tier-1 ISPs own the global backbones and use settlement-free peering; Tier-2 ISPs operate regional/national footprints and purchase transit from Tier-1; Tier-3 ISPs manage last-mile access directly to homes and offices.
• Finite Propagation Speed: Light travels through silica fiber optic cores at roughly $204,360 \text{ km/s}$ ($c / 1.468$), meaning physical geography dictates a non-negotiable minimum latency baseline for all distributed systems.
• Resilience via Dynamic Protocols: Cable landing stations and transoceanic lines are kept resilient through automated BGP rerouting, allowing modern cloud platforms to survive subsea line cuts without dropping global connectivity.