The Pythagorean Theorem in Navigation and GPS

In navigation, the Pythagorean theorem turns two perpendicular movements, usually east–west and north–south, into one straight-line distance: d = √(Δx)² + (Δy)². Map readers use it to measure between grid points, sailors and pilots use it to find displacement, and GPS receivers use its 3D form to model their distance to each satellite.

Straight-line distance on a map grid

Many topographic maps print a square grid, often with lines 1 km apart. East and north are perpendicular, so any two points on the grid are the ends of the hypotenuse of a right triangle. The legs are Δx (the change in the east coordinate, read "delta x") and Δy (the change in the north coordinate).

With coordinates instead of a ruler this is exactly the distance formula, and the distance formula calculator will do it for any two points. Always measure both legs in the same unit and convert with the scale once, at the end.

Displacement: where a ship or plane really ends up

The distance a vessel travels along its route is not the same as its displacement, the straight-line distance and direction from start to finish. Before satellite positioning, navigators estimated position by dead reckoning: tracking course, speed and time, and adding up how far the vessel had gone north and east. The Pythagorean theorem then turns those totals into a single distance.

With several legs, add up all the east–west parts and all the north–south parts first, counting west and south as negative. Then use the theorem once on the totals.

The boat sailed 22 nmi but ended √6² + 8² = 10 nmi from its start, a doubled 3-4-5 triangle, on a bearing of arctan6 over 8 ≈ 036.9°.

Real courses are rarely due north or due east. A leg of 300 km on a bearing of 060° splits into a north part of 300 cos60° = 150 km and an east part of 300 sin60° ≈ 259.8 km. Trigonometry does the splitting and the theorem checks it: √150² + 259.8² ≈ 300. The page on Pythagoras or trigonometry explains which tool to reach for when.

The wind triangle for pilots

An aircraft moves through the air, and the air itself moves over the ground. Pilots separate four quantities: heading (where the nose points), airspeed (speed through the air), track (the actual path over the ground) and ground speed. The wind adds its own velocity, and the three velocities form a triangle. When the wind blows at right angles to the heading or the track, that triangle is a right triangle.

Winds are reported by the direction they blow from, so a west wind (from 270°) pushes the aircraft toward the east.

Real winds usually blow at other angles, and then the triangle has no right angle. Pilots solve those with a flight computer such as the E6B or with software, which split each velocity into components or use the law of cosines. The vector ideas behind this are on the physics page.

How GPS uses 3D distances

GPS does not "use Pythagoras" in a single step, but the theorem sits at the heart of the calculation. Here is what a receiver actually does, in simplified form:

1. Listen. Each satellite, orbiting about 20,200 km above the Earth, broadcasts where it is and the exact time its signal left, kept by onboard atomic clocks.
2. Time the signal. The receiver notes when the signal arrives. Travel time multiplied by the speed of light, about 299,792 km/s, gives a range. The trip takes roughly 0.07 seconds.
3. Write a distance equation. In an Earth-centered x, y, z coordinate system, the range to satellite i at (x_i, y_i, z_i) is the 3D Pythagorean distance. Each equation puts the receiver somewhere on a sphere around that satellite.
4. Allow for the clock. The receiver's own clock is an ordinary quartz clock, so every measured range is off by the same unknown amount c b, where b is its clock error and c the speed of light. Four unknowns (x, y, z, b) need at least four satellites:

5. Solve and convert. The receiver starts from a guess and refines it until all the equations agree as closely as possible, usually with more than four satellites in view. It then converts x, y, z into latitude, longitude and height.

The precision demanded is extreme: light travels about 300 m in one microsecond, so a timing error of just one millionth of a second would shift a range by about 300 m. That is why the clock is solved for rather than trusted, and why the system also corrects for atmospheric delays and for relativistic effects on the satellite clocks.

Trilateration on a flat map

The same idea works in two dimensions with circles instead of spheres. Suppose three radio beacons sit at A(0, 0), B(10, 0) and C(0, 10), in kilometers, and you measure your distances to them as 5 km, √65 ≈ 8.06 km and √45 ≈ 6.71 km. Each measurement is a circle (see the equation of a circle):

Subtract the first equation from the second: −20x + 100 = 40, so x = 3. Subtract the first from the third: −20y + 100 = 20, so y = 4. Check: 3² + 4² = 25. You are at (3, 4). Subtracting cancels the squared terms and leaves straight-line equations, a trick that also appears in some GPS solution methods.

Where flat-map distances stop working

The Earth is round, so the Pythagorean theorem only works on a patch small enough to treat as flat. Within a city or a few tens of kilometers, the flat version is extremely accurate. Over hundreds or thousands of kilometers, navigators switch to great-circle formulas from spherical trigonometry. On a sphere, a triangle can even have three right angles, as the page on the theorem on curved surfaces shows.

Latitude and longitude need care too. A degree of latitude is about 111.2 km everywhere, but a degree of longitude shrinks toward the poles: it is about 111.2 cos(latitude) km. Convert both to kilometers first, then use the theorem.

Stretch the same method across an ocean and it breaks down. From New York (40.71° N, 74.01° W) to London (51.51° N, 0.13° W), the great-circle distance is about 5,570 km. The flat method with the cosine correction gives about 5,820 km, roughly 4.5% too long. Treating degrees of latitude and longitude as equal squares, which is a common mistake, gives about 8,300 km, almost 50% too long.

How far is the horizon?

One navigation formula comes straight from a right triangle drawn on a round Earth. Your line of sight to the horizon just touches the surface, and a tangent line always meets the radius at 90°. The radius R, your sight line d and the line from the Earth's center to your eye, R + h, form a right triangle:

With R ≈ 6,371,000 m, a person whose eyes are 1.7 m above calm water sees about √2 × 6,371,000 × 1.7 ≈ 4,654 m, or 4.7 km. A lookout 30 m up sees about 19.6 km. A lighthouse 50 m tall can be seen by that 1.7 m observer from up to about 25.2 + 4.7 ≈ 29.9 km away, adding the horizon distances of both. Atmospheric refraction bends light slightly around the curve, so real horizons are usually a little farther than these geometric values.