The latency is relatively low because the Starlink satellites are in low earth orbit. In simple terms, they're closer to you than some other types of satellites that orbit at higher (further from you) altitudes.
Laser links in orbit can reduce long-distance latency by as much as 50%, due to higher speed of light in vacuum and shorter path than undersea fiber.