Part of our evidence comes from direct sampling of the Earth's structural makeup. However, the deeper parts of the Earth are harder to reach, so we often rely on analyses of seismic waves and gravity, as well as magnetic studies.

You can read more about this topic here: https://sciencing.com/do-scientists-structure-earths-interior-8695198.html