I actually figured this out. So if anyone else wants to know, you can manually add links under/above the video by doing it like this:
<a href="#" onclick="jwplayer().seek(57);">0. Introduction</a>
Just edit the name of your link, and in the “.seek(57)”, change 57 to the marker (in seconds) where you want it to jump to.
