Right now I have a long table spanning across both pages. At the bottom of the portion of the first page it says "Continued on next page", which is good, but this also appears at the bottom of the portion on the second page. Here's the code I'm using:
\begin{longtable}{cc}
\caption{Reward surfaces of all MuJuCo environments} \\
\hline
\endfirsthead
\multicolumn{2}{c}%
{\tablename\ \thetable\ -- \textit{Continued from previous page}} \\
\hline
\endhead
\hline \multicolumn{2}{r}{\textit{Continued on next page}} \\
\endfoot
\hline
\includegraphics[width=2.75in,keepaspectratio]{./plots/mujuco/antepisode_rewards_3dsurface.png} & \includegraphics[width=2.75in,keepaspectratio]{./plots/mujuco/halfcheetahepisode_rewards_3dsurface.png} \\
\includegraphics[width=2.75in,keepaspectratio]{./plots/mujuco/hopperepisode_rewards_3dsurface.png} & \includegraphics[width=2.75in,keepaspectratio]{./plots/mujuco/humanoid@3x3episode_rewards_3dsurface.png} \\
[...]
\end{longtable}
\endlastfoot
without that