tex4ht: incompatibility of cleveref and amsthm?

Question

I found that tex4ht doesn't work with cleveref and amsthm. I just modified the HWE from an old post:

\documentclass{article}
\usepackage{hyperref}
\usepackage{amsthm}
\usepackage{cleveref}
\newtheorem{thm}{Theorem}[section]
\newtheorem{rmk}[thm]{Remark}
\begin{document}
\begin{rmk}\label{test}
Test content
\end{rmk}

See the test found in \cref{test}
\end{document}

When I compile it with htlatex, it complains:

! Argument of \eorem:syle has an extra }.
<inserted text> 
                \par 
l.8 \begin{rmk}
               \label{test}

This answer suggests \AtBeginDocument. However, then the \cref will be rendered wrongly as ??. I wonder a workaround for this.