Yes, you probably can.
But why have such a headache?
LaTeX may have a command like \section to start a section, but there is no marker for the end of the section. TeX4ht is really good in overcoming such restrictions, but maybe you try yourself with an example *.tex file that suits your needs.
There are -- mainly -- to other ways: pandoc or orgmode.