Upon further inspection it seems the other answer wasn't right. Okay, maybe the glyphs were right, but I needed a full set of characters, and for whatever reason "h" was missing, and it turns out the full story is more complicated. To figure out which fonts are used I analyzed a pdf document containing just a bunch of letters in math mode. An example result (from "pdffonts" cmd line tool) is:
name type encoding emb sub uni object ID
------------------------------------ ----------------- ---------------- --- --- --- ---------
FFIQJR+CMMI10 Type 1 Builtin yes yes no 4 0
RLKJHN+CMR10 Type 1 Builtin yes yes no 5 0
CMMI10 was the font I was looking for. And for this font, the correct characters are not special unicode characters, just the regular abcde...xyz, etc. CMMI stands for Computer Modern Math Italic.
However, adding more characters reveals that more than one font is used by default. I have been testing and so far, my results are
cmmi10 for abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ, comma, period, ><, lowercase greek
cmr10 for upper case greek 0123456789 and ?+=!()
cmsy10 for -* \to \ll \gg \leq \geq \approx \dagger
Update: I have used the program fontforge to combine these different fonts into one custom font, so that one can just type like normal (or use the default unicode characters for greek letters etc) and it will look like math mode. I didn't copy in every single character but I included all of the most useful characters and then some. It's a combination of cmmi10, cmr10, and cmsy10. In case it is helpful to other users, you can download it here:
https://drive.google.com/file/d/1NyH1rAtnCgJSsmZS_PWmm3f3k-oBCRUx/view?usp=sharing
The individual fonts that it is composed of can be downloaded here:
https://ctan.org/tex-archive/fonts/cm/ps-type1/bakoma/ttf/?lang=en
however in seemingly random cases a single glyph was missing, for example it has "greater than or equals", but not "less than or equals". So far I have been able to find the missing glyphs by searching for the same font from a different website.