# Using CJK (Chinese/kanji) characters in math using unicode-math on lualatex

I'm trying to persuade the unicode-math package to let me insert CJK characters (Chinese ideograms) in math formulæ. Here's a sample input (the first few lines are merely to check that basic functionalities and fonts are present:

 \documentclass[a4paper]{article}
\usepackage{fontspec}
\usepackage{unicode-math}
\setmainfont{Linux Libertine O}
\newfontfamily\cjkfont[Script=CJK]{Kochi Mincho}
\setmathfont{XITS Math}
\setmathfont[range={"4E00-"9FFF},Script=CJK]{Kochi Mincho}
\begin{document}
Hello, world!  Здравствуй, мир!  Unicode est vraiment \emph{épatant} !

\cjkfont{漢字}

$\mathbf{Δ} = (Δ_ι)_{ι∈I}$

$無 = ∅$
\end{document}


The "Linux Libertine O" and "Kochi Mincho" fonts are present on my system, respectively as LinLibertine_R.otf and kochi-mincho-subst.ttf. I'm using lualatex from TeXlive 2012, and the fontspec and unicode-math packages it contains. Everything works fine except the last formula, in which the character 無 simply does not appear.

Now the line

 \setmathfont[range={"4E00-"9FFF},Script=CJK]{Kochi Mincho}


was supposed to mean "for all Unicode characters in the range from U+4E00 to U+9FFF (i.e., the main CJK block), use the Kochi Mincho font".

The only clue I have is this warning:

*************************************************
* fontspec warning: "script-not-exist"
*
* Font 'KochiMincho' does not contain script 'CJK'.
*************************************************


But first of all I can't imagine what it means (the font in question is a CJK font, so obviously it does contain the CJK script, and, indeed, in text mode it works fine); and besides, using the \cjkfont command I defined produces the same warning but still works, so this warning alone cannot be fatal.

-
Welcome to TeX.SX! – e-birk Feb 21 at 19:59
Related question but using packages "fontenc", "inputenc" instead of "fontspec" and "unicode-math": tex.stackexchange.com/q/65599/24449 – e-birk Feb 22 at 11:38
@e-birk: I'm not sure how what you're saying is different from what I was asking: \setmathfont[range=\mathrm/{Greek}]{myfont} is used to replace Greek characters by those in myfont, and what I want to do is replace Chinese characters (which the default math font does not have) by those in myfont. But of course I'd be happy with any way of getting Chinese characters to work in math mode (short of typing \textrm which would fail to decrease the size when in superscript/subscript). – Gro-Tsen Feb 22 at 15:44
Sorry, you are right. I deleted my comment. I had a different idea in mind. Math mode is different from normal text mode. A letter like "a" can be typeset in many styles just by using \mathbf, \mathcal, \mathbb, ... By default it is typeset by some math font. I guess that a character like 無 is probably mapped to some different unicode position by the processing in math mode. The new - thus, wrong - position is maybe empty or is a placeholder. That could be the problem... Please, see my humble try to answer below. – e-birk Feb 23 at 1:06

The characters to be used in math mode are from CJK languages. In general these characters can be considered as ordinary symbols. According to the math classification -- see also my explanation below! -- there are two such classes: 0 and 7. Typesetting of CJK languages is different from typesetting languages with alphabets. E.g., traditionally CJK languages do not use italics for emphasis (but may have other means to do so). If italics, bold shape ... do not existing for such a font and \mathit, \mathbf, ... cannot be used then it seems appropriate to choose class 0 instead of class 7. Actually by default, a unicode character "zzzzzz ("0 - "10FFFF) is assigned Umathcode "0"0"zzzzzz. Hence, the character is already considered as an ordinary symbol of font family 0 and no change is necessary.

But it seems that \setmathfont (unicode-math, version 0.7c) is not working properly. As a workaround we define the command \adjustmathfont that uses a counter my@char to steps through the range from the first index #1 to the last index #2. At each step we adjust the font family by \Umathcode\value{my@char} = "0 #3 \value{my@char} to the font family given by the third argument #3. For example, if #1 and #2 are equal to "7121 and #3 is equal to "4 this just produces \Umathcode"7121="0"4"7121. The full code in a MWE follows.

\documentclass{article}
\usepackage{fontspec}
\usepackage{unicode-math}
\setmainfont{Linux Libertine O}
\newfontfamily\cjkfont{Kochi Mincho}

%------ workaround ------
\usepackage{etoolbox}
\makeatletter

%   where  arg1 is the beginning of the unicode range, e.g. "4E00
%          arg2 is the end of the unicode range, e.g. "9FFF
%          arg3 is the font number, e.g. "4
\newcounter{my@char}
\ifnumgreater{#1}{#2}{%
\PackageWarning{}{No adjustment of math font since #1 is greater than #2.}
}{
\setcounter{my@char}{#1}
\Umathcode\value{my@char}="0 #3 \value{my@char}
\whileboolexpr{%
test {\ifnumless{\value{my@char}}{#2}}
}{%
\stepcounter{my@char}
\Umathcode\value{my@char}="0 #3 \value{my@char}
}
}
}
\makeatother
%------------------------

\setmathfont{XITS Math}
\setmathfont[range={"4E00-"9FFF}]{Kochi Mincho}
%the new math font (here "Kochi Mincho") might use font number 4 or higher;
%please see @Gro-Tsen's comment how to automate this;

\begin{document}
Hello, world!  Здравствуй, мир!  Unicode est vraiment \emph{épatant}!  \cjkfont{漢字}

$\mathbf{Δ} = (Δ_ι)_{ι∈I}$  $無_無^無 = ∅$
\end{document}


BTW, the usage of \cjkfont could be avoided by using an approach as shown in this blog. For example, the package fontspec can be replaced by ctex and \setCJKmainfont{Kochi Mincho} needs to be added. Then \cjkfont is not needed.

Math mode has different rules from "normal" text typesetting. In math mode each character is assigned a "mathcode" (hexadecimal "xyzz), which tells how to print that character. The mathcode consists of three parts: the "math class" x, the font family y, the position zz of the character in that font family.
The class x controls several aspects of typesetting of a character, especially the spacing, and can take following eight values: 0: ordinary symbol, 1: large operator, 2: binary operator, 3: relation, 4: opening symbol, 5: closing symbol, 6: punctuation, 7: variable family (= oridnary symbol except that \fam is choosen instead of y if \fam in the range 0-15). The font family y is from the range 0-15. The position zz is from the range 0-255.
For example, the mathcode of the symbol \, is set by \mathcode\,="613B which means that \, is considered as punctuation and typeset by using the symbol "3B of font family 1. More examples can be found in the file "tex/plain/base/plain.tex".
Nowadays computers are much less restricted than some decades ago. Thus, by using the package unicode-math the ranges of the mathcode are extended: for the font family to yy (8 bits) and for the charater positions to zzzzzz (ranging "0 to "10FFFF, about 21 bits) to suit Unicode fonts. The extended fields can be set by \Umathcode"zzzzzz="x"yy"zzzzzz, for example, \Umathcode\leftarrow="3"0"02190. (For details, see the luatexref documentation mentioned here.)
 Thanks! At least this makes some sense, it might not be ideal but it's better than nothing, and it's not too ugly. Although it raises a lot of new questions: now I would really like to know why only "4007121 seems to work, and how I might define 無 to be a relation, or a binary operator, or whatever. – Gro-Tsen Feb 24 at 23:22 PS: Maybe "4007121 doesn't mean class 4, there could be a bit shift which is not a multiple of 4 (this thread suggests that there is some confusion about how the values are computed, and I can't even get \luatexUmathcode to produce the same effect as \Umathcodenum), anyway, the whole thing is a mess. | PPS: I'll accept your answer later on, in the hope of drawing other ones. ☺ – Gro-Tsen Feb 24 at 23:29 @Gro-Tsen It seems that \Umathcodenum無="4007121 has to be replaced by \Umathcode無="0"4"7121 and then things work the way which I described in my answer. I'll update my answer later if I get clearer... – e-birk Feb 25 at 0:59 It seems that the number 4 is the math family number that was assigned to the font by unicode-math's \setmathfont, or perhaps by fontspec, but after a great deal of pulling my hair I can't figure out how I could read this value. (As for the range argument, it appears to be completely ignored: even if we specify an empty range, the code still works exactly the same.) – Gro-Tsen Feb 28 at 19:01 Ah, got it! After \setmathfont the font family name can be accessed as \um_symfont_tl (need to use \ExplSyntaxOn and \ExplSyntaxOff around this), and the family number itself as \the\csname sym\um_symfont_tl\endcsname. So all in all, something like \Umathcode無="0"\the\csname sym\um_symfont_tl\endcsname"7121 seems to work. Yucky, but that's the best I can do so far. – Gro-Tsen Feb 28 at 19:15