Questions tagged [unicode]
{unicode} is for questions about Unicode (an international standard for character encoding) and its implementations. For questions about input encodings use {input-encodings}.
143
questions with no upvoted or accepted answers
5
votes
0
answers
68
views
LuaLaTeX font chainsubstitution works only for the first font loaded
Here is an extremely simplified version of my code from this answer, where I finally found a workaround to this problem:
\documentclass{article}
\tracinglostchars=3 % Panic if a font does not contain ...
- 42.3k
5
votes
0
answers
633
views
Localized glyphs (locl) have unicode value U+FFFD (�)
Originally this seemed to me like a font issue, as there was no equivalent problem with other fonts, as indicated by this good MWE:
Copied text from good PDF
EBGaramond12-Italic.otf:
[ - ] бгдпт
[...
- 926
4
votes
0
answers
287
views
Dotted Circle (U+25CC) with Combining Ring (U+030A) drawing incorrectly with XeLaTeX and Courier New
The Dotted Circle U+25CC with Combining Ring U+030A is not rendering correctly in my XeLaTeX document. They should be drawn together as one character, but instead are drawn separately as two ...
- 141
4
votes
0
answers
122
views
Fontspec shifts some diacritics marks when LetterSpacing
The fontspec feature LetterSpacing does not give the same result with a letter typed in ASCII form (e.g. \^E ) that when it is typed in UTF-8 form (e.g. Ê). The log file of the joined ECM shows that ...
4
votes
0
answers
116
views
For an arbitrary TeX-internal entity (e.g. METAPOST, TIPA), associate a unicode value for PDF copy/paste
Latin Modern Roman has bad output for certain unicode combinations, including ā́ (small Latin 'a' with macron and acute accent). This can be remedied by using the TIPA package for these combinations, ...
- 1,785
4
votes
0
answers
793
views
What hyperref options should be used for correct Unicode output?
I am trying to work out which hyperref options allow all Unicode characters to display properly, and whether XeLaTeX, LuaLaTeX, and pdfLaTeX have different configuration requirements. The hyperref ...
- 1,634
4
votes
0
answers
193
views
Support for all writing systems in a single document — more than just one or two Unicode planes simultaneously
I am working on a document that contains a growing number of representatives from different writing systems. It is mostly an English document, and I have been using the following to ensure that CJK ...
- 5,867
3
votes
0
answers
80
views
Importing code files with unicode using listings
I've written a program in python, about 2500 lines in total, that I wish to include segments from into my report. Normally I use listings to do that but in this case, the .py files include many ...
- 647
3
votes
0
answers
2k
views
Highlighting words with special characters using \hl (soul)
I am using xelatex, polyglossia and the document is in UTF-8 encoding. I use the soul package to highlight words (using soulutf8 makes no difference).
The problem is really weird, so I will go ...
- 751
3
votes
0
answers
2k
views
What UTF-8 characters are valid/invalid in utf8 inputenc?
I'm writing a Python program that reads some text files and writes the data to some TeX files. Unfortunately the TeX compilation stops with
Package inputenc Error: Unicode char \u8:´é« not set up for ...
- 11.5k
3
votes
0
answers
374
views
Accessing cmex10-equivalent symbols in latinmodern math in rendering code
I wish to display and print mathematical formulae not using one of the existing TeX distributions and not via a web browser, but using my own code so that the display is integrated into my packages as ...
3
votes
0
answers
360
views
Using UTF8 inside \path from the url package
Whereas there are certain rules for how a URL is to be formed (where non ascii letters are not really allowed). How about \path? I happend to try \path{æøå}, saved in latin1 this gives the expected ...
- 51.6k
3
votes
0
answers
137
views
Unicode and listings - still no luck
Although there are already some discussions on this issue, I can't get any of the proposed solutions to work for me.
Take this document and compile it with xelatex:
\documentclass[12pt,a4paper,parskip=...
- 365
2
votes
0
answers
65
views
Help with Indigenous characters (unicode)
I am writing a document in LaTeX and would like to be able to write out Indigenous names correctly. Examples are shown below.
I often use this website for help which allows me to copy and paste into ...
2
votes
0
answers
107
views
How can I get my Burmese text paragraph justified properly with LuaLaTex?
When I use \XeTeXlinebreaklocale "my_MM" \XeTeXinterwordspaceshaping=2 options in XeLaTex, I could get my paragraph properly justified. How can I get similar justification using LuaLaTex. I'...
- 151
2
votes
0
answers
3k
views
Inputenc Error: Invalid UTF-8 byte "FC
When compiling my code in Texmaker I get this error:
Error Package inputenc Error: Invalid UTF-8 byte "FC.
I don't know why. Can somebody help me?
\documentclass[11pt,a4paper,oneside,titlepage]{...
2
votes
0
answers
327
views
Problems with encoding of .bbl file created by BibTeX for LuaLaTeX
I am trying to use BibTeX and LuaLaTeX. However, I get the error message
File: project.bbl
String contains an invalid utf-8 sequence
for several bibliography entries that contain characters such as ...
- 195
2
votes
0
answers
75
views
Interpretation of Devanagari characters in XeTeX
\documentclass{standalone}
\usepackage{fontspec,xstring}
\setmainfont[Script=Devanagari]{Shobhika}
\begin{document}
\StrChar{abcd}{1} % Returns a
\StrChar{क्ष}{1} % Returns क, but should ...
- 2,813
2
votes
0
answers
167
views
unicode-math: Understanding the application of external fonts to math text
For the following usage of Redacted-Font, I would like to understand
why I get an error when setting \setmathfont{redacted-script-regular.ttf} instead of another math font (e.g. \setmathfont{Cambria ...
- 9,029
2
votes
0
answers
189
views
Moving luacode to Lua file, accessing glyphs by name
I have a package that includes (basically) the following code (provided by a contributor after asking this question on tex.stackoverflow).
\begin{luacode}
documentdata = documentdata or { }
...
- 1,890
2
votes
0
answers
713
views
Make words like naïve searchable via naive
very short question about the handling of umlaut and other unicode characters. Is it possible to make them searchable via their ascii-"equivalent" (e.g. a for ä)? Or can that only be done by the pdf ...
- 21
2
votes
0
answers
132
views
Turkish characters do not appear end of the word
I am preparing a latex document which should use Times New Roman font and should support Turkish characters. In the pre-toc part of document there are some kind of title pages and i had to use red, ...
- 21
2
votes
0
answers
88
views
Accented characters in a hyperlink, and problems with opening a new window
With this MWE, I have different results depending on the pdfviewer on linux box :
Evince dosen't find the link because of the é, but opens a new window on a non-accented link
Okular finds the link ...
- 16.8k
2
votes
0
answers
313
views
Missing Character; Possible to Redefine Unicode Mapping?
The font I am using lacks many spacing modifier letters and all combining diacritical marks. It does, however, have the diacritics I require, albeit non-combining, in its Private Use Area.
In my .tex ...
- 21
2
votes
0
answers
701
views
Unicode characters with XeLaTeX without changing the font
I need to write a document using a given template (with specific fonts and font sizes for title, headers, body etc.). The document is in English, but I need to type some Unicode characters (for ...
- 451
2
votes
0
answers
1k
views
Swedish letters ÅÄÖ do not show using listings package
Problem
I am using the listings package to produce HTML-code and everything works except that the letters åäö do not format in accordance to the defined colors.
Minimal Working Example
\...
- 2,743
2
votes
0
answers
121
views
EINVAL Error in Lyx
When I am typing text in the Lyx main editor window the following message keeps appearing in the Progress/Debug Message pane:
Error returned from iconv_open
EINVAL The conversion from UCS-4LE to UTF8 ...
- 723
2
votes
0
answers
426
views
Small-caps special character "ḫ"
I have been trying for some time to get the symbol "ḫ" to play nice with XeLaTeX. However, I'm now having trouble using it inside of a chapter title using the book class. Here's an MWE:
\...
- 21
2
votes
0
answers
455
views
Glyphs from font not displayed
I am trying to get Xelatex printing these glyphs from the font I'm using (it's Garamond Premier Pro):
▼ ◺ ◹
I tried both by copying and pasting them in my document and by their UTF code with:
\...
- 959
2
votes
0
answers
630
views
How to compile files with non-ASCII paths?
I cannot compile files with non-ASCII paths. I am using XeLaTeX from MikTex and TexStudio on Windows. Is it possible to read paths as utf8?
The specific path contains Chinese. If I change what ...
- 469
1
vote
0
answers
31
views
How do I get different glyphs in a font via commands?
In the ebgaramond package there are several glyphs as indicated in the pdf on ctan which gives the code for each glyph. I know commands for some of the glyphs such as \copyright \textonehalf \...
- 1,707
1
vote
1
answer
66
views
Is there any way to retrieve saved string in the beginning of document from its end in LuaLaTeX?
There are different types of “registers” in LuaTeX. With totcount package, you can save counter (number) from any place in a document and get its value also in any place in a document with the help of ...
- 133
1
vote
1
answer
60
views
listings package issues in LuaLaTeX, with coloring cyrillic comment in UTF
Coloring cyrillic comment does not work in LuaLaTeX.
How might I be able to resolve this issue?
MWE:
\documentclass{article}
\usepackage{polyglossia}
\setdefaultlanguage[spelling=modern]{russian}
\...
- 978
1
vote
0
answers
44
views
Adding a few words in Urdu, Japanese and Russian to pdflatex
I'm writing an English document that has to be compiled using pdflatex.
I'd like to add a few words in Urdu, Japanese and Russian to the document. I'm using an existing template so I'd like any ...
- 11
1
vote
0
answers
78
views
Using TexStudio with unicode - incorrect cursor position
I find myself becoming a fan of using more and more unicode as it make source files way more readable. In my favourite editor TexStudio I am facing a slight annoyance: some unicode characters are ...
- 549
1
vote
0
answers
87
views
How to create an alphabetical attachment list that supports unicode characters?
I would like to be able to create a list of attachments similar to the list of figures or tables. However, since it makes little sense to sort the attachments by page number, I would like to sort them ...
- 435
1
vote
0
answers
401
views
Cannot open Miktex: Invalid or unsupported charset:utf-8.utf-8
I've been using miktex for months without "unsolvable" problems. However, now, unexpectedly, when I open the MiKTeX Console it appears the following error message:
Invalid or unsupported ...
1
vote
0
answers
90
views
How to use non-ascii characters in hyperref's pdftitle option?
I'm trying to use non-ascii characters via hyperref's pdftitle option. I've read a similar question, but its solution isn't working for me. I'm working on Overleaf and when I download the PDF, a new ...
- 21
1
vote
0
answers
400
views
LaTeX Error: Unicode character happen with Miktex, but not with Texlive!
this error happens when I compile with Miktex on a windows machine, but works fine and without error on Texlive:
! LaTeX Error: Unicode character ف (U+0641)not set up for use with LaTeX
here is my ...
- 253
1
vote
0
answers
106
views
Lines are not wrapping on thinspace, `\,`, zero-width space (ZWSP), or other unicode space characters
Asian languages frequently do not use spaces, yet still have "words" which must be broken and wrapped at the right places. I am working with such a language, and actually want to put in a &...
- 355
1
vote
0
answers
59
views
Group Unicode indices header
I followed this post Index with an initial letter of the group
But anyone show me how to create a Unicode header like in the picture below ("Chỉ mục" (in Vietnamese) mean "Index"), ...
- 61
1
vote
0
answers
207
views
Unicode character within tikz textbox
I use the following code from this post to box-up selected inline text.
% Multiline Textbox
\usepackage{tikz}
\usetikzlibrary{calc}
\usepackage{tikzpagenodes}
\makeatletter
\newcommand{\gettikzxy}[3]{...
- 167
1
vote
0
answers
675
views
Tool from unicode to LaTeX or to generate a LaTeX code that trasform a unicode symbol to LaTeX
I am currently looking for a tool that converts unicode code to TeX/LaTeX language. Actually I have not found nothing.
There are many tools on the web that trasform the symbol from LaTeX to UNICODE ...
- 51.5k
1
vote
0
answers
290
views
latexmk fails with Invalid UTF-8 byte sequence even though I already used multiple tools to convert file to utf-8!
I would like to use latexmk in Visual Studio Code with the LaTeX plugin but I am facing some issues regarding encoding:
Package inputenc: Invalid UTF-8 byte "A4.
Package inputenc: Invalid UTF-8 ...
- 212
1
vote
0
answers
110
views
Are there any other fonts for Tamil fractions?
I'm Using TexLive2020 using the TexStudio editor in Linux. I can typeset in Tamil using Xelatex and Lualatex.I was able to typeset the Tamil fraction (LaTeX/XeTeX setup Tamil/Indic languages) as ...
- 11
1
vote
0
answers
109
views
Why does hyphenation orphan combining accents?
While testing a package I was writing to map Greek beta code to Unicode, I discovered a bug in both Babel and Polyglossia, running under either XeTeX or LuaTeX. The packages will happily insert a ...
- 42.3k
1
vote
0
answers
119
views
Unicode in PDF metadata with latex3 and an utf8 engine
In Unicode in PDF Metadata, Heiko Oberdiek proposes a way to set the PDF metadata to some unicode string while operating at the low level, without resorting to hyperref. To this aim, he ends up using ...
- 463
1
vote
0
answers
140
views
LuaTeX: Devanagari glyph order is reversed in tex's internal nodelist, how to recover the correct order while traversing glyph nodes?
Note: The problem discussed in this question might affect not just Devanagari, but also other scripts that have character (logical/typed) & glyph (presentational/typeset) order reversed/reordered ...
- 1,276
1
vote
0
answers
220
views
LuaTeX: UTF-8 character extraction, is one way more accurate and/or preferable than another
While experimenting ways to extract UTF-8 character strings from TeX boxes, I found a post from user micahl-h21 here: UTF-8 text extraction. After looking at the way glyph data is stored in the ...
- 1,276
1
vote
0
answers
73
views
Some characters have strange behaviour in listings with lualatex
The following MCE points out that some characters (for instance €, → or ←) have strange behavior (shifted on the left) in listings with lualatex (up to date TeX Live 2020). Do you know why?
\...
- 9,366