annotate README.unicode @ 89503:684f87e17d28

*** empty log message ***
author Kenichi Handa <handa@m17n.org>
date Thu, 11 Sep 2003 23:06:03 +0000
parents efdf5369988e
children 1b757cdb6144
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
1 -*-mode: text; coding: latin-1;-*-
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
2
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
3 Problems, fixmes and other issues in the emacs-unicode branch
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
4 -------------------------------------------------------------
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
5
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
6 Notes by fx to record various things of variable importance. handa
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
7 needs to check them -- don't take too seriously, especially with
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
8 regard to completeness.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
9
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
10 _Do take seriously that you don't want this branch unless you're
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
11 actually working on it; you risk your data by actually using it._ If
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
12 you just want to edit Unicode and/or unify iso-8859 et al, see the
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
13 existing support and the extra stuff at
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
14 <URL:ftp://dlpx1.dl.ac.uk/fx/emacs/Mule>, mostly now in the CVS trunk.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
15 (Editing support is mostly orthogonal to the internal representation.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
16
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
17 * SINGLE_BYTE_CHAR_P returns true for Latin-1 characters, which has
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
18 undesirable effects. E.g.:
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
19 (multibyte-string-p (let ((s "x")) (aset s 0 ?£) s)) => nil
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
20 (multibyte-string-p (concat [?£])) => nil
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
21 (text-char-description ?£) => "M-#"
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
22
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
23 These examples are all fixed by the change of 2002-10-14, but
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
24 there still exist questionalble SINGLE_BYTE_CHAR_P in the
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
25 code.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
26
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
27 * Rationalize character syntax and its relationship to the Unicode
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
28 database. (Applies mainly to symbol an punctuation syntax.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
29
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
30 * Fontset handling and customization needs work. We want to relate
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
31 fonts to scripts, probably based on the Unicode blocks. The
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
32 presence of small-repertoire 10646-encoded fonts in XFree 4 is a
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
33 pain, not currently worked round.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
34
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
35 With the change on 2002-07-26, multiple fonts can be
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
36 specified in a fontset for a specific range of characters.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
37 Each range can also be specified by script. Before using
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
38 ISO10646 fonts, Emacs checks their repertories to avoid such
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
39 fonts that don't have a glyph for a specific character.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
40
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
41 * Work is also needed on charset and coding system priorities.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
42
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
43 * The relevant bits of latin1-disp.el need porting (and probably
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
44 re-naming/updating). See also cyril-util.el.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
45
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
46 * Quail files need more work now the encoding is irrelevant.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
47
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
48 * What to do with the old coding categories stuff?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
49
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
50 * The preferred-coding-system property of charsets should probably be
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
51 junked unless it can be made more useful now.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
52
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
53 * find-multibyte-characters needs looking at.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
54
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
55 * Implement Korean cp949/UHC, BIG5-HKSCS and any other important missing
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
56 charsets.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
57
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
58 * Check up on definition of alternativnj.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
59
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
60 * Lazy-load tables for unify-charset somehow?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
61
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
62 Actually, Emacs clear out all charset maps and unify-map just
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
63 before dumping, and their are loaded again on demand the
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
64 dumped emacs. But, those maps (char tables) generated while
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
65 temacs is running can't be get rid of from the dumped emacs.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
66
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
67 * Translation tables for {en,de}code currently aren't supported.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
68
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
69 This should be fixed by the changes of 2002-10-14.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
70
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
71 * Defining CCL coding systems currently doesn't work.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
72
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
73 This should be fixed by the changes of 2003-01-30.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
74
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
75 * iso-2022 charsets get unified on i/o.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
76
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
77 With the change on 2003-01-06, decoding routines put `charset'
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
78 property to decoded text, and iso-2022 encoder pay attention
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
79 to it. Thus, for instance, reading and writing by
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
80 iso-2022-7bit preserve the original designation sequences.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
81 The property name `preferred-charset' may be better?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
82
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
83 We may have to utilize this property to decide a font.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
84
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
85 * Revisit locale processing: look at treating the language and
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
86 charset parts separately. (Language should affect things like
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
87 speling and calendar, but that's not a Unicode issue.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
88
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
89 * Handle Unicode combining characters usefully, e.g. diacritics, and
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
90 handle more scripts specifically (à la Devanagari). There are
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
91 issues with canonicalization.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
92
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
93 * Bidi is a separate issue with no support currently.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
94
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
95 * We need tabular input methods, e.g. for maths symbols. (Not
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
96 specific to Unicode.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
97
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
98 * Need multibyte text in menus, e.g. for the above. (Not specific to
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
99 Unicode.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
100
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
101 * There's currently no support for Unicode normalization.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
102
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
103 * Populate char-width-table correctly for Unicode chanaracters and
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
104 worry about what happens when double-width charsets covering
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
105 non-CJK characters are unified.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
106
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
107 * Emacs 20/21 .elc files are currently not loadable. It may or may
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
108 not be possible to do this properly.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
109
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
110 With the change on 2002-07-24, elc files generated by Emacs
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
111 20.3 and later are correctly loaded (including those
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
112 containing multibyte characters and compressed). But, elc
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
113 files generated by 20.2 and the primer are still not loadable.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
114 Is it really worth working on it?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
115
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
116 * Rmail won't work with non-ASCII text. Encoding issues for Babyl
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
117 files need sorting out, but rms says Babyl will go before this is
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
118 released.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
119
89503
684f87e17d28 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 89496
diff changeset
120 * ps-print won't work with non-ASCII text. ps-mule needs rework.
684f87e17d28 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 89496
diff changeset
121
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
122 * Gnus still needs some attention, and we need to get changes
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
123 accepted by Gnus maintainers...
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
124
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
125 * There are type errors lurking, e.g. in
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
126 Fcheck_coding_systems_region. Define ENABLE_CHECKING to find them.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
127
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
128 * You can grep the code for lots of fixmes.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
129
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
130 * Old auto-save files, and similar files, such as Gnus drafts,
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
131 containing non-ASCII characters probably won't be re-read correctly.