annotate README.unicode @ 90402:69ac9cbd4be5

(Vscript_representative_chars): Extern it.
author Kenichi Handa <handa@m17n.org>
date Tue, 06 Jun 2006 03:47:49 +0000
parents d6008ecc47e5
children 4c7d4b278599
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
1 -*-mode: text; coding: latin-1;-*-
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
2
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
3 Problems, fixmes and other issues in the emacs-unicode branch
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
4 -------------------------------------------------------------
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
5
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
6 Notes by fx to record various things of variable importance. handa
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
7 needs to check them -- don't take too seriously, especially with
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
8 regard to completeness.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
9
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
10 _Do take seriously that you don't want this branch unless you're
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
11 actually working on it; you risk your data by actually using it._ If
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
12 you just want to edit Unicode and/or unify iso-8859 et al, see the
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
13 existing support and the extra stuff at
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
14 <URL:ftp://dlpx1.dl.ac.uk/fx/emacs/Mule>, mostly now in the CVS trunk.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
15 (Editing support is mostly orthogonal to the internal representation.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
16
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
17 * SINGLE_BYTE_CHAR_P returns true for Latin-1 characters, which has
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
18 undesirable effects. E.g.:
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
19 (multibyte-string-p (let ((s "x")) (aset s 0 ?£) s)) => nil
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
20 (multibyte-string-p (concat [?£])) => nil
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
21 (text-char-description ?£) => "M-#"
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
22
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
23 These examples are all fixed by the change of 2002-10-14, but
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
24 there still exist questionalble SINGLE_BYTE_CHAR_P in the
89837
d6008ecc47e5 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 89540
diff changeset
25 code (keymap.c and print.c).
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
26
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
27 * Rationalize character syntax and its relationship to the Unicode
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
28 database. (Applies mainly to symbol an punctuation syntax.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
29
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
30 * Fontset handling and customization needs work. We want to relate
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
31 fonts to scripts, probably based on the Unicode blocks. The
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
32 presence of small-repertoire 10646-encoded fonts in XFree 4 is a
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
33 pain, not currently worked round.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
34
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
35 With the change on 2002-07-26, multiple fonts can be
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
36 specified in a fontset for a specific range of characters.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
37 Each range can also be specified by script. Before using
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
38 ISO10646 fonts, Emacs checks their repertories to avoid such
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
39 fonts that don't have a glyph for a specific character.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
40
89525
1b757cdb6144 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 89503
diff changeset
41 fx has worked on fontset customization, but was stymied by
1b757cdb6144 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 89503
diff changeset
42 basic problems with the way the default face is dealt with
1b757cdb6144 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 89503
diff changeset
43 (and something else, I think). This needs revisiting.
1b757cdb6144 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 89503
diff changeset
44
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
45 * Work is also needed on charset and coding system priorities.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
46
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
47 * The relevant bits of latin1-disp.el need porting (and probably
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
48 re-naming/updating). See also cyril-util.el.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
49
89525
1b757cdb6144 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 89503
diff changeset
50 * Quail files need more work now the encoding is largely irrelevant.
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
51
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
52 * What to do with the old coding categories stuff?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
53
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
54 * The preferred-coding-system property of charsets should probably be
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
55 junked unless it can be made more useful now.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
56
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
57 * find-multibyte-characters needs looking at.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
58
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
59 * Implement Korean cp949/UHC, BIG5-HKSCS and any other important missing
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
60 charsets.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
61
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
62 * Lazy-load tables for unify-charset somehow?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
63
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
64 Actually, Emacs clear out all charset maps and unify-map just
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
65 before dumping, and their are loaded again on demand the
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
66 dumped emacs. But, those maps (char tables) generated while
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
67 temacs is running can't be get rid of from the dumped emacs.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
68
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
69 * Translation tables for {en,de}code currently aren't supported.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
70
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
71 This should be fixed by the changes of 2002-10-14.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
72
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
73 * Defining CCL coding systems currently doesn't work.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
74
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
75 This should be fixed by the changes of 2003-01-30.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
76
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
77 * iso-2022 charsets get unified on i/o.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
78
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
79 With the change on 2003-01-06, decoding routines put `charset'
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
80 property to decoded text, and iso-2022 encoder pay attention
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
81 to it. Thus, for instance, reading and writing by
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
82 iso-2022-7bit preserve the original designation sequences.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
83 The property name `preferred-charset' may be better?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
84
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
85 We may have to utilize this property to decide a font.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
86
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
87 * Revisit locale processing: look at treating the language and
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
88 charset parts separately. (Language should affect things like
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
89 speling and calendar, but that's not a Unicode issue.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
90
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
91 * Handle Unicode combining characters usefully, e.g. diacritics, and
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
92 handle more scripts specifically (à la Devanagari). There are
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
93 issues with canonicalization.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
94
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
95 * Bidi is a separate issue with no support currently.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
96
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
97 * We need tabular input methods, e.g. for maths symbols. (Not
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
98 specific to Unicode.)
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
99
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
100 * Need multibyte text in menus, e.g. for the above. (Not specific to
89525
1b757cdb6144 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 89503
diff changeset
101 Unicode -- see Emacs etc/TODO, but now mostly works with gtk.)
89496
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
102
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
103 * There's currently no support for Unicode normalization.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
104
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
105 * Populate char-width-table correctly for Unicode chanaracters and
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
106 worry about what happens when double-width charsets covering
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
107 non-CJK characters are unified.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
108
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
109 * Emacs 20/21 .elc files are currently not loadable. It may or may
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
110 not be possible to do this properly.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
111
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
112 With the change on 2002-07-24, elc files generated by Emacs
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
113 20.3 and later are correctly loaded (including those
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
114 containing multibyte characters and compressed). But, elc
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
115 files generated by 20.2 and the primer are still not loadable.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
116 Is it really worth working on it?
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
117
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
118 * Rmail won't work with non-ASCII text. Encoding issues for Babyl
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
119 files need sorting out, but rms says Babyl will go before this is
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
120 released.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
121
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
122 * Gnus still needs some attention, and we need to get changes
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
123 accepted by Gnus maintainers...
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
124
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
125 * There are type errors lurking, e.g. in
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
126 Fcheck_coding_systems_region. Define ENABLE_CHECKING to find them.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
127
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
128 * You can grep the code for lots of fixmes.
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
129
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
130 * Old auto-save files, and similar files, such as Gnus drafts,
efdf5369988e *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents:
diff changeset
131 containing non-ASCII characters probably won't be re-read correctly.