annotate README.unicode @ 89176:729d852f7419

(re_search_2): Fix for the case of unibyte buffer.
author Kenichi Handa <handa@m17n.org>
date Mon, 07 Oct 2002 12:58:29 +0000
parents 52c1682e6353
children 9693e41cc2fd
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
1 -*-text-*-
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
2
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
3 Problems, fixmes and other issues in the emacs-unicode branch
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
4 -------------------------------------------------------------
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
5
88836
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
6 Notes by fx to record various things of variable importance. handa
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
7 needs to check them -- don't take too seriously, especially with
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
8 regard to completeness.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
9
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
10 _Do take seriously that you don't want this branch unless you're
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
11 actually working on it; you risk your data by actually using it._ If
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
12 you just want to edit Unicode and/or unify iso-8859 et al, see the
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
13 existing support and the extra stuff at
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
14 <URL:ftp://dlpx1.dl.ac.uk/fx/emacs/Mule>, mostly now in the CVS trunk.
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
15 (Editing support is mostly orthogonal to the internal representation.)
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
16
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
17 * SINGLE_BYTE_CHAR_P returns true for Latin-1 characters, which has
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
18 undesirable effects.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
19
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
20 * Rationalize character syntax and its relationship to the Unicode
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
21 database. Specifically, the latin-N.el files aren't consistent for
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
22 common characters (and obviously have redundancies except in
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
23 unibyte mode).
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
24
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
25 * Fontset handling and customization needs work. We want to relate
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
26 fonts to scripts, probably based on the Unicode blocks. The
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
27 presence of small-repertoire 10646-encoded fonts in XFree 4 is a
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
28 pain, not currently worked round.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
29
88979
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
30 With the change on 2002-07-26, multiple fonts can be
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
31 specified in a fontset for a specific range of characters.
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
32 Each range can also be specified by script. Before using
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
33 ISO10646 fonts, Emacs checks their repertories to avoid such
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
34 fonts that don't have a glyph for a specific character.
88891
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
35
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
36 * Work is also needed on charset and coding system priorities.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
37
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
38 * The relevant bits of latin1-disp.el need porting (and probably
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
39 re-naming/updating). See also cyril-util.el.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
40
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
41 * Quail files need more work now the encoding is irrelevant.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
42
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
43 * What to do with the old coding categories stuff?
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
44
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
45 * Syntax for symbols &c in characters.el needs looking at.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
46
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
47 * The preferred-coding-system property of charsets should probably be
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
48 junked unless it can be made more useful now.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
49
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
50 * find-coding-systems-for-charsets needs re-writing or removing.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
51
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
52 * find-multibyte-characters needs looking at.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
53
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
54 * Implement Korean cp949/UHC and any other important missing
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
55 charsets.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
56
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
57 * Check up on definitions of tcvn and alternativnj.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
58
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
59 * Lazy-load tables for unify-charset somehow?
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
60
88979
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
61 Actually, Emacs clear out all charset maps and unify-map just
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
62 before dumping, and their are loaded again on demand the
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
63 dumped emacs. But, those maps (char tables) generated while
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
64 temacs is running can't be get rid of from the dumped emacs.
52c1682e6353 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88891
diff changeset
65
88836
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
66 * Translation tables for {en,de}code currently aren't supported.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
67
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
68 * Defining CCL coding systems currently doesn't work.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
69
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
70 * iso-2022 charsets get unified on i/o.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
71
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
72 * Revisit locale processing: look at treating the language and
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
73 charset parts separately. (Language should affect things like
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
74 speling and calendar, but that's not a Unicode issue.)
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
75
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
76 * Handle Unicode combining characters usefully, e.g. diacritics, and
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
77 handle more scripts specifically (à la Devanagari). There are
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
78 issues with canonicalization.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
79
88836
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
80 * Bidi is a separate issue with no support currently.
88740
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
81
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
82 * DTRT with X keysyms. We should get the right unicode for a given
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
83 keysym, not decode raw bytes in some ill-defined coding system.
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
84 (fx has some data on keysyms v. unicodes.)
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
85
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
86 * We need tabular input methods, e.g. for maths symbols. (Not
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
87 specific to Unicode.)
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
88
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
89 * Need multibyte text in menus, e.g. for the above. (Not specific to
62f922836c9b *** empty log message ***
Dave Love <fx@gnu.org>
parents:
diff changeset
90 Unicode.)
88836
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
91
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
92 * Still can't have case pairs which have different byte lengths --
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
93 can that be fixed for Turkish, at least?
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
94
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
95 * There's currently no support for Unicode normalization.
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
96
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
97 * Populate char-width-table correctly for Unicode chanaracters and
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
98 worry about what happens when double-width charsets covering
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
99 non-CJK characters are unified.
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
100
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
101 * Emacs 20/21 .elc files are currently not loadable. It may or may
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
102 not be possible to do this properly.
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
103
88891
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
104 With the change on 2002-07-24, elc files generated by Emacs
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
105 20.3 and later are correctly loaded (including those
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
106 containing multibyte characters and compressed). But, elc
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
107 files generated by 20.2 and the primer are still not loadable.
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
108 Is it really worth working on it?
1c1bc8902236 *** empty log message ***
Kenichi Handa <handa@m17n.org>
parents: 88884
diff changeset
109
88884
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
110 * Encoding issues in babyl files/rmail need sorting out.
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
111
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
112 * Gnus still needs some attention, and we need to get changes
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
113 accepted by Gnus maintainers...
9d76d33fbcff *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88836
diff changeset
114
88836
b53799fa4747 *** empty log message ***
Dave Love <fx@gnu.org>
parents: 88763
diff changeset
115 * You can grep the code for lots of fixmes.