blob: 988e5c138dfe81484442d4471fccae3ad1ea3596 [file] [log] [blame]
Daniel Veillard01791d51998-07-24 19:24:09 +00001
Daniel Veillardad8f99d2000-01-15 14:20:03 +00002 TODO for the XML parser and stuff:
3 ==================================
Daniel Veillard01791d51998-07-24 19:24:09 +00004
Daniel Veillarde39a93d2001-04-28 14:35:02 +00005 $Id$
6
7 this tend to be outdated :-\ ...
Daniel Veillard361d8452000-04-03 19:48:13 +00008
Daniel Veillard28ae6362001-07-14 16:44:32 +00009DOCS:
10=====
11
12- use case of using XInclude to load for example a description.
13 order document + product base -(XSLT)-> quote with XIncludes
14 |
15 HTML output with description of parts <---(XSLT)--
16
Daniel Veillard75c29212000-03-14 18:33:47 +000017TODO:
18=====
19
Daniel Veillard4ec885a2001-06-17 10:31:07 +000020- fix the C code prototype to bring back doc/libxml-undocumented.txt
21 to a reasonable level
Daniel Veillardbf432752000-11-12 15:56:56 +000022- Computation of base when HTTP redirect occurs, might affect HTTP
23 interfaces.
Daniel Veillarde0854c32000-08-27 21:12:29 +000024- listing all attributes in a node.
Daniel Veillard75c29212000-03-14 18:33:47 +000025- Correct standalone checking/emitting (hard)
26 2.9 Standalone Document Declaration
Daniel Veillard75c29212000-03-14 18:33:47 +000027- Better checking of external parsed entities TAG 1234
Daniel Veillard75c29212000-03-14 18:33:47 +000028- Go through erratas and do the cleanup.
Daniel Veillarde0854c32000-08-27 21:12:29 +000029 http://www.w3.org/XML/xml-19980210-errata ... started ...
Daniel Veillardf0cc7cc2000-08-26 21:40:43 +000030- reported by Michael, update of doc node when pasting on a new document
31 There can be far more than simply the doc pointer which refers to
32 the old document, for example namespace declarations or entities
33 references can also be a nasty problem, far more than updating the
34 doc values.
Daniel Veillard46057e12000-09-24 18:49:59 +000035- jamesh suggestion: SAX like functions to save a document ie. call a
36 function to open a new element with given attributes, write character
37 data, close last element, etc
Daniel Veillarda6d8eb62000-12-27 10:46:47 +000038- htmlParseDoc has parameter encoding which is not used.
39 Function htmlCreateDocParserCtxt ignore it.
Daniel Veillardc2f4df22001-01-04 14:06:39 +000040- fix realloc() usage.
Daniel Veillard389e6b72001-01-15 19:41:13 +000041- compliance to XML-Namespace checking, see section 6 of
42 http://www.w3.org/TR/REC-xml-names/
43- Fix output of <tst val="x&#xA;y"/>
Daniel Veillardd7e4d652001-06-15 14:57:10 +000044- Implement OASIS XML Catalog support
45 http://www.oasis-open.org/committees/entity/
Daniel Veillard8cf14d52001-06-23 16:32:46 +000046- Stricten the UTF8 conformance (Martin Duerst):
47 http://www.w3.org/2001/06/utf-8-test/.
48 The bad files are in http://www.w3.org/2001/06/utf-8-wrong/.
Daniel Veillardd7e4d652001-06-15 14:57:10 +000049
Daniel Veillardad8f99d2000-01-15 14:20:03 +000050
51TODO:
52=====
53
Daniel Veillard75c29212000-03-14 18:33:47 +000054- Get OASIS testsuite to a more friendly result, check all the results
Daniel Veillard496a1cf2000-05-03 14:20:55 +000055 once stable. Current state at:
Daniel Veillard75c29212000-03-14 18:33:47 +000056 http://xmlsoft.org/conf/result.html
Daniel Veillardad8f99d2000-01-15 14:20:03 +000057
Daniel Veillard3dd82e72000-03-20 11:48:04 +000058- Optimization of tag strings allocation ?
Daniel Veillard75c29212000-03-14 18:33:47 +000059
60- maintain coherency of namespace when doing cut'n paste operations
61 => the functions are coded, but need testing
62
Daniel Veillard3dd82e72000-03-20 11:48:04 +000063- function to rebuild the ID table
64- functions to rebuild the DTD hash tables (after DTD changes).
Daniel Veillard75c29212000-03-14 18:33:47 +000065
Daniel Veillard75c29212000-03-14 18:33:47 +000066
67EXTENSIONS:
68===========
Daniel Veillard3dd82e72000-03-20 11:48:04 +000069
Daniel Veillard75c29212000-03-14 18:33:47 +000070- Tools to produce man pages from the SGML docs.
Daniel Veillardad8f99d2000-01-15 14:20:03 +000071
72- Add Xpointer recognition/API
73
74- Add Xlink recognition/API
75 => started adding an xlink.[ch] with a unified API for XML and HTML.
Daniel Veillard496a1cf2000-05-03 14:20:55 +000076 it's crap :-(
Daniel Veillardad8f99d2000-01-15 14:20:03 +000077
Daniel Veillardad8f99d2000-01-15 14:20:03 +000078- Implement XSchemas
Daniel Veillard496a1cf2000-05-03 14:20:55 +000079 => Really need to be done <grin/>
Daniel Veillardad8f99d2000-01-15 14:20:03 +000080
81- O2K parsing;
82 => this is a somewhat ugly mix of HTML and XML, adding a specific
83 routine in the comment parsing code of HTML and plug the XML
84 parsing one in-there should not be too hard. Key point is to get
85 XSL to transform all this to something decent ...
Daniel Veillard96ed5832001-06-15 22:22:04 +000086 => forget about it ?
Daniel Veillardad8f99d2000-01-15 14:20:03 +000087
Daniel Veillardad8f99d2000-01-15 14:20:03 +000088- extend the shell with:
89 - edit
90 - load/save
91 - mv (yum, yum, but it's harder because directories are ordered in
92 our case, mvup and mvdown would be required)
93
Daniel Veillardad8f99d2000-01-15 14:20:03 +000094- Add HTML validation using the XHTML DTD
95 - problem: do we want to keep and maintain the code for handling
96 DTD/System ID cache directly in libxml ?
97
98- Add a DTD cache prefilled with xhtml DTDs and entities and a program to
99 manage them -> like the /usr/bin/install-catalog from SGML
100 right place seems $datadir/xmldtds
Daniel Veillard361d8452000-04-03 19:48:13 +0000101 Maybe this is better left to user apps
Daniel Veillardad8f99d2000-01-15 14:20:03 +0000102
103- Add output to XHTML in case of HTML documents.
104
Daniel Veillarde3d88ef2000-01-24 13:55:06 +0000105
Daniel Veillardad8f99d2000-01-15 14:20:03 +0000106Done:
107=====
108
Daniel Veillard96ed5832001-06-15 22:22:04 +0000109- Implement XSLT
110 => libxslt
111
112- Finish XPath
113 => attributes addressing troubles
114 => defaulted attributes handling
115 => namespace axis ?
116 done as XSLT got debugged
117
Daniel Veillardd7e4d652001-06-15 14:57:10 +0000118- bug reported by Michael Meallin on validation problems
119 => Actually means I need to add support (and warn) for non-deterministic
120 content model.
121- Handle undefined namespaces in entity contents better ... at least
122 issue a warning
Daniel Veillard9403a042001-05-28 11:00:53 +0000123- DOM needs
124 int xmlPruneProp(xmlNodePtr node, xmlAtttrPtr attr);
125 => done it's actually xmlRemoveProp xmlUnsetProp xmlUnsetNsProp
126
Daniel Veillard1e851392000-10-15 10:02:56 +0000127- HTML: handling of Script and style data elements, need special code in
128 the parser and saving functions (handling of < > " ' ...):
129 http://www.w3.org/TR/html4/types.html#type-script
130 Attributes are no problems since entities are accepted.
Daniel Veillarde0854c32000-08-27 21:12:29 +0000131- DOM needs
132 xmlAttrPtr xmlNewDocProp(xmlDocPtr doc, const xmlChar *name, const xmlChar *value)
Daniel Veillard2f2bf412000-08-20 15:11:02 +0000133- problem when parsing hrefs with & with the HTML parser (IRC ac)
134- If the internal encoding is not UTF8 saving to a given encoding doesn't
135 work => fix to force UTF8 encoding ...
136 done, added documentation too
Daniel Veillard32bc74e2000-07-14 14:49:25 +0000137- Add an ASCII I/O encoder (asciiToUTF8 and UTF8Toascii)
138- Issue warning when using non-absolute namespaces URI.
139- the html parser should add <head> and <body> if they don't exist
140 started, not finished.
141 Done, the automatic closing is added and 3 testcases were inserted
Daniel Veillard3f6f7f62000-06-30 17:58:25 +0000142- Command to force the parser to stop parsing and ignore the rest of the file.
Daniel Veillard32bc74e2000-07-14 14:49:25 +0000143 xmlStopParser() should allow this, mostly untested
Daniel Veillardbe803962000-06-28 23:40:59 +0000144- support for HTML empty attributes like <hr noshade>
145- plugged iconv() in for support of a large set of encodings.
146- xmlSwitchToEncoding() rewrite done
Daniel Veillard496a1cf2000-05-03 14:20:55 +0000147- URI checkings (no fragments) rfc2396.txt
Daniel Veillard5d211f42000-04-07 17:00:24 +0000148- Added a clean mechanism for overload or added input methods:
149 xmlRegisterInputCallbacks()
Daniel Veillard361d8452000-04-03 19:48:13 +0000150- dynamically adapt the alloc entry point to use g_alloc()/g_free()
151 if the programmer wants it:
152 - use xmlMemSetup() to reset the routines used.
153- Check attribute normalization especially xmlGetProp()
154- Validity checking problems for NOTATIONS attributes
155- Validity checking problems for ENTITY ENTITIES attributes
156- Parsing of a well balanced chunk xmlParseBalancedChunkMemory()
157- URI module: validation, base, etc ... see uri.[ch]
158- turn tester into a generic program xmllint installed with libxml
Daniel Veillardec303412000-03-24 13:41:54 +0000159- extend validity checks to go through entities content instead of
160 just labelling them PCDATA
Daniel Veillard75c29212000-03-14 18:33:47 +0000161- Save Dtds using the children list instead of dumping the tables,
162 order is preserved as well as comments and PIs
163- Wrote a notice of changes requires to go from 1.x to 2.x
164- make sure that all SAX callbacks are disabled if a WF error is detected
165- checking/handling of newline normalization
166 http://localhost/www.xml.com/axml/target.html#sec-line-ends
167- correct checking of '&' '%' on entities content.
168- checking of PE/Nesting on entities declaration
169- checking/handling of xml:space
170 - checking done.
171 - handling done, not well tested
172- Language identification code, productions [33] to [38]
173 => done, the check has been added and report WFness errors
174- Conditional sections in DTDs [61] to [65]
175 => should this crap be really implemented ???
176 => Yep OASIS testsuite uses them
177- Allow parsed entities defined in the internal subset to override
178 the ones defined in the external subset (DtD customization).
179 => This mean that the entity content should be computed only at
180 use time, i.e. keep the orig string only at parse time and expand
181 only when referenced from the external subset :-(
182 Needed for complete use of most DTD from Eve Maler
183- Add regression tests for all WFC errors
184 => did some in test/WFC
185 => added OASIS testsuite routines
186 http://xmlsoft.org/conf/result.html
187
188- I18N: http://wap.trondheim.com/vaer/index.phtml is not XML and accepted
189 by the XML parser, UTF-8 should be checked when there is no "encoding"
190 declared !
191- Support for UTF-8 and UTF-16 encoding
192 => added some convertion routines provided by Martin Durst
193 patched them, got fixes from @@@
194 I plan to keep everything internally as UTF-8 (or ISO-Latin-X)
195 this is slightly more costly but more compact, and recent processors
196 efficiency is cache related. The key for good performances is keeping
197 the data set small, so will I.
198 => the new progressive reading routines call the detection code
199 is enabled, tested the ISO->UTF-8 stuff
Daniel Veillardad8f99d2000-01-15 14:20:03 +0000200- External entities loading:
201 - allow override by client code
202 - make sure it is alled for all external entities referenced
203 Done, client code should use xmlSetExternalEntityLoader() to set
204 the default loading routine. It will be called each time an external
205 entity entity resolution is triggered.
206- maintain ID coherency when removing/changing attributes
207 The function used to deallocate attributes now check for it being an
208 ID and removes it from the table.
209- push mode parsing i.e. non-blocking state based parser
210 done, both for XML and HTML parsers. Use xmlCreatePushParserCtxt()
211 and xmlParseChunk() and html counterparts.
212 The tester program now has a --push option to select that parser
213 front-end. Douplicated tests to use both and check results are similar.
214
215- Most of XPath, still see some troubles and occasionnal memleaks.
216- an XML shell, allowing to traverse/manipulate an XML document with
217 a shell like interface, and using XPath for the anming syntax
218 - use of readline and history added when available
219 - the shell interface has been cleanly separated and moved to debugXML.c
220- HTML parser, should be fairly stable now
221- API to search the lang of an attribute
222- Collect IDs at parsing and maintain a table.
223 PBM: maintain the table coherency
224 PBM: how to detect ID types in absence of DtD !
225- Use it for XPath ID support
226- Add validity checking
227 Should be finished now !
228- Add regression tests with entity substitutions
229
230- External Parsed entities, either XML or external Subset [78] and [79]
231 parsing the xmllang DtD now works, so it should be sufficient for
232 most cases !
233
234- progressive reading. The entity support is a first step toward
Daniel Veillard260a68f1998-08-13 03:39:55 +0000235 asbtraction of an input stream. A large part of the context is still
236 located on the stack, moving to a state machine and putting everyting
237 in the parsing context should provide an adequate solution.
Daniel Veillardad8f99d2000-01-15 14:20:03 +0000238 => Rather than progressive parsing, give more power to the SAX-like
239 interface. Currently the DOM-like representation is built but
240 => it should be possible to define that only as a set of SAX callbacks
241 and remove the tree creation from the parser code.
242 DONE
Daniel Veillard01791d51998-07-24 19:24:09 +0000243
Daniel Veillardad8f99d2000-01-15 14:20:03 +0000244- DOM support, instead of using a proprietary in memory
245 format for the document representation, the parser should
246 call a DOM API to actually build the resulting document.
247 Then the parser becomes independent of the in-memory
248 representation of the document. Even better using RPC's
249 the parser can actually build the document in another
250 program.
251 => Work started, now the internal representation is by default
252 very near a direct DOM implementation. The DOM glue is implemented
253 as a separate module. See the GNOME gdome module.
254
Daniel Veillard01791d51998-07-24 19:24:09 +0000255- C++ support : John Ehresman <jehresma@dsg.harvard.edu>
256- Updated code to follow more recent specs, added compatibility flag
Daniel Veillard260a68f1998-08-13 03:39:55 +0000257- Better error handling, use a dedicated, overridable error
258 handling function.
259- Support for CDATA.
260- Keep track of line numbers for better error reporting.
261- Support for PI (SAX one).
Daniel Veillardad8f99d2000-01-15 14:20:03 +0000262- Support for Comments (bad, should be in ASAP, they are parsed
263 but not stored), should be configurable.
264- Improve the support of entities on save (+SAX).
Daniel Veillard01791d51998-07-24 19:24:09 +0000265