| Commit message (Collapse) | Author | Files | Lines |
|---|
|
Removes compression support
|
|
The comments in WordBreak and SentenceBreak tests get really long, the
provided buffer would be inadequate. So this just provides a sub-
iterator which will strip comments and comment lines, while keeping an
eye on line numbers for any debugging.
|
|
These turned up an excessive amount of allocations in CanonData and
CompatData, which have been reduced to two through the somewhat
squirrely use of 'magic numbers'.
There are now allocation tests for every allocated structure in the
library, and they run to completion in a reasonable amount of time.
So, that's nice.
|
|
This harmonizes the allocating modules in a couple of ways. All can
now be constructed by pointer, and all treat various miscellaneous
read failures as `unreachable`, which indeed they should be.
The README has been updated to inform users of this option.
|
|
These get different names, but don't otherwise change.
|
|
CaseFolding now has the FoldData, and can be initialized with a copy
of Normalize if wanted.
|
|
|
|
After a considerable slog, all tests are reachable from the test step,
and pass. Almost every failure was related to the change away from the
inclusion of an allocator on this or that.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Michael Chaten
Sam Atman
Jose Colon Rodriguez