Commit graph

27 commits

Author SHA1 Message Date
Ed Page
7984d47095 feat(dictgen): Add aho-corasick support 2024-12-31 07:48:55 -06:00
Ed Page
da0e536796 feat(dictgen): Generate a naive match
After 23 minutes of compiling, I gave up.  The compiler might generate
fast `match`s but its not worth the compile time.
2024-12-30 20:55:12 -06:00
Ed Page
b6352341f9 perf(dict): Benchmark cased maps 2024-12-30 16:48:19 -06:00
Ed Page
084461743a feat(dictgen): Allow different Maps to be made 2024-12-30 16:29:20 -06:00
Ed Page
92c9aa17f4 refactor(dictgen): Make room for different maps 2024-12-30 16:26:21 -06:00
Ed Page
d4767767b2 fix(dictgen)!: Allow case-sensitive maps 2024-12-30 16:24:14 -06:00
Ed Page
534e3c5f71 perf(dictgen): Remove ascii/unicode branch from trie 2024-12-30 16:13:35 -06:00
Ed Page
e7ff9cfc01 fix(dictgen)!: Allow case-sensitive ordered maps 2024-12-30 15:39:34 -06:00
Ed Page
81d6807495 fix(dictgen): Clarify names 2024-12-30 14:57:39 -06:00
Ed Page
bd7c3df5db fix(dictgen): Align trie write/access conditions 2024-12-30 14:22:11 -06:00
Ed Page
a33352a199 fix(dictgen)!: Remove fn iter 2024-12-30 12:07:51 -06:00
Ed Page
3db1b3906e fix(dictgen)!: Generate phf for map feature
Unsure how this happened
2024-12-30 11:51:13 -06:00
Ed Page
016ae0c7c6 perf(dictgen): Move unicode check up in trie 2024-12-30 11:27:34 -06:00
Ed Page
083871447d perf(dictgen): Make lookups faster for map/table 2024-12-30 11:01:58 -06:00
Ed Page
db16cb53c5 refactor(dictgen): Pull out custom str 2024-12-30 10:56:06 -06:00
Ed Page
52822b019f fix(dictgen)!: Use a builer for easier customization 2024-12-28 21:02:19 -06:00
Ed Page
9efaabdf84 style: Make clippy happy 2024-12-02 11:33:06 -06:00
Ed Page
267121b5d6 style: Make clippy happy 2024-07-26 16:08:02 -05:00
Ed Page
b6c895ea49 chore: Update from _rust/main template 2024-04-30 11:28:23 -05:00
Ed Page
0c05b217d4 style: Make clippy happy 2023-09-01 10:20:03 -05:00
Ed Page
2b667ffe55 fix: Correctly calculate trie 2022-10-04 10:57:28 -05:00
Ed Page
4c2f2c434a feat(dict): Shared PHF support 2021-07-01 11:14:30 -05:00
Ed Page
3b43272724 refactor(dict): Separate dictgen concerns 2021-07-01 11:00:33 -05:00
Ed Page
bbbf985777 perf(dict): Switch varcon to a burst-trie
This cuts varcon lookup times in half but I still suspect slower than
phf.  Like with bsearch and unlike, the cost is consistent between hits
and misses.

At least this doesn't have the compile hit of PHF + unicase.  Maybe I
should experiment with integrating a non-const-fn variant of unicase
with PHF and give up on all of this extra complexity.
2021-06-30 21:03:57 -05:00
Ed Page
908f9d44eb refactor(dict): Be more cache concious 2021-06-30 19:56:03 -05:00
Ed Page
f176055834 refactor(dict): Make room for trie logic 2021-06-30 19:56:03 -05:00
Ed Page
a1e95bc7c0 refactor(dict): Pull out table-lookup logic
Before, only some dicts did we guarentee were pre-sorted.  Now, all are
for-sure pre-sorted.

This also gives each dict the size-check to avoid lookup.

But this is really about refactoring in prep for playing with other
lookup options, like tries.
2021-06-30 10:12:17 -05:00