Ed Page
f176055834
refactor(dict): Make room for trie logic
2021-06-30 19:56:03 -05:00
Ed Page
0e6d683ebe
test(dict): Bench more varcon cases
2021-06-30 19:56:00 -05:00
Ed Page
0144f4521f
Merge pull request #294 from epage/codegen
...
refactor(dict): Pull out table-lookup logic
2021-06-30 08:32:15 -07:00
Ed Page
a1e95bc7c0
refactor(dict): Pull out table-lookup logic
...
Before, only some dicts did we guarentee were pre-sorted. Now, all are
for-sure pre-sorted.
This also gives each dict the size-check to avoid lookup.
But this is really about refactoring in prep for playing with other
lookup options, like tries.
2021-06-30 10:12:17 -05:00
Ed Page
bfa7888f82
chore: Skip more releases
2021-06-29 15:39:28 -05:00
Ed Page
8f3f5b90ad
chore: Release
2021-06-29 15:34:25 -05:00
Ed Page
9149c4765d
chore: Release
2021-06-29 15:05:18 -05:00
Ed Page
effc21ed10
Merge pull request #293 from epage/parse
...
Detect non-identifiers to ignore
2021-06-29 15:03:56 -05:00
Ed Page
9a0d754862
docs(parser): Note new features
2021-06-29 14:43:05 -05:00
Ed Page
c83f655109
feat(parser): Ignore URLs
...
Fixes #288
2021-06-29 14:14:58 -05:00
Ed Page
b673b81146
fix(parser): Ensure we get full base64
...
We greedily matched separators, including ones that might be part of
base64. This impacts the length calculation, so we want as much as
possible.
2021-06-29 13:55:46 -05:00
Ed Page
6915d85c0b
feat(parser): Ignore emails
...
This skips a lot of validation for being "good enough" (comment
open/closes matching, etc).
This has a chance of incorrectly matching in languages with `@` as an
operator, like Python, but Python encourages spaces arround operators,
so hopefully this won't be a problem.
2021-06-29 13:42:27 -05:00
Ed Page
2a1e6ca0f6
feat(parser): Ignore base64
...
For now, we hardcoded a min length of 90 bytes to ensure to avoid
ambiguity with math operations on variables (generally people use
whitespace anyways).
Fixes #287
2021-06-29 13:25:10 -05:00
Ed Page
23b6ad5796
feat(parser): Ignore SHA-1+
...
Fixes #270
2021-06-29 12:20:08 -05:00
Ed Page
8566b31f7b
fix(parser): Go ahead and do lower UUIDs
...
I need this for hash support anyways
2021-06-29 12:13:21 -05:00
Ed Page
85082cdbb1
feat(parser): Ignore UUIDs
...
We might be able to make this bail our earlier and not accidentally
detect the wrong thing by checking if the hex values are lowercase. RFC
4122 says that UUIDs must be generated lowecase, while input accepts
any case. The main issues are risk on the "input" part and the extra
annoyance of writing a custm `is_hex_digit` function.
2021-06-29 12:11:50 -05:00
Ed Page
32f5e6c682
refactor(typos)!: Bake ignores into parser
...
This is prep for other items to be ignored
BREAKING CHANGE: `TokenizerBuilder` no longer takes config for ignoring
tokens. Related, we now ignore token-ignore config flags.
2021-06-29 11:41:25 -05:00
Ed Page
a46cc76bae
Merge pull request #292 from epage/unicode
...
perf(parser): Auto-detect unicode
2021-06-29 03:46:20 -07:00
Ed Page
ded90f2387
perf(parser): Auto-detect unicode
...
For smaller, ascii-only content, this seems to be taking ~30% less time
for parsing.
2021-06-29 05:28:17 -05:00
Ed Page
21231bfc4d
Merge pull request #291 from epage/parse
...
refactor(parser): Consolidate utf8/ascii logic
2021-06-29 03:27:39 -07:00
Ed Page
95417f3a41
refactor(parser): Consolidate utf8/ascii logic
2021-06-29 05:10:02 -05:00
Ed Page
3e5787c0e2
chore: Release
2021-06-28 14:56:13 -05:00
Ed Page
6ff1f15f56
docs: Update changelog
2021-06-28 14:53:43 -05:00
Ed Page
8382d3c9ae
Merge pull request #290 from epage/codegen
...
fix(ci): Don't fail codegen checks
2021-06-28 12:31:24 -07:00
Ed Page
83b2804623
fix(ci): Don't fail codegen checks
2021-06-28 14:06:47 -05:00
Ed Page
4066d21790
style: Address clippy
2021-06-28 13:51:06 -05:00
Ed Page
e01a34ad08
Merge pull request #289 from scop/feat/pre-commit-py
...
feat(pre-commit): add binary based install
2021-06-28 11:09:14 -07:00
Ville Skyttä
ef76d20c6a
fix(pre-commit): Update version in setup.py with release
2021-06-28 20:54:48 +03:00
Ville Skyttä
867ee75b02
feat(pre-commit): Add binary based install
...
For no additional build dependencies (besides Python >= 3.6), and faster
install.
The setup.py here is a copy of the one at
https://github.com/shellcheck-py/shellcheck-py with changes kept at the
bare minimum for future diffability.
We don't support checksumming at least yet, because there's no access to
them from cargo-release at the moment.
Closes #285
2021-06-28 19:53:51 +03:00
Ed Page
e9c800b2bf
chore: Release
2021-06-15 17:32:26 -05:00
Ed Page
10497270f1
Merge pull request #286 from epage/crash
...
fix(cli): Don't crash on races
2021-06-15 17:31:59 -05:00
Ed Page
655b6571bd
fix(cli): Don't crash on races
...
I misused `compare_exchange` when I didn't even really need it.
Fixes #284
2021-06-15 16:50:12 -05:00
Ed Page
5304d94fb7
chore: Release
2021-06-15 10:53:20 -05:00
Ed Page
c1096917a6
chore: Release
2021-06-15 10:52:49 -05:00
Ed Page
992a6cebbf
docs: Update release notes
2021-06-15 10:52:49 -05:00
Ed Page
0be066fb06
Merge pull request #282 from scop/feat/pre-commit-integration
...
feat: Add pre-commit integration
2021-06-09 11:23:27 -05:00
Ville Skyttä
cd35ac231f
feat: Update pre-commit.md with pre-release-replacements
2021-06-09 18:01:00 +03:00
Ville Skyttä
9739865559
feat: Add pre-commit integration
2021-06-08 23:07:54 +03:00
Ed Page
b329b17e96
Merge pull request #281 from brianteeman/patch-1
...
Typo
2021-06-08 06:28:26 -05:00
Brian Teeman
4caddb6a80
Typo
...
The irony of a typo in typos is not missing
2021-06-08 08:35:08 +01:00
Ed Page
1612e077ac
Merge pull request #280 from epage/bsearch
...
chore: Reduce code-gen memory usage
2021-06-07 09:21:57 -05:00
Ed Page
3a4d039c4f
chore: Reduce code-gen memory usage
...
More `const fn` removals to reduce compilation memory use
2021-06-07 08:58:34 -05:00
Ed Page
a861cbfb1f
chore: Release
2021-06-07 08:04:04 -05:00
Ed Page
083020270c
Merge pull request #279 from epage/fix
...
fix(cli): Don't panic
2021-06-07 08:03:32 -05:00
Ed Page
20f4e5de75
fix(cli): Don't panic
...
Fixes #277
2021-06-07 07:44:21 -05:00
Ed Page
04f5d40e57
chore: Release
2021-06-05 14:39:37 -05:00
Ed Page
3a952cba8f
chore: Release
2021-06-05 14:37:25 -05:00
Ed Page
3462a239f9
docs: Update changelog
2021-06-05 14:37:14 -05:00
Ed Page
78787b1768
Merge pull request #276 from epage/action
...
fix(action): Be stricter/cleaner with entrypoint
2021-06-05 14:34:50 -05:00
Ed Page
60fe94c292
fix(cli): Ensure we can run on files
2021-06-05 13:52:44 -05:00