Commit graph

1205 commits

Author SHA1 Message Date
Ed Page
0144f4521f
Merge pull request #294 from epage/codegen
refactor(dict): Pull out table-lookup logic
2021-06-30 08:32:15 -07:00
Ed Page
a1e95bc7c0 refactor(dict): Pull out table-lookup logic
Before, only some dicts did we guarentee were pre-sorted.  Now, all are
for-sure pre-sorted.

This also gives each dict the size-check to avoid lookup.

But this is really about refactoring in prep for playing with other
lookup options, like tries.
2021-06-30 10:12:17 -05:00
Ed Page
bfa7888f82 chore: Skip more releases 2021-06-29 15:39:28 -05:00
Ed Page
8f3f5b90ad chore: Release 2021-06-29 15:34:25 -05:00
Ed Page
9149c4765d chore: Release 2021-06-29 15:05:18 -05:00
Ed Page
effc21ed10
Merge pull request #293 from epage/parse
Detect non-identifiers to ignore
2021-06-29 15:03:56 -05:00
Ed Page
9a0d754862 docs(parser): Note new features 2021-06-29 14:43:05 -05:00
Ed Page
c83f655109 feat(parser): Ignore URLs
Fixes #288
2021-06-29 14:14:58 -05:00
Ed Page
b673b81146 fix(parser): Ensure we get full base64
We greedily matched separators, including ones that might be part of
base64.  This impacts the length calculation, so we want as much as
possible.
2021-06-29 13:55:46 -05:00
Ed Page
6915d85c0b feat(parser): Ignore emails
This skips a lot of validation for being "good enough" (comment
open/closes matching, etc).

This has a chance of incorrectly matching in languages with `@` as an
operator, like Python, but Python encourages spaces arround operators,
so hopefully this won't be a problem.
2021-06-29 13:42:27 -05:00
Ed Page
2a1e6ca0f6 feat(parser): Ignore base64
For now, we hardcoded a min length of 90 bytes to ensure to avoid
ambiguity with math operations on variables (generally people use
whitespace anyways).

Fixes #287
2021-06-29 13:25:10 -05:00
Ed Page
23b6ad5796 feat(parser): Ignore SHA-1+
Fixes #270
2021-06-29 12:20:08 -05:00
Ed Page
8566b31f7b fix(parser): Go ahead and do lower UUIDs
I need this for hash support anyways
2021-06-29 12:13:21 -05:00
Ed Page
85082cdbb1 feat(parser): Ignore UUIDs
We might be able to make this bail our earlier and not accidentally
detect the wrong thing by checking if the hex values are lowercase.  RFC
4122 says that UUIDs must be generated lowecase, while input accepts
any case.  The main issues are risk on the "input" part and the extra
annoyance of writing a custm `is_hex_digit` function.
2021-06-29 12:11:50 -05:00
Ed Page
32f5e6c682 refactor(typos)!: Bake ignores into parser
This is prep for other items to be ignored

BREAKING CHANGE: `TokenizerBuilder` no longer takes config for ignoring
tokens.  Related, we now ignore token-ignore config flags.
2021-06-29 11:41:25 -05:00
Ed Page
a46cc76bae
Merge pull request #292 from epage/unicode
perf(parser): Auto-detect unicode
2021-06-29 03:46:20 -07:00
Ed Page
ded90f2387 perf(parser): Auto-detect unicode
For smaller, ascii-only content, this seems to be taking ~30% less time
for parsing.
2021-06-29 05:28:17 -05:00
Ed Page
21231bfc4d
Merge pull request #291 from epage/parse
refactor(parser): Consolidate utf8/ascii logic
2021-06-29 03:27:39 -07:00
Ed Page
95417f3a41 refactor(parser): Consolidate utf8/ascii logic 2021-06-29 05:10:02 -05:00
Ed Page
3e5787c0e2 chore: Release 2021-06-28 14:56:13 -05:00
Ed Page
6ff1f15f56 docs: Update changelog 2021-06-28 14:53:43 -05:00
Ed Page
8382d3c9ae
Merge pull request #290 from epage/codegen
fix(ci): Don't fail codegen checks
2021-06-28 12:31:24 -07:00
Ed Page
83b2804623 fix(ci): Don't fail codegen checks 2021-06-28 14:06:47 -05:00
Ed Page
4066d21790 style: Address clippy 2021-06-28 13:51:06 -05:00
Ed Page
e01a34ad08
Merge pull request #289 from scop/feat/pre-commit-py
feat(pre-commit): add binary based install
2021-06-28 11:09:14 -07:00
Ville Skyttä
ef76d20c6a fix(pre-commit): Update version in setup.py with release 2021-06-28 20:54:48 +03:00
Ville Skyttä
867ee75b02 feat(pre-commit): Add binary based install
For no additional build dependencies (besides Python >= 3.6), and faster
install.

The setup.py here is a copy of the one at
https://github.com/shellcheck-py/shellcheck-py with changes kept at the
bare minimum for future diffability.

We don't support checksumming at least yet, because there's no access to
them from cargo-release at the moment.

Closes #285
2021-06-28 19:53:51 +03:00
Ed Page
e9c800b2bf chore: Release 2021-06-15 17:32:26 -05:00
Ed Page
10497270f1
Merge pull request #286 from epage/crash
fix(cli): Don't crash on races
2021-06-15 17:31:59 -05:00
Ed Page
655b6571bd fix(cli): Don't crash on races
I misused `compare_exchange` when I didn't even really need it.

Fixes #284
2021-06-15 16:50:12 -05:00
Ed Page
5304d94fb7 chore: Release 2021-06-15 10:53:20 -05:00
Ed Page
c1096917a6 chore: Release 2021-06-15 10:52:49 -05:00
Ed Page
992a6cebbf docs: Update release notes 2021-06-15 10:52:49 -05:00
Ed Page
0be066fb06
Merge pull request #282 from scop/feat/pre-commit-integration
feat: Add pre-commit integration
2021-06-09 11:23:27 -05:00
Ville Skyttä
cd35ac231f feat: Update pre-commit.md with pre-release-replacements 2021-06-09 18:01:00 +03:00
Ville Skyttä
9739865559 feat: Add pre-commit integration 2021-06-08 23:07:54 +03:00
Ed Page
b329b17e96
Merge pull request #281 from brianteeman/patch-1
Typo
2021-06-08 06:28:26 -05:00
Brian Teeman
4caddb6a80
Typo
The irony of a typo in typos is not missing
2021-06-08 08:35:08 +01:00
Ed Page
1612e077ac
Merge pull request #280 from epage/bsearch
chore: Reduce code-gen memory usage
2021-06-07 09:21:57 -05:00
Ed Page
3a4d039c4f chore: Reduce code-gen memory usage
More `const fn` removals to reduce compilation memory use
2021-06-07 08:58:34 -05:00
Ed Page
a861cbfb1f chore: Release 2021-06-07 08:04:04 -05:00
Ed Page
083020270c
Merge pull request #279 from epage/fix
fix(cli): Don't panic
2021-06-07 08:03:32 -05:00
Ed Page
20f4e5de75 fix(cli): Don't panic
Fixes #277
2021-06-07 07:44:21 -05:00
Ed Page
04f5d40e57 chore: Release 2021-06-05 14:39:37 -05:00
Ed Page
3a952cba8f chore: Release 2021-06-05 14:37:25 -05:00
Ed Page
3462a239f9 docs: Update changelog 2021-06-05 14:37:14 -05:00
Ed Page
78787b1768
Merge pull request #276 from epage/action
fix(action): Be stricter/cleaner with entrypoint
2021-06-05 14:34:50 -05:00
Ed Page
60fe94c292 fix(cli): Ensure we can run on files 2021-06-05 13:52:44 -05:00
Ed Page
6e8f7cf9d3 test(action): Update test case for typos 2021-06-05 13:52:44 -05:00
Ed Page
39d9a90c9b fix(action): Be stricter/cleaner with entrypoint 2021-06-05 12:22:24 -05:00