Thibault "bui" Koechlin
0eea20fa7c
revert decision dedup behavior to 1.3.4 ( #1675 )
...
* revert decision dedup behavior to 1.3.4
2022-07-22 11:20:10 +02:00
Thibault "bui" Koechlin
bd91ddaf52
logging consistency for .local files ( #1655 )
2022-07-13 10:56:03 +02:00
blotus
7b8cd63b04
do not set the UDP read buffer size in syslog datasource ( #1657 )
2022-07-13 10:18:03 +02:00
AlteredCoder
39da36361c
Get geoip Country from other objects if not present ( #1659 )
2022-07-12 15:26:34 +02:00
Thibault "bui" Koechlin
73f336363a
bump log level when overloading config file with .local ( #1646 )
...
* bump log level
Co-authored-by: Marco Mariani <marco@crowdsec.net>
2022-07-08 09:29:23 +02:00
blotus
5c1c941851
close response body in heartbeat ( #1637 )
2022-07-06 14:50:54 +02:00
AlteredCoder
5f62d738fc
Add no-capi flag and review some logs ( #1628 )
...
* Add no-capi flag and review some logs
2022-07-01 16:56:13 +02:00
Thibault "bui" Koechlin
ca4cd6d559
attempt to fix ticker leak ( #1620 )
2022-06-30 17:36:01 +02:00
AlteredCoder
02e0f3c095
Fix event.timestamp pointer usage ( #1621 )
...
* Fix event.timestamp pointer usage
* avoid returning an error when creating alerts if something goes wrong during the parsing
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
2022-06-30 17:35:42 +02:00
blotus
863facaa33
Properly handle expired decisions with different scopes ( #1616 )
2022-06-29 16:13:04 +02:00
Thibault "bui" Koechlin
15902dcba6
fix #1615 : cleanup based on heartbeat instead ( #1617 )
2022-06-29 13:21:58 +02:00
mmetc
8e7e799304
[wip] serve metrics only after agent and/or lapi are ready; fixed some func tests ( #1613 )
2022-06-24 15:55:21 +02:00
he2ss
7fafb483ad
Pkg/database/fix count decisions since by value ( #1606 )
...
* fix CountDecisionsSinceByValue to have also expired decisions
2022-06-23 12:04:07 +02:00
AlteredCoder
a4f4eabf0a
support yml file ( #1605 )
2022-06-22 17:01:27 +02:00
mmetc
628d7be1d8
simplify err.Error() to err when used in printf context ( #1603 )
2022-06-22 15:53:53 +02:00
he2ss
3d6f015211
Add duration expr to add duration formula ( #1556 )
...
* add duration expr to add duration formula
2022-06-22 11:29:52 +02:00
Thibault "bui" Koechlin
a6ed08b239
Add alerts and decisions metrics, LAPI and agent timing prom metrics ( #1546 )
2022-06-22 11:14:34 +02:00
AlteredCoder
0a39066f9d
Fix #1552 ( #1569 )
2022-06-22 10:29:02 +02:00
mmetc
d71279f023
added flag crowdsec --warning ( #1461 )
2022-06-22 09:38:23 +02:00
mmetc
c78c833400
CI: colored test output, colored crowdsec and crowdsec-api logs, full final db dump for mysql and sqlite ( #1596 )
...
* github-ci: color unit test output and logs
* new config option: force_color_logs (useful in CI)
* bats: show sqlite/mysql dump at the end
* removed "-v" (print package names) from "go build"
* general workflow cleanup
2022-06-17 16:12:49 +02:00
mmetc
10585bfecc
enabled linters and fixes for: misspell, predeclared, unconvert, ineffassign, gosimple, govet ( #1595 )
2022-06-16 14:41:54 +02:00
Thibault "bui" Koechlin
ff72a3c1c7
avoid create a new name generator at each bucket instanciation, it's not that cheap ( #1591 )
2022-06-15 10:02:00 +02:00
blotus
9c1b78395a
reduce verbosity of TLS auth and FlushAgentsAndBouncers ( #1588 )
2022-06-13 16:08:00 +02:00
Thibault "bui" Koechlin
581ddf78fc
Performance improvements ( #1583 )
...
* fix concurrent map write on distinct cache
* cache compiled expressions for groupby and cancel_on filters
* limit objects copy when it's going to lock a shared goroutine
2022-06-13 14:41:05 +02:00
Thibault "bui" Koechlin
567e0ab7d1
fix concurrent map write on distinct cache ( #1582 )
2022-06-10 09:39:23 +02:00
Thibault "bui" Koechlin
1c0fe09576
Add support for certificate authentication for agents and bouncers ( #1428 )
2022-06-08 16:05:52 +02:00
blotus
bdda8691ff
New syslog parser for syslog datasource ( #1554 )
2022-06-08 15:16:58 +02:00
blotus
4b311684ab
Add more JSON expr helpers ( #1576 )
2022-06-08 12:15:29 +02:00
mmetc
799cc82bb5
functional tests, minor refactoring and lint/cleanup ( #1570 )
...
* cmd/crowdsec: removed log.Fatal()s, added tests and print error for unrecognized argument
* updated golangci-lint to v1.46
* lint/deadcode: fix existing issues
* tests: cscli config backup/restore
* tests: cscli completion powershell/fish
* err check: pflags MarkHidden()
* empty .dockerignore (and explain the reason)
* tests, errors.Wrap
* test for CS_LAPI_SECRET and minor refactoring
* minor style changes
* log cleanup
2022-06-06 15:24:48 +02:00
mmetc
88a4801d6a
allow run-tests with -f "<test-name>" ( #1564 )
2022-05-28 22:10:27 +02:00
he2ss
e88e9946f9
Crowdsec/decisions_stream bug fix ( #1517 )
...
* Fix bug when stream interval is greater or equal to 60s
Co-authored-by: alteredCoder <kevin@crowdsec.net>
2022-05-27 15:23:59 +02:00
mmetc
1fc9587919
fix #1283 : update and enable error reports from golangci ( #1523 )
2022-05-25 22:27:50 +02:00
mmetc
1a293a2a27
cwhub: export SetHubBranch ( #1559 )
2022-05-24 15:46:48 +02:00
mmetc
357899b83e
fixed uid/gid bound check regression ( #1555 )
2022-05-23 09:46:39 +02:00
Thibault "bui" Koechlin
0483b9c641
do not spew.Sdump() the invalid node on error. It leads to huge memory usage, especially if the parsers refers ie. datafile ( #1550 )
2022-05-20 13:29:47 +02:00
AlteredCoder
1e1741aa45
Allow to set static to a pointer and add IsIPV6 helper ( #1540 )
...
* Allow to set static to a pointer and add IsIPV6 helper
2022-05-19 16:28:25 +02:00
Thibault "bui" Koechlin
fe09737d80
Add support for machine heartbeat ( #1541 )
...
* add the last_heartbeat field
* add heartbeat controller
* add endpoint of heartbeat
* heartbeat integration
* add last_heartbeat to cscli machines list
2022-05-19 15:47:27 +02:00
mmetc
131ed1b0a7
error reporting ( #1501 )
...
* unified error reporting, removed redundancy, tests
2022-05-19 10:48:08 +02:00
Manuel Sabban
18030e6c58
add notifications command ( #1537 )
...
* add notifications command
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2022-05-18 16:13:33 +02:00
Shivam Sandbhor
220bbe5862
Document LAPI filters ( #1535 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-05-18 11:45:12 +02:00
mmetc
98f2ac5e7c
fix #1385 : .yaml.local ( #1497 )
...
Added support for .yaml.local files to override values in .yaml
2022-05-18 10:08:37 +02:00
blotus
39f7e38444
retry to send alert to plugin channel if it fails ( #1530 )
2022-05-17 16:57:15 +02:00
Thibault "bui" Koechlin
fbcb2ed7fd
Improve distinct/uniq behaviour ( #1478 )
...
* make uniq/distinct use a cache that is independant of the bucket's cache_size
* add testing specifically for cache_size
2022-05-17 12:45:53 +02:00
blotus
0449ec1868
Windows Support ( #1159 )
2022-05-17 12:14:59 +02:00
Cristian Nitescu
a49b023a28
GetExprEnv usage optimization ( #1515 )
...
* avoid multiples calls to GetExprEnv
* cache ExprEnv in node process
* use global expression env
* remove block profile rate
2022-05-17 10:50:37 +02:00
blotus
8f111680bf
Allow to override statics in hubtest. ( #1495 )
2022-04-29 14:24:41 +02:00
blotus
64369b5c2b
add expr XML helpers ( #1493 )
2022-04-29 13:52:23 +02:00
blotus
392708a804
Fix docker flaky test ( #1494 )
2022-04-29 12:16:49 +02:00
AlteredCoder
f22e4eb24e
Improve MySQL performance ( #1477 )
...
* Improve MySQL performance
2022-04-28 12:53:14 +02:00
AlteredCoder
be977d1cc4
Fix cwhub collections uninstall dependencies ( #1486 )
...
* Fix cwhub collections uninstall dependencies
2022-04-27 18:28:03 +02:00
AlteredCoder
a645c928d4
Fix decisions list with --no-simu flag ( #1482 )
...
* Fix decisions list with --no-simu flag
2022-04-27 11:05:40 +02:00
Greg Myers
0f4ab71f01
Fix typos in docs, comments, code ( #1483 )
2022-04-27 11:04:12 +02:00
AlteredCoder
44b11c2e5b
Fix hub items installation ( #1481 )
2022-04-26 17:37:07 +02:00
blotus
1bd8cc79c8
Kill the whole docker acquis in tests ( #1475 )
2022-04-22 16:56:22 +02:00
blotus
8909fbdb22
cleanup container state if the reader tomb dies by itself ( #1470 )
2022-04-22 10:52:44 +02:00
Thibault "bui" Koechlin
242706a475
fix journalctl deadlock on shutdown ( #1468 )
...
* avoid being locked sending termination error while the reading routine - on the chan - died
2022-04-21 14:02:25 +02:00
AlteredCoder
4273a0f243
cscli: add autocompletions for hubitems ( #1465 )
...
* Add autocompletion for hub items in cscli
2022-04-20 15:44:48 +02:00
he2ss
615895da9d
cscli: add force enroll feature ( #1430 )
...
* cscli: add force enroll feature
2022-04-20 13:34:17 +02:00
Thibault "bui" Koechlin
e6a35e8714
Improve plugins grouping (alternative to #1424 ) ( #1437 )
...
* Fix races in test (#1446 )
Co-authored-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
Co-authored-by: alteredCoder <kevin@crowdsec.net>
Co-authored-by: AlteredCoder <64792091+AlteredCoder@users.noreply.github.com>
2022-04-19 19:12:23 +02:00
AlteredCoder
526a4dbd08
Reduce the query unescape helper verbosity ( #1447 )
2022-04-19 12:31:29 +02:00
Shivam Sandbhor
8060f54f27
Cwhub testing ( #1438 )
...
* Add tests in cwhub and fix collection upgrade(#1431 )
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com
Co-authored-by: bui <thibault@crowdsec.net>
Co-authored-by: Thibault "bui" Koechlin <orixxx@gmail.com>
2022-04-19 12:07:35 +02:00
mmetc
4b9a0c4ef7
typos ( #1453 )
2022-04-19 11:25:27 +02:00
Shivam Sandbhor
4a3ec85686
Update bouncer pull in rupture mode ( #1445 )
...
* Update bouncer pull in rupture mode
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-04-15 12:24:01 +02:00
AlteredCoder
71165bcd30
Send all installed scenario to LAPI ( #1277 )
2022-04-13 17:48:29 +02:00
AlteredCoder
099469c5d2
Fix hub loader to support '.yml' files ( #1433 )
2022-04-11 16:13:20 +02:00
Shivam Sandbhor
a8089c8ddb
Add origins param in decision stream service ( #1429 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-04-07 12:40:27 +02:00
blotus
9cf2d5ab5c
handle containers with TTY in docker acquis ( #1422 )
2022-04-05 10:31:36 +02:00
Thibault "bui" Koechlin
ba7f4fcec0
make this info level ( #1409 )
...
* make this info level
2022-04-01 15:31:33 +02:00
Thibault "bui" Koechlin
d8dc01cd94
Revamp unit tests ( #1368 )
...
* Revamp unit tests
* Increase coverage
* Use go-acc to get cross packages coverage
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-03-29 14:20:26 +02:00
Håvard Moen
42ff269bc8
add back dialect to handle pgx correctly ( #1376 )
2022-03-23 09:29:22 +01:00
AlteredCoder
411baa4dcf
Improve cscli metrics units ( #1374 )
...
* Improve cscli metrics units
2022-03-21 12:13:36 +01:00
Shivam Sandbhor
c5566e92f3
Fix 1262 pgsql conflict resolve ( #1363 )
...
* Fix api for all dbs (#1310 )
* DB agnostic lapi sanitize
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
* Update ent
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
* Fix go dep mess.
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-03-17 14:12:13 +01:00
Shivam Sandbhor
023ac9e138
Add trusted IPs which have admin API access ( #1352 )
...
* Add trusted IPs which have admin API access
2022-03-16 17:28:34 +01:00
Shivam Sandbhor
42a1bc0260
Add query param to filter decisions by scenarios and origin ( #1294 )
...
* Add query param to filter decisions by scenarios
2022-03-16 14:37:42 +01:00
Shivam Sandbhor
bb30a3f966
Don't omit fields of bouncer in json ( #1354 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-03-16 09:40:34 +01:00
Thibault "bui" Koechlin
a74a41dac5
fix #1357 ( #1358 )
2022-03-16 09:40:00 +01:00
Shivam Sandbhor
76e97303a5
Deprecate pid_file config ( #1346 )
...
* Deprecate pid_file config
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
* Fix unit test
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
* Impl review suggestions.
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-03-16 09:23:49 +01:00
j-k
2cd3248431
refactor: use runtime rather than ldflags for go details ( #1302 )
2022-03-14 11:29:34 +01:00
mmetc
4e6b9597f8
fix for https://staticcheck.io/docs/checks#SA2002 ( #1334 )
2022-03-10 13:53:33 +01:00
mmetc
7c0593c659
noop code removal, typos and lint fixes ( #1329 )
2022-03-09 16:15:18 +01:00
mmetc
10ce45c054
allow notification plugins to work on freebsd and non-root functional tests ( #1253 )
...
* random uuid for all platforms
* check group writable and setgid; don't check group ownership
* allow user to run plugins without changing desired user/group (set them to "")
2022-03-09 12:09:50 +01:00
Thibault "bui" Koechlin
5a15f9b39b
bailout on incompatible duration format ( #1326 )
2022-03-08 18:18:36 +01:00
mmetc
e35efc5b2d
fix check uid, gid values ( #1309 )
2022-03-07 10:16:34 +01:00
Thibault "bui" Koechlin
b66366c28c
Revert "Handle decisions with varying expiry for same IP ( #1262 )" ( #1308 )
...
This reverts commit e4f6cdfc14
2022-03-04 10:17:31 +01:00
mmetc
c5dda0ffba
fix: deny copy folder to itself or subpath ( #1299 )
2022-03-02 11:30:04 +01:00
Shivam Sandbhor
c3dbe0080c
Exit syslog acquis only after server is dead ( #1288 )
2022-03-01 11:32:28 +01:00
blotus
fb74b2fda7
Improve LAPI performance when under high load ( #1273 )
2022-02-17 17:52:04 +01:00
Shivam Sandbhor
e4f6cdfc14
Handle decisions with varying expiry for same IP ( #1262 )
...
* Upgrade ent and add sql/modifier in codegen
* update db wrappers to sanitize LAPI
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-02-16 15:19:14 +01:00
mmetc
9bc7e6ffcf
Refactor unit tests to reduce line count ( #1264 )
2022-02-15 12:50:33 +01:00
Shivam Sandbhor
43d5690432
Detect missing plugin binary wrt profiles ( #1252 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-02-14 17:45:03 +01:00
AlteredCoder
8b90f4b2b2
Upgrade download datafiles if doesn't exist ( #1254 )
2022-02-14 16:51:06 +01:00
AlteredCoder
5a0843852a
add IpToRange helpers and allows to have an expression with scope Range ( #1260 )
...
* add IpToRange helpers and allows to have an expression with scope Range
2022-02-14 16:50:52 +01:00
mmetc
40ab8fa738
Atoi() -> ParseInt() ( #1256 )
2022-02-14 14:00:42 +01:00
Shivam Sandbhor
76e3612088
Check log level before dumping resp ( #1243 )
...
* Check log level before dumping resp
* Sleep longer in func tests
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-02-08 15:40:01 +01:00
mmetc
5c7c12c62d
define cwversion.System (Platform) in "make static" too; show it with --version ( #1238 )
2022-02-04 13:02:45 +01:00
Thibault "bui" Koechlin
dd53d19777
Make whitelist by expr debug level ( #1236 )
...
* fix #616 : simply make it at debug level, so that the user can set his node to debug level if he really wants to see this. Otherwise it can be too spammy
2022-02-03 17:04:18 +01:00
mmetc
ad28a979e9
local control flow cleanup ( #1215 )
...
removed redundant/unreachable returns, else branches, type declarations, unused variables
2022-02-01 22:08:06 +01:00
mmetc
35eea39db7
allow Makefile to override /etc/crowdsec and /var/lib/crowdsec/data ( #1221 )
2022-02-01 10:34:53 +01:00
mmetc
8310c10ce3
console_config.yaml -> console.yaml ( #1195 )
2022-01-21 11:52:23 +01:00
mmetc
240e5ad3ab
remove trailing carriage return ( #1194 )
2022-01-21 11:35:21 +01:00
blotus
19323ba4aa
fix crash on upgrade with nil last push field ( #1191 )
2022-01-20 18:10:40 +01:00
AlteredCoder
b93b8d9a2e
Support PGX ( #1186 )
...
* Support PGX
* support sslmode
2022-01-20 11:17:21 +01:00
Shivam Sandbhor
59a537514f
Check for errors before modifying proc attrs ( #1181 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-01-19 15:34:09 +01:00
Thibault "bui" Koechlin
cc1ab8c50d
switch to utc time everywhere ( #1167 )
...
* switch to utc time everywhere
Co-authored-by: alteredCoder <kevin@crowdsec.net>
2022-01-19 14:56:05 +01:00
AlteredCoder
b1a7ffb92f
fix postgreSQL count fail ( #1184 )
2022-01-19 14:50:53 +01:00
Thibault "bui" Koechlin
c81fc87d4e
fix #1168 ( #1179 )
...
* fix #1168
2022-01-19 11:34:40 +01:00
Thibault "bui" Koechlin
a88848009a
fix default perms for log file ( #1177 )
...
* fix default perms
2022-01-18 16:54:02 +01:00
Thibault "bui" Koechlin
a17f150e5d
fix #1170 : display full message in debug mode when syslog cannot parse ( #1176 )
...
* fix #1170 : display full message in debug mode when syslog cannot parse
2022-01-18 09:54:01 +01:00
Thibault "bui" Koechlin
40ed810c0b
Gin upgrade ( #1174 )
...
* upgrade gin / gin-jwt, and add a new 'trusted_proxies' option to provide trusted CIDRs
2022-01-17 17:18:12 +01:00
Thibault "bui" Koechlin
6e92da76ad
lapi to capi : allow push of tainted/custom/manual decisions ( #1154 )
...
* add console command to control signal sharing
* modify metrics endpoint to add lastpush
Co-authored-by: alteredCoder <kevin@crowdsec.net>
2022-01-13 16:46:16 +01:00
blotus
cc72800f50
Update LAPI swagger ( #1155 )
2022-01-11 16:45:34 +01:00
Thibault "bui" Koechlin
3bca25fd6d
lists support from central api ( #1074 )
...
* lists support from central api
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
2022-01-11 14:31:51 +01:00
blotus
4a11060930
Kinesis datasource ( #1147 )
2022-01-11 14:19:43 +01:00
Thibault "bui" Koechlin
6c676c4869
fix #1131 : complain when validating unknown machine ( #1146 )
2022-01-05 13:50:04 +01:00
Shivam Sandbhor
ba71c55492
Fix cscli inpsect json output ( #1145 )
...
* Fix cscli inpsect json output
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-01-05 10:42:27 +01:00
Thibault "bui" Koechlin
8e3004ebb3
fix race condition on repetitive trigger buckets creation ( #1144 )
2022-01-04 14:02:07 +01:00
Shivam Sandbhor
6c4ec64ca9
Fix json output of cscli hub list ( #1143 )
...
* Fix json output of cscli hub list
* Fix functional tests.
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-01-04 11:49:23 +01:00
blotus
f86ec1c389
Docker api version negotiation ( #1135 )
2021-12-30 12:21:49 +01:00
blotus
3105897f37
Allow to configure log rotation ( #1130 )
2021-12-28 11:59:03 +01:00
mmetc
7126f8f0ff
replaced ( #1129 )
2021-12-28 10:32:46 +01:00
AlteredCoder
f86e0c0a5a
don't send decisions with negative duration to bouncers ( #1117 )
2021-12-21 10:23:30 +01:00
Sykursen
6a3adcff0e
Upgrade metabase to v41.5 ( #1109 )
2021-12-17 10:29:48 +01:00
Thibault "bui" Koechlin
106254f020
support for cancel_on ( #1105 )
...
* cancel_on filter
* tests
2021-12-17 09:56:02 +01:00
AlteredCoder
d913ac160e
fix create alert bulk for decisions insertion ( #1107 )
...
* fix create alert bulk for decisions insertion
2021-12-16 18:26:19 +01:00
AlteredCoder
88d06260d7
add cscli decisions import ( #1038 )
...
* add cscli decisions import
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
Co-authored-by: bui <thibault@crowdsec.net>
2021-12-15 11:39:37 +01:00
AlteredCoder
458dcd1979
add more helpers ( #1091 )
...
* add more exprhelpers
2021-12-14 11:07:40 +01:00
Thibault "bui" Koechlin
e5204bc1b1
fix #1083 : do not update/overwrite 'not installed' collections sub-items on 'cscli XX upgrade' ( #1089 )
...
* fix #1083 : do not update/overwrite 'not installed' collections sub-items on 'cscli XX upgrade'
2021-12-13 19:31:16 +01:00
mmetc
c7fb6a1428
enabled -> enabling ( #1090 )
2021-12-13 13:14:29 +01:00
Manuel Sabban
4e6f6fe3a2
log4j vuln fix for metabase ( #1082 )
...
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-12-13 10:19:20 +01:00
mmetc
7dee103b6e
typos of various nature ( #1072 )
2021-12-06 17:29:23 +01:00
AlteredCoder
4917aa23c9
Docker datasource ( #1064 )
...
* add docker datasource
2021-12-02 15:55:50 +01:00
blotus
dd03d07355
optimize the flush function by deleting alerts based on their id ( #1054 )
2021-11-17 10:15:38 +01:00
he2ss
0652e9ed08
feature cscli|crowdsec add additional labels on crowdsec dsn run ( #1053 )
...
* feature cscli|crowdsec add additional labels on crowdsec dsn run
2021-11-17 10:08:46 +01:00
Thibault "bui" Koechlin
3c768490ba
fix #873 without breaking backward ( #1052 )
2021-11-15 14:16:18 +01:00
Kerma Gérald
37c2a10e21
Use math.MaxInt32 instead of math.MaxUint32 ( #980 )
...
To fix 32 bits compilation in v1.2.0
https://github.com/crowdsecurity/crowdsec/issues/979
Signed-off-by: Kerma Gérald <gandalf@gk2.net>
2021-11-15 12:14:04 +01:00
Thibault "bui" Koechlin
7362828a3b
add --failures to explain feature : only display failed lines ( #1048 )
...
* add --failures to explain feature : only display failed lines
* no error no problem
2021-11-08 18:01:43 +01:00
Thibault "bui" Koechlin
8b0527bf9d
add evt. ( #1045 )
2021-11-03 15:17:48 +01:00
AlteredCoder
fb54388e93
Fix issue 1033 ( #1034 )
...
* Fix issue 1033
2021-11-02 12:16:33 +01:00
Thibault "bui" Koechlin
d1ce543440
Improve explain ( #1039 )
...
* improve explain feature
* nicer display for details, --verbose in favor of --debug for details
2021-11-02 12:06:01 +01:00
Shivam Sandbhor
cbada3d435
Allow using cloudwatch using iam role instead of hardcoded tokens ( #1035 )
2021-11-02 10:25:35 +01:00
mmetc
f10187bd6d
typos ( #1036 )
2021-11-02 09:19:22 +01:00
Thibault "bui" Koechlin
2b2a11fec7
Extra syslog debug ( #1030 )
...
* extra logging
2021-11-01 20:55:03 +01:00
AlteredCoder
cf57c89177
add name and alias in cscli console enroll ( #950 )
...
* add name and alias in cscli console enroll
2021-10-26 15:33:17 +02:00
blotus
25a2d528b0
Alerts flush: Optimization of the flush mechanism (batch and limit to one job) + add cscli alerts flush command ( #1024 )
...
- Don't allow running more than one alert flush job at a time to prevent runaway CPU usage in some case. (fix High CPU after Upgrade to 1.2.0 #1022 )
- Add a cscli alerts flush command to manually flush the alerts in the database (fixes Improvement/Manual flush mechanism #1023 ).
- Enable cascading deletion on alerts as we upgraded ent: Deleting an alert in the database will automatically delete all related decisions, events and meta
- Add an index on alerts.id to try to improve flush performance with very big sqlite database.
- Flush alert now operates in batch
2021-10-26 13:33:45 +02:00
Thibault "bui" Koechlin
3f99330b3d
Entgo 0.9 ( #1018 )
...
* update entgo & sqlite to latest version
* schema update
2021-10-22 16:15:57 +02:00
Shivam Sandbhor
a7b1c02bd5
Fix bugs in cloudwatch acq ( #991 )
...
* Fix bugs in cloudwatch acq
- Fix concurrent writes to map streamIndexes
- Fix multiple cases of modifying while iterating on slice.
- Fix order of fetching cloudwatch events.
- Remove `startup` hack.
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
* Fix cloudwatch tests
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-10-22 10:35:05 +02:00
Thibault "bui" Koechlin
3bb2128bf4
fix sort :/ ( #1007 )
2021-10-12 19:16:24 +02:00
Thibault "bui" Koechlin
1bd6b8f7b9
Multiple fixes ( #1006 )
...
* fix #1005 : timestamp in trigger timemachine buckets
* attempt at consistent bucket order for hubtest
2021-10-12 14:09:17 +02:00
Thibault "bui" Koechlin
2961a0ed02
ensure machineID is included early enough into the alert ( #1004 )
2021-10-11 15:02:16 +02:00
blotus
2bc9f33e12
add ParseUri() expr helper ( #994 )
2021-10-08 16:50:31 +02:00
AlteredCoder
0ccc69696b
Break on success when alert already has decision ( #997 ) ( #999 )
...
* Break on success when alert already has decision (#997 )
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-10-05 11:30:34 +02:00
Thibault "bui" Koechlin
af4bb350c0
hubtests revamp + cscli explain ( #988 )
...
* New hubtest CI for scenarios/parsers from the hub
* New `cscli explain` command to visualize parsers/scenarios pipeline
Co-authored-by: alteredCoder <kevin@crowdsec.net>
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
Co-authored-by: he2ss <hamza.essahely@gmail.com>
Co-authored-by: Cristian Nitescu <cristian@crowdsec.net>
2021-10-04 17:14:52 +02:00
Thibault "bui" Koechlin
c2fd173d1e
fix node success logic ( #993 )
...
* fix node success logic : only fail node on child failure if mother node has no successfull grok
2021-09-28 17:58:07 +02:00
he2ss
fb308d5596
fix plugins logging in right level ( #990 )
2021-09-28 14:44:21 +02:00
he2ss
db5ffb0040
Update test env ( #987 )
...
* update test_env
2021-09-24 18:06:30 +02:00
blotus
f0db3742de
fix usage of regex.Match in cloudwatch module ( #986 )
2021-09-23 13:52:05 +02:00
Shivam Sandbhor
cca76da2d6
Fix crash if plugin config is broken ( #964 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-09-10 14:25:34 +02:00
he2ss
e651379964
add jsonExtractUnescape Helper ( #962 )
...
* add jsonExtractUnescape Helper
2021-09-10 12:43:11 +02:00
AlteredCoder
5ae69aa293
fix stacktrace when mmdb file are not present ( #935 )
...
* fix stacktrace when mmdb file are not present
2021-09-09 16:27:30 +02:00
blotus
7a1b955ad1
use our fork of grokky ( #953 )
2021-09-09 14:46:16 +02:00
Shivam Sandbhor
b8e24a1e0b
Make plugin runner configurable and run only registered plugins ( #944 )
...
* Make plugin runner configurable and run only registered plugins
2021-09-08 11:36:42 +02:00
Thibault "bui" Koechlin
0ad6165ed2
fix release drafter + readme + remove dead readme for acquis ( #933 )
2021-09-03 09:07:24 +02:00
Manuel Sabban
d7d591ff84
update to use cdn for hub ( #920 )
...
* update to use cdn for hub
* add cdn for version
* fix unit tests accodingly with new cdn
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-09-02 15:17:37 +02:00
Thibault "bui" Koechlin
bed90a832e
fix #919 : display error message ( #929 )
...
* fix #919
* fix tests
2021-09-02 12:46:32 +02:00
Thibault "bui" Koechlin
589cb72d41
enforce a bit more parsing for resillience ( #928 )
2021-09-02 12:34:20 +02:00
Shivam Sandbhor
b40fd36607
Add plugin interface code in protobufs package ( #921 )
...
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-08-31 14:40:17 +02:00
Thibault "bui" Koechlin
68c11dd827
don't try to send/don't notify if plugin chan is nil ( #923 )
2021-08-31 14:39:32 +02:00
blotus
b5d0d56a11
add support for --since in journalctl DSN ( #917 )
2021-08-31 12:40:22 +02:00
ThinkChaos
448a227079
Minor changes to specific logs ( #900 )
...
- Minor changes to specific logs
- Fix LAPI to not push signals to CAPI when disabled #907
2021-08-25 18:30:05 +02:00
Thibault "bui" Koechlin
c188d401a3
Improve CAPI pull management ( #871 )
...
* prepare for new consensus : thousands of ips
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
2021-08-25 11:45:29 +02:00
Thibault "bui" Koechlin
950759f6d6
Output plugins ( #878 )
...
* Add plugin system for notifications (#857 )
2021-08-25 11:43:29 +02:00
Manuel Sabban
4dbbd4b3c4
Download datafile ( #895 )
...
* add the ability to download datafile on cscli hub upgrade on files are missing
* fix stuff + lint
* fix error management
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-08-19 09:08:20 +02:00
Shivam Sandbhor
f64f20fd53
Document scope parameter for stream API ( #897 )
...
Signed-off-by: Shivam Sandbhor <shivam@crowdsec.net>
2021-08-18 16:05:56 +02:00
Nanik
b0746fbc4d
fix: add /health endpoint ( #881 )
...
* fix: add /health endpoint
2021-08-18 09:06:01 +02:00
Thibault "bui" Koechlin
05ac3ca402
if profile is in debug, log debug even if it matched the profile ( #894 )
2021-08-17 16:50:16 +02:00
Thibault "bui" Koechlin
25ed1c265d
fix #885 : remove dead dependencies for plugin ( #891 )
2021-08-17 10:32:15 +02:00
Thibault "bui" Koechlin
fc7369c4ea
Fix big serialized entries ( #877 )
...
* bump serialized to 8k
* handle oversized serialized entry : progressively strip its size down
2021-08-03 15:46:10 +02:00
Thibault "bui" Koechlin
01028d0a09
Goroutine leak hunt ( #874 )
...
* close the writers of gin loggers + kill the tomb of httpServer
* body close defer
2021-07-30 11:41:17 +02:00
blotus
cedfca07c2
don't wait for acquis tomb if we have no sources ( #868 )
2021-07-28 08:58:44 +02:00
Thibault "bui" Koechlin
b6ee006078
ensure decisions from CAPI have proper case ( #848 )
2021-07-02 11:23:46 +02:00
Thibault "bui" Koechlin
033c8e17e8
fix #842 #837 ( #845 )
...
* fix #842 and move preflight checks tgth
* handle new container name
Co-authored-by: AlteredCoder <AlteredCoder>
2021-07-01 18:15:22 +02:00
blotus
3994aec7fe
add console enroll command to cscli ( #828 )
2021-06-28 17:34:19 +02:00
Thibault "bui" Koechlin
7f0cac8ee6
add support for 'expression' ( fix #822 ) in grok patterns ( #830 )
...
* add support for 'expression' (fix #822 ) in grok patterns
* add tests
2021-06-21 09:07:33 +02:00
Thibault "bui" Koechlin
ce6a61df1c
Refactor Acquisition Interface ( #773 )
...
* Add new acquisition interface + new modules (cloudwatch, syslog)
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
2021-06-11 09:53:53 +02:00
Thibault "bui" Koechlin
71c1d9431f
fix #823 : lower JsonExtract debug ( #824 )
...
* lower key not found log level, fix #823
2021-06-02 14:27:34 +02:00
Shivam Sandbhor
f25d02a7c8
Allow bouncers to filter decisions by scope ( #817 )
...
Signed-off-by: Shivam Sandbhor <shivam@crowdsec.net>
2021-05-31 15:07:09 +02:00
Thibault "bui" Koechlin
bf6b791420
fix #781 - avoid unconsistent body : do not send NbDeleted on error ( #812 )
2021-05-28 11:17:30 +02:00
blotus
c1c76645a7
improve emoji for local configuration when listing ( #811 )
2021-05-28 11:11:53 +02:00
svesve
6693bff2f5
Add postgres sslmode option ( #772 )
...
Co-authored-by: aleksandr.drozdin <aleksandr.drozdin@karuna.group>
2021-05-19 17:03:23 +02:00
he2ss
eb0bd70046
fix #787 : load simulation config at startup ( #793 )
...
* fix #787 : load simulation config at startup
2021-05-17 11:54:28 +02:00
Thibault "bui" Koechlin
f881510f79
delete orphan nodes ( fix #778 ) ( #794 )
...
* delete orphan nodes (for #778 and partially #781 )
* and do it as well for decisions
2021-05-17 11:45:01 +02:00
AlteredCoder
fd830b4293
Fix some bugs ( #788 )
...
* fix config restore
* fix panic on middleware
Co-authored-by: AlteredCoder <AlteredCoder>
2021-05-07 18:40:01 +02:00
AlteredCoder
a19f13ab45
fix cscli alerts delete -all ( #769 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2021-04-27 11:59:18 +02:00
Thibault "bui" Koechlin
b0d4744b15
add System to cwversion to know platform, add it in UA ( #763 )
2021-04-23 15:23:46 +02:00
registergoofy
7e9ce901a4
add TimeNow in the exprlib helpers ( #756 )
...
* add TimeNow in the exprlib helpers
* add a default date when none is detected: when no date is recognised by ParseDate, then use time.Now()
2021-04-16 19:13:48 +02:00
Lars Lehtonen
d86ba98cff
pkg/apiserver: fix dropped error ( #700 )
...
* pkg/apiserver: fix dropped error
* pkg/apiserver: remove unused Context from APIServer{}
2021-04-07 14:51:00 +02:00
Thibault "bui" Koechlin
4bb34d8e77
fix #723 : intercept http2 stream closed errors ( #724 )
...
* fix #723 : intercept http2 stream closed errors
* factorize the 'dump stacktrace' code
2021-04-07 14:31:03 +02:00
Thibault "bui" Koechlin
cd06929e75
honor log levels for api : don't log access logs if level is warn/err ( #732 )
...
* honor log levels for api : don't log access logs if level is warn/err
* add basic test for logging of api server
2021-04-07 11:39:24 +02:00
Thibault "bui" Koechlin
20ef67a699
cscli hub mgmt improvements (#710 )
...
* avoid this confusing behaviour where 'cscli parsers/scenarios/... upgrade' won't tell a thing if no arguments are given (and won't do anything neither)
* avoid repeating warnings about available update to the user
2021-03-29 10:33:23 +02:00
AlteredCoder
1e899c2211
Refactor configuration management ( #698 )
2021-03-24 18:16:17 +01:00
Thibault "bui" Koechlin
6d28599efa
Ensure LAPI logs respect log_media ( #707 )
...
* if log_media is set to file, don't try to log to stdout
* use the log media no matter what
2021-03-22 17:46:55 +01:00
AlteredCoder
4166d9ff48
fix pattern registration ( #715 )
2021-03-22 17:17:24 +01:00
Thibault "bui" Koechlin
1938e1a62d
clarify doc on onsuccess in parsers + add new date formats for dateparse ( #703 )
2021-03-19 16:33:10 +01:00
Lars Lehtonen
7f8faa7565
pkg/apiclient: pick up dropped errors ( #676 )
2021-03-17 12:36:47 +01:00
Thibault "bui" Koechlin
28446b6d29
Ent update : 0.7.0 ( #692 )
...
* up regenerate new schema
* new ent
* update documentation for min required versions
* update documentation
2021-03-15 18:46:52 +01:00
AlteredCoder
c1abf69979
fix #677 ( #684 )
2021-03-12 15:10:56 +01:00
AlteredCoder
f2d14c8ca2
update the config.yaml file ( #674 )
2021-03-11 11:18:09 +01:00
Thibault "bui" Koechlin
0981aa98d8
Pattern syntax consistence ( #675 )
...
* fix #667
* improved error message
* mark the compability, ordered pattern_syntax will be tagged as 'version 2'
* fix tests + add tests to check grok subpattern dependencies
2021-03-10 18:27:21 +01:00
Lars Lehtonen
7863bad596
pkg/metabase: fix dropped error ( #652 )
2021-03-10 15:11:56 +01:00
registergoofy
a8b16a66b1
truely don't try to send anything with empty online credentials configuration file ( #657 )
...
* truely don't try to send anything with empty online credentials config file
Co-authored-by: AlteredCoder <AlteredCoder>
2021-03-02 09:25:12 +01:00
Thibault "bui" Koechlin
70055b3fd6
Doc api + minor api fixes ( #654 )
...
* add doc for API
* link users guide on metabase without docker
* rename doc and swagger
2021-02-26 17:42:45 +01:00
registergoofy
5b7ac4a473
[Rebased] fix races ( #633 )
...
* get rid of dead code
* have LeakRoutined started in a tomb
* fix race and multiple small issues in the way we handle tombs
* yet another race fix
* another race
* get rid of leaky.KillSwitch for proper tomb use
* fix deadlock
* empty overflow before exiting
* fix an obvious typo
* proper use of waitgroup
* have a smart signalisation for allowing LeakRoutine being killed
* ugly workaround
* fix lint error
* fix compilation
* fix panic
* shorten lock
* up lock both copy
* wait for crowdsec to die
* fix coding style and lint issue
* go mod tidy
Co-authored-by: bui <thibault@crowdsec.net>
2021-02-25 11:26:46 +01:00
AlteredCoder
8b504e9f67
improve logging in cscli and wizard ( #643 )
2021-02-25 11:20:36 +01:00
Thibault "bui" Koechlin
a3d00fe130
skip empty lines to avoid issue of #630 ( #631 )
...
* skip empty lines to avoid issue of #630
* add tests on empty lines and comms
2021-02-25 09:57:24 +01:00
Thibault "bui" Koechlin
22ada59393
Allow for acquisition files to be specified from a directory as well ( #619 )
...
* allow a acquisition_dir in crowdsec's config + change the behaviour of config loading so that it's working with a list instead. keep backward compat with acquisition_path
* remove the default behaviour of 'guessing' acquis path if param isn't present, and error
2021-02-17 13:55:36 +01:00
Thibault "bui" Koechlin
7d93302e05
add a prometheus_uri option for cscli's config ( #625 )
...
* add a prometheus_uri option for cscli's config, and update documentation
* specify min version
2021-02-17 13:53:57 +01:00
Thibault "bui" Koechlin
7f40160f6e
only set logfile dir if media is file ( #615 )
2021-02-11 18:28:01 +01:00
AlteredCoder
dae4458a6f
create crowdsec group for metabase and crowdsec.db ( #606 )
2021-02-10 09:23:33 +01:00
blotus
260332c726
Add use_forwarded_for_headers configuration option for LAPI ( #610 )
...
* Add use_forwarded_for_headers configuration option for LAPI
* update documentation
2021-02-09 19:10:14 +01:00
AlteredCoder
22c4962768
don't load lapi creds when running only api ( #608 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2021-02-09 17:59:35 +01:00
AlteredCoder
50ee846e87
enable item when they have been added to a collection since previous release ( #599 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2021-02-04 17:17:51 +01:00
AlteredCoder
359a9cb8ce
allow environment variable in configuration file ( #601 )
2021-02-04 17:17:01 +01:00
Thibault "bui" Koechlin
e74f221044
Fix default configurations ( #597 )
...
* fix default perms on SQLite file
* seed the prng securely
* fix defaults to enforce certificates verification
* ensure file is within path
* ensure the directory doesn't exist beforehand
* verify certificate by default
* disable http ip forward headers
2021-02-02 14:15:13 +01:00
Shivam Sandbhor
36844e50b3
Fix typo in apic.go logs ( #592 )
2021-01-31 11:42:17 +01:00
Thibault "bui" Koechlin
25562e9575
drop the platform argument to avoid being compatible ONLY with API 1.41 ( #582 )
2021-01-18 15:25:07 +01:00
AlteredCoder
81e7db71ed
Fix bugs in wizard and cscli ( #577 )
...
* fix id generation bug
* fix api client response
Co-authored-by: AlteredCoder <AlteredCoder>
2021-01-15 18:14:50 +01:00
AlteredCoder
5544000d38
lapi: fix ipv6 operations ( #567 )
2021-01-14 16:27:45 +01:00
Thibault "bui" Koechlin
9ec0ea08bb
fix jwt token desynchronization between crowdsec and lapi ( #572 )
2021-01-14 16:04:10 +01:00
AlteredCoder
c2517e8eb4
fix docker container creation for metabase ( #563 )
2021-01-08 14:32:29 +01:00
registergoofy
eda9c03c82
jwt token generation improvement ( #557 )
...
* add some warning comment for those who want to choose their secret
* strictly follow the golang doc for using crypto/rand
* fatal if not enough entropy
* add a check when using pre-choosen secret
2021-01-07 14:24:53 +01:00
Thibault "bui" Koechlin
ad4521f2cc
gin: broken pipe ( #538 )
...
* broken pipe
* don't fail if release isn't here
2020-12-14 17:48:32 +01:00
registergoofy
13881edbaa
export node logger ( #537 )
2020-12-14 14:12:22 +01:00
Thibault "bui" Koechlin
f2b30db684
ensure decisions from local or tainted scenarios aren't push, neither are manual decisions ( #536 )
2020-12-14 12:46:07 +01:00
Thibault "bui" Koechlin
bb679310c7
deal with LAPI down : ensure client will reauthenticate ( #527 )
...
* to avoid keeping apiclient in broken state, reset the token on error
2020-12-14 11:54:16 +01:00
erenJag
b6d73f48cd
Fix some bugs : update doc, codename and fix wizard ( #522 )
...
* change localhost to 127.0.0.1 + fix uninstall in wizard
* remove beta from repo
2020-12-08 12:45:36 +01:00
erenJag
339cb6cce7
update prometheus doc ( #509 )
2020-12-04 11:24:12 +01:00
registergoofy
f411ab4fcd
Fix a crash ( #503 )
...
* fix a crash
2020-12-03 17:34:57 +01:00
erenJag
fd744408c3
fix cwhub remove func ( #501 )
2020-12-03 12:05:27 +01:00
erenJag
9d016f262f
fix & improve cscli remove action + improve cscli args vars ( #498 )
2020-12-02 18:47:17 +01:00
Thibault "bui" Koechlin
2e76097d35
Fix overflows of overflows requesting for different decision scope ( #499 )
2020-12-02 17:15:48 +01:00
Thibault "bui" Koechlin
b7190c9ecc
improve error management of cscli bouncers add ( #495 )
2020-12-01 16:16:01 +01:00
erenJag
71325d9134
Improve create alerts input ( #493 )
...
* check decisions start_ip & end_ip fields
2020-12-01 14:42:53 +01:00
erenJag
a16fb1475d
add info message when there is no hub index ( #492 )
2020-12-01 12:33:14 +01:00
AlteredCoder
c6eb2afa20
push to CAPI in go routine ( #489 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-11-30 17:46:02 +01:00
Thibault "bui" Koechlin
71ac0d2fce
Apiclient tests ( #484 )
...
Co-authored-by: AlteredCoder
Co-authored-by: erenJag
2020-11-30 16:15:07 +01:00
Thibault "bui" Koechlin
dbb420f79e
local api ( #482 )
...
Co-authored-by: AlteredCoder
Co-authored-by: erenJag
2020-11-30 10:37:17 +01:00
registergoofy
f0ea8312db
set default hub branch to master in cscli ( #279 )
2020-10-01 15:02:53 +02:00
registergoofy
9b97633043
fix ban flush ( #277 )
...
* fix ban flush by soft-deleting entries in database
* fix unit tests accordingly
2020-10-01 08:26:59 +02:00
registergoofy
c6aab9893a
add randomness to machine-id when registering. ( #261 )
...
* add randomness to machine-id when registering.
* add some regexp check for machine_id
* typo fix
* fix cwapi unit tests
2020-09-29 13:17:33 +02:00
AlteredCoder
b7286d6a85
make cscli use crowdsec version for hub ( #194 )
2020-09-01 14:32:45 +02:00
AlteredCoder
b81c735d81
remove debug while fixing test
2020-08-30 16:04:51 +02:00
AlteredCoder
7f45c43eb1
change github workflow to get latest release
2020-08-28 16:37:35 +02:00
Thibault "bui" Koechlin
b2ef6a555c
add support for 'prometheus_mode' configuration directive that can be set to 'aggregation' to limit the cardinality of prometheus metrics ( #192 )
2020-08-24 11:51:50 +02:00
erenJag
6624fce66a
fix tests ( #191 )
...
* fix leakybucket test
2020-08-24 10:25:52 +02:00
AlteredCoder
a6fabcf481
fix CI in leakybuckets
2020-08-23 23:42:24 +02:00
AlteredCoder
3801dcc277
fix parser tests
2020-08-23 23:34:12 +02:00
erenJag
25dfcebf4c
improve fileInit func by not loading unspecified data ( #189 )
...
* improve fileInit func by not loading unsepcified data
2020-08-21 14:20:44 +02:00
Thibault "bui" Koechlin
5595070e67
handle multiple plugins for now (append results rather than taking the 'last one' ( #185 )
2020-08-21 12:28:59 +02:00
Thibault "bui" Koechlin
1956f52be5
add a warning when a grok pattern ends with \n ( #183 )
2020-08-20 15:07:50 +02:00
Thibault "bui" Koechlin
742435f178
Acquisition extra tests ( #188 )
...
* acquisition testing
2020-08-20 13:55:52 +02:00
Thibault "bui" Koechlin
1398a74c6d
add extra tests for exprlib visitors ( #187 )
...
* add extra tests for exprlib visitors
2020-08-20 11:53:47 +02:00
Thibault "bui" Koechlin
ceb69f0cef
documentation improvment ( #182 )
2020-08-07 09:40:43 +02:00
AlteredCoder
747065229e
fix expr debugger ( #178 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-08-05 16:27:16 +02:00
Thibault "bui" Koechlin
7525f11975
improve tests in pkg/leakybuckets ( #171 )
2020-08-05 11:39:54 +02:00
Thibault "bui" Koechlin
8128dcf61b
add more tests for pkg/parser (config loading) ( #172 )
2020-08-05 11:20:03 +02:00
AlteredCoder
b10c7e9bef
fix expr debugger when no variable is present ( #174 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-08-04 16:44:03 +02:00
AlteredCoder
d8f0f5a3a9
Add debug expr ( #168 )
...
* debug expr in node.go
* update documentation
Co-authored-by: AlteredCoder <AlteredCoder>
Co-authored-by: Thibault bui Koechlin <thibault@crowdsec.net>
2020-08-03 12:21:15 +02:00
Thibault "bui" Koechlin
085dcc5eb6
add a basic functional tests in the CI ( #169 )
2020-07-31 16:16:23 +02:00
AlteredCoder
b7096be6e6
fix message to verbose in expr helper ( #166 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-30 17:12:47 +02:00
Thibault "bui" Koechlin
0356f8404b
add tests for pkg/database ( #151 )
2020-07-30 15:58:06 +02:00
AlteredCoder
d23512e9c6
improve logging ( #164 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-30 15:30:02 +02:00
Thibault "bui" Koechlin
b19046939c
sqlite set busy timeout to 10s rather than 1s ( #162 )
2020-07-30 11:39:06 +02:00
Thibault "bui" Koechlin
d2ffb190f9
add a default configuration file if none is specified ( #159 )
2020-07-29 16:58:25 +02:00
AlteredCoder
5e561e30bd
fix cwapi bug with new sling usage ( #157 )
...
* fix sling usage
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-29 15:15:33 +02:00
erenJag
89c8d1a527
rename metrics and update metrics helps ( #152 )
...
* rename metrics and update metrics helps
* add meta info about crowdsec
Co-authored-by: erenJag <erenJag>
2020-07-29 15:03:15 +02:00
Thibault "bui" Koechlin
acc0960c17
match the hashes version in reverse order ( #156 )
2020-07-29 15:02:52 +02:00
AlteredCoder
794d3221d0
add tests in pkg/csconfig and improve pkg/exprhelpers tests ( #150 )
...
* add tests for csconfig & improve exprhelpers tests
2020-07-28 15:38:48 +02:00
AlteredCoder
e6cb7f3a79
fix
2020-07-27 18:52:00 +02:00
AlteredCoder
55d5b6842c
fix
2020-07-27 18:35:31 +02:00
Thibault "bui" Koechlin
056c7801c6
add unitest in cwhub package ( #144 )
2020-07-27 13:47:32 +02:00
Thibault "bui" Koechlin
151af2d0d8
No sql transaction + proper time-machine wait ( #148 )
2020-07-27 13:42:30 +02:00
AlteredCoder
851ad300cb
Add unitest in pkg/acquisition and pkg/cwapi ( #145 )
...
* ci for acquisition and cwapi
* update README
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-27 12:18:55 +02:00
Thibault "bui" Koechlin
a104e6d053
fix ban deduplication ( #143 )
2020-07-21 10:48:06 +02:00
AlteredCoder
40b7bfaf69
fix ( #142 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-20 17:44:45 +02:00
Thibault "bui" Koechlin
66161bc8ae
fix auto-delete ( #140 )
2020-07-20 11:52:00 +02:00
AlteredCoder
0864f13cb8
fix post merge ( #138 )
...
* fix post merge (#138 )
2020-07-17 15:26:46 +02:00
Thibault "bui" Koechlin
177480cff7
updated mysql plugin support ( #135 )
...
* add support for plugin, support mysql & so on
* fix queries
Co-authored-by: erenJag <erenJag>
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-16 16:05:03 +02:00
Thibault "bui" Koechlin
7fe6741df3
Simulation support ( #136 )
...
* support simulation mode
2020-07-16 15:59:09 +02:00
AlteredCoder
87a90583fe
Fix#80 ( #133 )
...
* fix #80
Co-authored-by: AlteredCoder <AlteredCoder>
Co-authored-by: Thibault bui Koechlin <thibault@crowdsec.net>
2020-07-16 15:48:46 +02:00
Thibault "bui" Koechlin
bc2566f3e5
support multiple args for all cscli upgrade/install/remove commands ( #132 )
2020-07-10 10:43:22 +02:00
erenJag
44304a30e7
fix #124 ( #127 )
...
* fix #124
2020-07-09 12:41:18 +02:00
Thibault "bui" Koechlin
a0c1ca49d0
Doc : fix whitelists documentation + document data for parsers/scenarios + document expr helpers + link taxonomy ( #126 )
2020-07-08 10:58:20 +02:00
AlteredCoder
d0ac43b00f
Allow comments with # in expr wordlists
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-07 16:26:00 +02:00
Thibault "bui" Koechlin
a62bac0ca0
verbosity ( #121 )
2020-07-03 18:26:23 +02:00
Thibault "bui" Koechlin
7691e5b663
re-enable postoverflows ( #117 )
...
* re-enable postoverflows
* debug
* yoloooo
* remove debug
* remove error print
* fix test
* fix leakybucket test
* fix
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-02 17:56:39 +02:00
AlteredCoder
eef1847873
add whitelisted flag in signal occurence ( #114 )
2020-07-02 11:44:27 +02:00
erenJag
f6826c7e47
add expr helper to check if IP is in ipRange ( #113 )
...
* add expr helper to check if IP is in ipRange
* update helper name
Co-authored-by: erenJag <erenJag>
2020-07-02 11:09:40 +02:00
Thibault "bui" Koechlin
b9ae94b874
Sqlite : Support automatic db flushing ( #91 )
...
* add support for sqlite retention : max_records, max_records_age
* reduce verbosity of cwhub
2020-07-01 17:04:29 +02:00
Thibault "bui" Koechlin
e4993996a5
exclude fields so that they are not serialized when we're rewritting api.yaml file ( #103 )
2020-06-29 17:47:57 +02:00
Thibault "bui" Koechlin
02b2193d64
fix collection dependencies : install subparts of collection, even if the collec file itself exists ( #101 )
2020-06-29 17:31:37 +02:00
Thibault "bui" Koechlin
652b54ee81
SignalOccurence can't lead to BanApplication if there is no source in the Event ( #96 )
2020-06-29 13:22:56 +02:00
AlteredCoder
2e30793188
Allow CrowdSec to start if geoip data are not downloaded ( #92 )
...
* Allow CrowdSec to start if `geoip` data are not downloaded
2020-06-25 12:36:01 +02:00
Thibault "bui" Koechlin
5446857377
Add crowdsec reload + cscli metrics minor improvements ( #79 )
2020-06-19 13:57:44 +02:00
Thibault "bui" Koechlin
8651a1aefc
skip ~ files #69 ( #71 )
...
* skip ~ files
* only keep .yaml et .yml files
2020-06-12 17:55:35 +02:00
Thibault "bui" Koechlin
26f77bed88
CI: provide makefile for CI and fixe types.Event ( #70 )
2020-06-11 15:03:43 +02:00
Thibault "bui" Koechlin
64c5fa7360
CI: add a CI to test parsers ( #67 )
2020-06-10 12:14:27 +02:00
AlteredCoder
fc05a49cc3
Fix API push ( #62 )
...
* add debug
* debug
* remove debug
* remove typo
* fix linter
Co-authored-by: AlteredCoder <AlteredCoder>
2020-06-03 14:24:07 +02:00
Thibault "bui" Koechlin
f9a4ae2b3f
fix #60 - sqlite lock + badges ( #61 )
...
* don't fatal is DB is locked + Fix #60
2020-06-03 14:18:00 +02:00
AlteredCoder
08c0167f15
fix debug ( #58 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-06-02 16:17:30 +02:00
AlteredCoder
72d1fe4c3b
fix ( #51 )
...
Co-authored-by: AlteredCoder <AlteredCoder>
2020-06-01 18:32:01 +02:00
Thibault "bui" Koechlin
430b7cd90d
add a 'Upper' expr helper ( #50 )
...
* add a 'Upper' expr helper
* remove redundant startsWith and endsWith
2020-06-01 16:12:48 +02:00
Thibault "bui" Koechlin
f2e38b0d28
fix #47 #35 ( #49 )
2020-06-01 12:56:32 +02:00
AlteredCoder
82d6e6938a
Fix expr helpers "StartsWith" and "EndsWith" ( #48 )
...
* fix
* fix typo
Co-authored-by: AlteredCoder <AlteredCoder>
2020-05-29 17:25:09 +02:00
Thibault "bui" Koechlin
4e8aa19c09
bump version 0.0.4 + typo ( #46 )
...
* fix typo in history rewrite
* and bump version
2020-05-28 12:03:29 +02:00
AlteredCoder
ea4e4153af
fix review
2020-05-28 11:32:00 +02:00
AlteredCoder
937bd20c18
fix
2020-05-28 11:32:00 +02:00
AlteredCoder
083b9897d8
fix
2020-05-28 11:32:00 +02:00
Thibault "bui" Koechlin
cda7beddbf
add support in cscli to switch branches of hub ( #43 )
2020-05-28 11:32:00 +02:00
Thibault bui Koechlin
b51d666dcb
type
2020-05-28 11:32:00 +02:00
Thibault bui Koechlin
7563975eef
only set if non-nil, avoid crash on unconfigured logger
2020-05-28 11:32:00 +02:00
Thibault bui Koechlin
80387fe66e
simplify the code
2020-05-28 11:32:00 +02:00
Thibault bui Koechlin
87ff0883cf
lower verbosity for this, give context to that
2020-05-28 11:32:00 +02:00
Thibault bui Koechlin
372d8680c3
unify loggers and improve the log message about groks when they're not called by name
2020-05-28 11:31:55 +02:00
Thibault bui Koechlin
a06f8373ae
move the setLogger config and ConfigureLogger to be part of types for reuse accross modules
2020-05-28 11:28:49 +02:00
Thibault bui Koechlin
3fa5122db7
only test directories
2020-05-28 11:28:49 +02:00
AlteredCoder
8d43abbf4c
add context in log
2020-05-28 11:28:49 +02:00
AlteredCoder
ed919a55be
fiw review
2020-05-28 11:28:49 +02:00
AlteredCoder
fd6ecd25df
fix review
2020-05-28 11:28:49 +02:00
Thibault bui Koechlin
7657a0cc37
fix non unique grok name
2020-05-28 11:28:49 +02:00
Thibault bui Koechlin
a199cd8b36
unify paths
2020-05-28 11:28:49 +02:00
Thibault bui Koechlin
7557ce8156
add 'in File(...)' tests for parsers and leakybuckets
2020-05-28 11:28:49 +02:00
Thibault bui Koechlin
6cb5ec0460
add a parser unit test using the 'in File(...)' construct
2020-05-28 11:28:49 +02:00
AlteredCoder
160478b419
add test for exprhelpers
2020-05-28 11:28:49 +02:00
Thibault "bui" Koechlin
1abdfc9b10
make message better
2020-05-28 11:28:49 +02:00
erenJag
c020ff8c64
Merge pull request #22 from crowdsecurity/add_expr_helpers
...
add new expr helpers
2020-05-25 12:12:49 +02:00
Thibault "bui" Koechlin
d9a37683e7
Merge pull request #27 from crowdsecurity/add_custom_error
...
Adding custom error.
2020-05-25 12:12:03 +02:00
FaricaUnknown
060a595244
Merge pull request #25 from crowdsecurity/json_extractor
...
add json support via expr helpers
2020-05-25 11:47:47 +02:00
Thibault bui Koechlin
ed24638200
fix remark
2020-05-25 11:37:52 +02:00
Thibault bui Koechlin
aad2e1421e
fix printf
2020-05-25 11:35:32 +02:00
erenJag
34a6156097
add custom error to be able to ignore or fatalF when reference is missing in collection
2020-05-25 10:55:05 +02:00
AlteredCoder
1b54bbb909
add data folder parameter to hubMgmt
2020-05-24 19:53:05 +02:00
AlteredCoder
1f91bd8af0
make var public
2020-05-24 19:17:03 +02:00
AlteredCoder
6757fa3cee
merge
2020-05-24 18:15:59 +02:00
Thibault bui Koechlin
1970a90813
debug is false in benchmark
2020-05-24 12:59:26 +02:00
Thibault bui Koechlin
88c72340e3
unique pattern names
2020-05-24 12:44:33 +02:00
Thibault bui Koechlin
aa9badc70c
reset stages
2020-05-24 12:41:45 +02:00
Thibault bui Koechlin
d601e21afb
working tests for json
2020-05-23 13:22:43 +02:00
AlteredCoder
74dd723ebf
fix
2020-05-22 18:24:54 +02:00
AlteredCoder
f8821b8982
fix dev config
2020-05-22 18:22:43 +02:00
Thibault bui Koechlin
32f32b41c7
add json support via expr helpers
2020-05-22 18:12:33 +02:00
AlteredCoder
019c8d3e18
fix package config name
2020-05-22 17:45:08 +02:00
AlteredCoder
62daa98bf3
add new helpers
2020-05-22 13:55:48 +02:00
Thibault bui Koechlin
ada5d3fcfe
explain linter bypasses
2020-05-22 10:12:35 +02:00
Thibault bui Koechlin
e86b163ba5
linter fixes
2020-05-20 18:05:05 +02:00
Thibault bui Koechlin
e643bb5b31
linter fixes, inefficient assignments
2020-05-20 17:50:56 +02:00
Thibault bui Koechlin
e6cad40ac4
more linting fixes
2020-05-20 11:26:21 +02:00
Thibault bui Koechlin
fe68914628
more linter fixes (simplicity mostly)
2020-05-20 11:00:25 +02:00
Thibault bui Koechlin
db9e1e280d
fix linter warnings : dead code, simplification
2020-05-20 10:49:17 +02:00
Thibault bui Koechlin
604b97a519
LGMT fixes + avoid capitalizing fmt.Errorf strings
2020-05-19 21:31:06 +02:00
Thibault bui Koechlin
3d2d39e77d
up
2020-05-15 12:13:57 +02:00
Thibault bui Koechlin
eb0b49cbbc
up
2020-05-15 11:49:17 +02:00
Thibault bui Koechlin
58a9bb0bc0
rename
2020-05-15 11:42:56 +02:00
Thibault bui Koechlin
2016167654
initial import
2020-05-15 11:39:16 +02:00
