Commit graph

735 commits

Author SHA1 Message Date
blotus
25a2d528b0
Alerts flush: Optimization of the flush mechanism (batch and limit to one job) + add cscli alerts flush command (#1024)
- Don't allow running more than one alert flush job at a time to prevent runaway CPU usage in some case. (fix High CPU after Upgrade to 1.2.0 #1022)
 - Add a cscli alerts flush command to manually flush the alerts in the database (fixes Improvement/Manual flush mechanism #1023 ).
 - Enable cascading deletion on alerts as we upgraded ent: Deleting an alert in the database will automatically delete all related decisions, events and meta
 - Add an index on alerts.id to try to improve flush performance with very big sqlite database.
- Flush alert now operates in batch
2021-10-26 13:33:45 +02:00
Thibault "bui" Koechlin
76a80380e7
don't wait on tomb if no datasources were started (#1019) 2021-10-24 11:07:45 +02:00
Thibault "bui" Koechlin
3f99330b3d
Entgo 0.9 (#1018)
* update entgo & sqlite to latest version

* schema update
2021-10-22 16:15:57 +02:00
blotus
66919924d3
don't attempt to start crowdsec if LAPI has been disabled with debconf (#1016) 2021-10-22 10:49:44 +02:00
Shivam Sandbhor
a7b1c02bd5
Fix bugs in cloudwatch acq (#991)
* Fix bugs in cloudwatch acq

- Fix concurrent writes to map streamIndexes
- Fix multiple cases of modifying while iterating on slice.
- Fix order of fetching cloudwatch events.
- Remove `startup` hack.

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>

* Fix cloudwatch tests

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-10-22 10:35:05 +02:00
Manuel Sabban
0d075f32cd
fix perms in package installation (#1012)
* fix perms

Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-10-22 10:14:15 +02:00
mmetc
b6bce96350
remove plugins with "make clean" (#1015) 2021-10-22 10:12:27 +02:00
Manuel Sabban
f8e52f1a91
Merge pull request #2 from crowdsecurity/perms
typo
2021-10-18 17:16:51 +02:00
sabban
c41234e6e1 typo 2021-10-18 17:15:28 +02:00
Manuel Sabban
0f4b2881b6
Merge pull request #1 from crowdsecurity/perms
fix perms
2021-10-18 16:09:06 +02:00
sabban
b576fd7c66 fix perms 2021-10-18 15:58:07 +02:00
he2ss
4d4d6d802c
fix #1008 + regenerate localhost credentials on start (#1009) 2021-10-14 17:02:38 +02:00
Thibault "bui" Koechlin
3bb2128bf4
fix sort :/ (#1007) 2021-10-12 19:16:24 +02:00
Thibault "bui" Koechlin
1bd6b8f7b9
Multiple fixes (#1006)
* fix #1005 : timestamp in trigger timemachine buckets

* attempt at consistent bucket order for hubtest
2021-10-12 14:09:17 +02:00
Thibault "bui" Koechlin
2961a0ed02
ensure machineID is included early enough into the alert (#1004) 2021-10-11 15:02:16 +02:00
AlteredCoder
203be9bfbf
fix typo in cscli help command (#1001)
* fix typo in cscli help command

* Update hubtest.go
2021-10-08 16:53:02 +02:00
blotus
2bc9f33e12
add ParseUri() expr helper (#994) 2021-10-08 16:50:31 +02:00
alteredCoder
6bd80dbb86 update hubtest workflow 2021-10-07 16:45:28 +02:00
AlteredCoder
cc653ce0d7
Update README.md 2021-10-07 15:04:53 +02:00
AlteredCoder
3b4c773890
fix hubtest CI (#1000) 2021-10-05 12:13:57 +02:00
AlteredCoder
0ccc69696b
Break on success when alert already has decision (#997) (#999)
* Break on success when alert already has decision (#997)

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-10-05 11:30:34 +02:00
alteredCoder
079172568a fix the CI coverage generation 2021-10-05 10:19:19 +02:00
alteredCoder
5c7f873e18 fix the coverage badge generation 2021-10-05 10:15:12 +02:00
alteredCoder
1e200d99d8 fix hubtest CI for coverage 2021-10-05 10:02:59 +02:00
alteredCoder
285351f4f9 fix hubtest CI for coverage 2021-10-05 09:56:18 +02:00
AlteredCoder
37eedce72e
add functionnal test for hubtest (#996)
* add hubtest in functionnal test
2021-10-05 09:52:55 +02:00
alteredCoder
de87d0d951 fix badge coverage generation 2021-10-04 18:07:36 +02:00
Thibault "bui" Koechlin
af4bb350c0
hubtests revamp + cscli explain (#988)
* New hubtest CI for scenarios/parsers from the hub
 * New `cscli explain` command to visualize parsers/scenarios pipeline

Co-authored-by: alteredCoder <kevin@crowdsec.net>
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
Co-authored-by: he2ss <hamza.essahely@gmail.com>
Co-authored-by: Cristian Nitescu <cristian@crowdsec.net>
2021-10-04 17:14:52 +02:00
Thibault "bui" Koechlin
c2fd173d1e
fix node success logic (#993)
* fix node success logic : only fail node on child failure if mother node has no successfull grok
2021-09-28 17:58:07 +02:00
he2ss
fb308d5596
fix plugins logging in right level (#990) 2021-09-28 14:44:21 +02:00
he2ss
db5ffb0040
Update test env (#987)
* update test_env
2021-09-24 18:06:30 +02:00
Cristian Nitescu
9d2cd58f31
#975 Mysql default parser: parse also lines with using password NO (#976) 2021-09-24 10:49:49 +02:00
blotus
f0db3742de
fix usage of regex.Match in cloudwatch module (#986) 2021-09-23 13:52:05 +02:00
blotus
bd5c119f85
update golang.org/x/sys dep (#983) 2021-09-21 17:06:40 +02:00
blotus
e92862213e
allow coveralls job to fail, as it is down :( (#984) 2021-09-21 12:45:38 +02:00
he2ss
990599a0b5
update docker entrypoint script (#982) 2021-09-21 10:54:05 +02:00
Shivam Sandbhor
d10b5e2aa2
Update README.md (#974) 2021-09-15 15:43:01 +02:00
blotus
0ecfe75687
default to current GOOS in makefile (#973) 2021-09-14 15:42:34 +02:00
Thibault "bui" Koechlin
f5e54083c7
fix static build (#971)
* fix static build
2021-09-14 15:32:35 +02:00
Manuel Sabban
6b5f272c0a
Func tests (#970)
* stabilize func tests
* fix cold logs func tests
* add wait condition on mock server

Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-09-13 17:33:47 +02:00
he2ss
ff400c9bca
fix docker image + install whitelists on build (#968)
* fix docker image + install whitelists on build
2021-09-13 10:48:48 +02:00
Manuel Sabban
e929ba16de
add sleep (#969)
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-09-10 17:42:46 +02:00
he2ss
88846ac115
update docker image documentation + docker start script (#965)
* update docker image documentation  + docker start script
2021-09-10 14:59:22 +02:00
Shivam Sandbhor
cca76da2d6
Fix crash if plugin config is broken (#964)
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-09-10 14:25:34 +02:00
blotus
dd41c30fba
log more information if server returns non 200 status code (#966) 2021-09-10 14:24:17 +02:00
he2ss
e651379964
add jsonExtractUnescape Helper (#962)
* add jsonExtractUnescape Helper
2021-09-10 12:43:11 +02:00
Manuel Sabban
e67fad06d3
fix error (#960)
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-09-10 11:06:25 +02:00
blotus
652b75ee68
do no set hub_branch to master in docker (#956) 2021-09-10 09:44:06 +02:00
Manuel Sabban
e6afafa4d8
fix (#958)
Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-09-10 09:32:01 +02:00
Thibault "bui" Koechlin
21dfc784b1
remove config.patch on master (#957)
* remove config.patch on master

* fix functional tests for plugins : replace group by nobody's actual group

* fix mock http server
2021-09-09 19:12:44 +02:00