Commit graph

336 commits

Author SHA1 Message Date
Ilya Kuramshin
772b878d90
ISSUE-943: Topic messages tailing implementation (#1515)
* Topic messages tailing implementation
2022-02-09 14:23:35 +03:00
Ilya Kuramshin
1699663bac
Smart filters: Groovy script messages filter implementation (reopened) (#1547)
* groovy script messages filter added
2022-02-09 13:28:27 +03:00
Ilya Kuramshin
6424a88aca
Console banner updated (#1319)
* banner changed to fix new name

* width adjusted to 80 to fit all terminals

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-08 12:42:15 +03:00
Ruslan Ibragimov
6ab0e40685
Fix maven warnings about dynamic versioning (#1559) 2022-02-07 13:40:43 +03:00
Ilya Kuramshin
81ecea1c91
Sanitizer disable property added (#1531) 2022-02-01 21:35:42 +03:00
ValentinPrischepa
42a004af1c
Implement sorting order for consumers page (#1526)
* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* Create parameters of request for sorting consumer groups. (backend)
2022-02-01 13:14:05 +03:00
ValentinPrischepa
7cdcacf5d5
Implement topics sorting (backend) (#1498)
* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-31 13:38:56 +03:00
ValentinPrischepa
540b8eb79b
Schema registry pagination and search
* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] fixed Checkstyle violation issue.

* WIP: Fixes some frontend issues just to build frontend

* WIP: Fixes fronted just to build it

* WIP: Fixes frontend to build it

* WIP: Schemas tests are failing

* WIP: List tests work

* WIP: Details test work

* WIP: Updates tests

* WIP: Fixes lint errors and comments

* WIP: Changes usePagination, some tests have warns

* WIP: Refreshes with query string works correctly

* cleanup

* WIP: cleanup

* WIP: cleanup

* WIP: Removes ThemeProvider from test as render function uses ThemeProvider

* WIP: Pagination + Search works correcly

* WIP: Cleanup

* WIP: Cleanup

* WIP: Cleanup

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Damir Abdulganiev <dabdulganiev@provectus.com>
Co-authored-by: Damir Abdulganiev <damupka@gmail.com>
2022-01-31 13:24:39 +03:00
aizerin
2c6a197cb3
LDAP: add admin auth and search filter (#1403)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-28 15:33:27 +03:00
Roman Zabaluev
afca54d374
Add missing readonly field (#1506)
Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-28 15:24:50 +03:00
Ilya Kuramshin
f85a340b79
ISSUE-1444: Additional params added to connector restart endpoint to be able to… (#1445)
* Additional params added to connector restart endpoint to be able to restart not only connector instance, but all its tasks
* RESTARTING state added to ConnectorTaskStatus
* Restart connector button rename

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-21 15:24:13 +03:00
Ruslan Ibragimov
79442a7e82
Change the way of release workflow (#1434)
* use version placeholders in pom.xml files

* add release drafter config and workflow

* update master workflow

* update release workflow

* update branch-deploy.yml workflow

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-21 10:47:48 +03:00
github-actions
45b9a10c7c Increased version in pom.xml 2022-01-20 17:35:47 +00:00
github-actions
857a13573a Increased release 2022-01-20 17:35:45 +00:00
Ilya Kuramshin
02b1fc5437
tmp volume declaration removed to prevent unnecessary anonymous volumes creation (#1401) 2022-01-19 14:46:01 +03:00
bystnik
0a7d64de78
URL decoding for cluster names (#1378)
Co-authored-by: Nikita Bystrov <n.bysterov>
2022-01-18 13:32:41 +03:00
Ilya Kuramshin
6828a41242
Consumer groups pagination (Backend) (#1318)
* consumer-groups endpoint with pagination added
* consumer group dto mappings moved to controller
* consumer groups loading logic refactored
2022-01-17 13:58:33 +03:00
Ilya Kuramshin
b54b20aa48
bytesOutPerSec metric added to topic (#1358)
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-10 11:13:38 +03:00
Ilya Kuramshin
40b5b52bd9
ISSUE-1347: system libs added to Dockerfile to support all compressions (#1350)
* libc6 & gcompat libs added to docker image to support all kafka compression codecs
* base image version specified explicitly

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-06 17:53:38 +03:00
github-actions
d87c2a5290 Increased version in pom.xml 2021-12-29 16:55:44 +00:00
github-actions
b506b59866 Increased release 2021-12-29 16:55:41 +00:00
Roman Zabaluev
a023284b0e
Revert "Increased release"
This reverts commit ca1aeab02d.
2021-12-29 19:54:14 +03:00
Roman Zabaluev
0ecf229be0
Revert "Increased version in pom.xml"
This reverts commit 3d2f885801.
2021-12-29 19:54:13 +03:00
github-actions
3d2f885801 Increased version in pom.xml 2021-12-29 16:42:40 +00:00
github-actions
ca1aeab02d Increased release 2021-12-29 16:42:37 +00:00
Roman Zabaluev
24f7e4c190
Fix NPE on producing a message (#1342) 2021-12-29 19:37:44 +03:00
Roman Zabaluev
108242aeb2
Fix healthchecks (#1339) 2021-12-29 13:20:34 +03:00
github-actions
460fc0ec14 Increased version in pom.xml 2021-12-27 10:16:10 +00:00
github-actions
d33150123a Increased release 2021-12-27 10:16:07 +00:00
Roman Zabaluev
32a2e753b0
Allow producing messages with an empty key/value
* [ISSUE 1046] UI allows to submit message with empty key & value (#1264)

* [ISSUE 1046] UI allows to submit message with empty key & value

* Update Contract

(cherry picked from commit 4b730eb288)

* Backend fix

* Refactoring

* Fix nullable & checkstyle

* Fix jsonnullable get

* Remove unnecessary check and add a test

Co-authored-by: Oleg Shur <workshur@gmail.com>
2021-12-24 19:00:27 +03:00
ValentinPrischepa
49285bee9b
Improve exception message about schema registry back compatibility
* [ISSUE-1250] Introduced new exception for attempt at creating new PROTOBUF/JSON schemas via a deprecated version of Schema Registry.

* [issue-1250] fixed formatting

* [ISSUE-1250] updated exception message
2021-12-23 10:43:10 +03:00
Roman Zabaluev
e34520f6e9
Implement LDAP authentication (#1173)
* Sync container versions in examples

* Add ldap required dependencies

* Create a separate package for security configs

* Fix annoying checkstyle line length

* Refactor auth security configuration setup

* Implement ldap authentication. Closes #1023

* Review fixes

* Review fixes
2021-12-22 18:18:59 +03:00
Roman Zabaluev
b2586c41a0
Fix CVE-2021-44228 (#1231)
* Fix CVE-2021-44228

* Get rid of log4j

* Fix build

* Migration logging properties

* Get rid of json logs. Leave commented for local debugging purposes
2021-12-22 15:53:46 +03:00
Ruslan Ibragimov
91ac0cb134
Docker: support ARM and M1 2021-12-18 03:53:52 +03:00
Ilya Kuramshin
2ce80f6d80
cluster storage usage removed from SchemaRegistryService (#1262)
Co-authored-by: iliax <ikuramshin@provectus.com>
2021-12-17 11:51:31 +03:00
Ilya Kuramshin
ec42c37f24
Ksql functionality reimplemented (#1161)
* Ksql functionality reimplemented

Co-authored-by: iliax <ikuramshin@provectus.com>
2021-12-13 13:16:47 +03:00
Anna Antipova
24b401d5ad
627: tests on crud kafka connectors (#866)
* #627 add class for Connectors List page

* #627 add class for testing of Connectors functionality

* #627 add step for create a Connector

* #627 add class for Connector View page

* #627 add test for updating connector

* #627 add test for delete connector

* #627 add class for create connector view

* #627 add connector creation steps

* #627 add step for visibility check

* #627 add api interaction to connector test

* #627 update connector config file

* #627 add api helpers to create connector test

* #627 add creating the connector

* #627 update delete Connector test

* #627 add api helpers to send messages

* #627 add before all and after all methods to use one topic for tests

* #627 get rid of duplicate Lombok version

* #627 add check that connector is visible in the connector's list

* #627 add class for update connector config

* #627 add steps to update connector test

* #627 add check that connector is updated

* #627 add separate config file to connector deletion test

* #627 add different tables for each config files

* #627 move api helpers to test from BeforeAll and AfterAll

* #627 refactor config names

* #627 add support for different operational systems

* #622 change command for docker image composing until issue #819 will be fixed

* #622 return the test because the topic deleting bug has been fixed

* merge conflict fixes

* #627 extract methods to the before all/after all

* #627 fix github action file

* #627 fix github action file

* #627 refactor connector update method

* #627 update api helpers

* #627 fix update connector config

* #627 merge conflict fixes

* #627 move delete topic instance to end of list

* #627 refactor FileUtils to use Apache Commons lib

* #627 reduce code duplication

* #627 add waiting step to update topic test

* #627 return of test skip

* save container logs on fail

* #627 testing that creating the connector works in PR check

* #627 change element for checking connector creation

* #627 check that connector deletion works in PR check

* #627 add check during connector creation

* #627 disable connector creation

* #627 move check to the view page

* #627 add steps to check that connector is created

* #627 pr check

* #627 add check after connector is created

* #627 add logging

* #627 add check before topic deletion

* #627 rename package with tests

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2021-12-09 12:55:26 +03:00
Ilya Kuramshin
c9811e4f60
Kafka API timeout fixes + doc (#1187)
*  kafka.admin-client-timeout set to 30s by default
* unused zookeeper.connection-timeout removed
* documentation to admin-client-timeout param added
2021-12-08 13:23:10 +03:00
Ilya Kuramshin
062367efcc
1. stacktrace field added to error responses (#1145)
1. stacktrace field added to error responses (#1145)
2. lastError added to Cluster responce
3. blocking metrics initialization on startup changed to async init (returned to prev behavior)
2021-11-30 13:07:51 +03:00
Ilya Kuramshin
4d3db7a7de
AdminClient creation error handling fix
1. AdminClient error logging added (#1136)
2. MetricsService error handling fixed
2021-11-29 12:44:49 +03:00
Ilya Kuramshin
d674808f3c
ISSUE-1128: Add respect to cluster's order in ClustersStorage (#1130)
* add respect to cluster's order in ClustersStorage
* minor cleaning
2021-11-26 14:50:32 +03:00
Ilya Kuramshin
0cc39fcd7f
using AdminClient for offsets retrieval instead of Consumer (#1123)
Co-authored-by: iliax <ikuramshin@provectus.com>
2021-11-24 14:44:26 +03:00
Ilya Kuramshin
43a0e383cf
Metrics & cache refactoring (#1036)
Metrics retrieval refactoring:
* metrics data moved to separate class with its own storage
* topics list pagination logic changed for better actuality
* some mappings moved to InternalXXX classed
2021-11-17 13:10:55 +03:00
Roman Zabaluev
e021d97194
Enable spring boot actuators 2021-11-12 14:23:03 +03:00
Si Tang
c986bc178c
Sanitize credentials in Kafka Connector configs
* #980: sanitize credentials in Kafka Connector configs. Add a warning to edit page when people try to edit configs with obfuscated field

* #980: make sanitizer patterns configurable

* #980 fix using stream pattern

Co-authored-by: Si Tang <si@indeed.com>
2021-10-30 13:42:08 +03:00
Ilya Kuramshin
627885d0ec
Metrics collection refactoring
* BE Services split:
* Unrelated logic moved from ClusterService to proper services
* KafkaCluster existence check moved to controllers level
* useless interfaces removed

* ConsumingService merged into MessagesService

* sonar fix

* PR fixes

* methods rename

* checkstyle fix

* wip

* wip

* wip

* wip

* wip

* wip

* getTopicDetails partitions set returned

* compilation fix

* Disk usage fields fixes

* typo & unused removal

* features retrieval returned

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-10-28 11:55:43 +03:00
Ilya Kuramshin
c5e5717a98
Handling for 404 responses from connect added (#1025)
* handling for 404 responses from connect added
* connector name uniqness check added (#1026)
2021-10-27 21:31:15 +03:00
Si Tang
7bd3fdd152
Upgrade Spring Boot to 2.5.6
* #931: upgrade Spring Boot to 2.5.6

* #931: add spring-boot-starter-validation dependency
2021-10-26 14:38:25 +03:00
Ilya Kuramshin
83fba5aca3
onTopicXXX methods refactored to use only cluster name. This is important because cluster instance send as parameter can be outdated in case of simultaneous updates (#1012) 2021-10-25 21:10:59 +03:00
Ilya Kuramshin
335e0ea983
ISSUE-993: Cluster names validation moved to ClustersProperties, added default n… (#1010) 2021-10-25 14:51:01 +03:00