Commit graph

414 commits

Author SHA1 Message Date
Roman Zabaluev
0ecf229be0
Revert "Increased version in pom.xml"
This reverts commit 3d2f885801.
2021-12-29 19:54:13 +03:00
github-actions
3d2f885801 Increased version in pom.xml 2021-12-29 16:42:40 +00:00
github-actions
ca1aeab02d Increased release 2021-12-29 16:42:37 +00:00
Roman Zabaluev
24f7e4c190
Fix NPE on producing a message (#1342) 2021-12-29 19:37:44 +03:00
Roman Zabaluev
108242aeb2
Fix healthchecks (#1339) 2021-12-29 13:20:34 +03:00
github-actions
460fc0ec14 Increased version in pom.xml 2021-12-27 10:16:10 +00:00
github-actions
d33150123a Increased release 2021-12-27 10:16:07 +00:00
Roman Zabaluev
32a2e753b0
Allow producing messages with an empty key/value
* [ISSUE 1046] UI allows to submit message with empty key & value (#1264)

* [ISSUE 1046] UI allows to submit message with empty key & value

* Update Contract

(cherry picked from commit 4b730eb288)

* Backend fix

* Refactoring

* Fix nullable & checkstyle

* Fix jsonnullable get

* Remove unnecessary check and add a test

Co-authored-by: Oleg Shur <workshur@gmail.com>
2021-12-24 19:00:27 +03:00
ValentinPrischepa
49285bee9b
Improve exception message about schema registry back compatibility
* [ISSUE-1250] Introduced new exception for attempt at creating new PROTOBUF/JSON schemas via a deprecated version of Schema Registry.

* [issue-1250] fixed formatting

* [ISSUE-1250] updated exception message
2021-12-23 10:43:10 +03:00
Roman Zabaluev
e34520f6e9
Implement LDAP authentication (#1173)
* Sync container versions in examples

* Add ldap required dependencies

* Create a separate package for security configs

* Fix annoying checkstyle line length

* Refactor auth security configuration setup

* Implement ldap authentication. Closes #1023

* Review fixes

* Review fixes
2021-12-22 18:18:59 +03:00
Roman Zabaluev
b2586c41a0
Fix CVE-2021-44228 (#1231)
* Fix CVE-2021-44228

* Get rid of log4j

* Fix build

* Migration logging properties

* Get rid of json logs. Leave commented for local debugging purposes
2021-12-22 15:53:46 +03:00
Ruslan Ibragimov
91ac0cb134
Docker: support ARM and M1 2021-12-18 03:53:52 +03:00
Ilya Kuramshin
2ce80f6d80
cluster storage usage removed from SchemaRegistryService (#1262)
Co-authored-by: iliax <ikuramshin@provectus.com>
2021-12-17 11:51:31 +03:00
Ilya Kuramshin
ec42c37f24
Ksql functionality reimplemented (#1161)
* Ksql functionality reimplemented

Co-authored-by: iliax <ikuramshin@provectus.com>
2021-12-13 13:16:47 +03:00
Anna Antipova
24b401d5ad
627: tests on crud kafka connectors (#866)
* #627 add class for Connectors List page

* #627 add class for testing of Connectors functionality

* #627 add step for create a Connector

* #627 add class for Connector View page

* #627 add test for updating connector

* #627 add test for delete connector

* #627 add class for create connector view

* #627 add connector creation steps

* #627 add step for visibility check

* #627 add api interaction to connector test

* #627 update connector config file

* #627 add api helpers to create connector test

* #627 add creating the connector

* #627 update delete Connector test

* #627 add api helpers to send messages

* #627 add before all and after all methods to use one topic for tests

* #627 get rid of duplicate Lombok version

* #627 add check that connector is visible in the connector's list

* #627 add class for update connector config

* #627 add steps to update connector test

* #627 add check that connector is updated

* #627 add separate config file to connector deletion test

* #627 add different tables for each config files

* #627 move api helpers to test from BeforeAll and AfterAll

* #627 refactor config names

* #627 add support for different operational systems

* #622 change command for docker image composing until issue #819 will be fixed

* #622 return the test because the topic deleting bug has been fixed

* merge conflict fixes

* #627 extract methods to the before all/after all

* #627 fix github action file

* #627 fix github action file

* #627 refactor connector update method

* #627 update api helpers

* #627 fix update connector config

* #627 merge conflict fixes

* #627 move delete topic instance to end of list

* #627 refactor FileUtils to use Apache Commons lib

* #627 reduce code duplication

* #627 add waiting step to update topic test

* #627 return of test skip

* save container logs on fail

* #627 testing that creating the connector works in PR check

* #627 change element for checking connector creation

* #627 check that connector deletion works in PR check

* #627 add check during connector creation

* #627 disable connector creation

* #627 move check to the view page

* #627 add steps to check that connector is created

* #627 pr check

* #627 add check after connector is created

* #627 add logging

* #627 add check before topic deletion

* #627 rename package with tests

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2021-12-09 12:55:26 +03:00
Ilya Kuramshin
c9811e4f60
Kafka API timeout fixes + doc (#1187)
*  kafka.admin-client-timeout set to 30s by default
* unused zookeeper.connection-timeout removed
* documentation to admin-client-timeout param added
2021-12-08 13:23:10 +03:00
Ilya Kuramshin
062367efcc
1. stacktrace field added to error responses (#1145)
1. stacktrace field added to error responses (#1145)
2. lastError added to Cluster responce
3. blocking metrics initialization on startup changed to async init (returned to prev behavior)
2021-11-30 13:07:51 +03:00
Ilya Kuramshin
4d3db7a7de
AdminClient creation error handling fix
1. AdminClient error logging added (#1136)
2. MetricsService error handling fixed
2021-11-29 12:44:49 +03:00
Ilya Kuramshin
d674808f3c
ISSUE-1128: Add respect to cluster's order in ClustersStorage (#1130)
* add respect to cluster's order in ClustersStorage
* minor cleaning
2021-11-26 14:50:32 +03:00
Ilya Kuramshin
0cc39fcd7f
using AdminClient for offsets retrieval instead of Consumer (#1123)
Co-authored-by: iliax <ikuramshin@provectus.com>
2021-11-24 14:44:26 +03:00
Ilya Kuramshin
43a0e383cf
Metrics & cache refactoring (#1036)
Metrics retrieval refactoring:
* metrics data moved to separate class with its own storage
* topics list pagination logic changed for better actuality
* some mappings moved to InternalXXX classed
2021-11-17 13:10:55 +03:00
Roman Zabaluev
e021d97194
Enable spring boot actuators 2021-11-12 14:23:03 +03:00
Si Tang
c986bc178c
Sanitize credentials in Kafka Connector configs
* #980: sanitize credentials in Kafka Connector configs. Add a warning to edit page when people try to edit configs with obfuscated field

* #980: make sanitizer patterns configurable

* #980 fix using stream pattern

Co-authored-by: Si Tang <si@indeed.com>
2021-10-30 13:42:08 +03:00
Ilya Kuramshin
627885d0ec
Metrics collection refactoring
* BE Services split:
* Unrelated logic moved from ClusterService to proper services
* KafkaCluster existence check moved to controllers level
* useless interfaces removed

* ConsumingService merged into MessagesService

* sonar fix

* PR fixes

* methods rename

* checkstyle fix

* wip

* wip

* wip

* wip

* wip

* wip

* getTopicDetails partitions set returned

* compilation fix

* Disk usage fields fixes

* typo & unused removal

* features retrieval returned

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-10-28 11:55:43 +03:00
Ilya Kuramshin
c5e5717a98
Handling for 404 responses from connect added (#1025)
* handling for 404 responses from connect added
* connector name uniqness check added (#1026)
2021-10-27 21:31:15 +03:00
Si Tang
7bd3fdd152
Upgrade Spring Boot to 2.5.6
* #931: upgrade Spring Boot to 2.5.6

* #931: add spring-boot-starter-validation dependency
2021-10-26 14:38:25 +03:00
Ilya Kuramshin
83fba5aca3
onTopicXXX methods refactored to use only cluster name. This is important because cluster instance send as parameter can be outdated in case of simultaneous updates (#1012) 2021-10-25 21:10:59 +03:00
Ilya Kuramshin
335e0ea983
ISSUE-993: Cluster names validation moved to ClustersProperties, added default n… (#1010) 2021-10-25 14:51:01 +03:00
German Osin
4339841771
Changed consumer groups request logic for better performance (#965)
* Changed consumer groups request logic for better performance

* Fixed checkstyle
2021-10-14 11:52:58 +03:00
Ilya Kuramshin
d0f63aeaa0
BE Services split (#964)
BE Services split:
* Unrelated logic moved from ClusterService to proper services
* KafkaCluster existence check moved to controllers level
* useless interfaces removed
2021-10-14 10:05:07 +03:00
Ilya Kuramshin
7abf5db187
unnecessary option passing removed (#958)
Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-10-11 15:46:17 +03:00
Ilya Kuramshin
b05da3373e
[BE Refactoring] Reactive admin client (#882)
* All AdminClient interactions moved to ReactiveAdminClient
2021-10-08 21:33:36 +03:00
Ilya Kuramshin
da477b2896
DTO suffix added to all generated models (#872)
Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-10-08 18:08:22 +03:00
Ademílson F. Tonato
962322f20f
Fix different lombok logging annotations
Fixes #938
2021-10-07 12:27:40 +03:00
Roman Zabaluev
9c48e5682a
Fix unsupported DESCRIBE_CONFIGS (#939) 2021-10-06 21:01:46 +03:00
github-actions
1f360ce8ab Increased version in pom.xml 2021-10-04 14:39:08 +00:00
github-actions
f2c8629ff6 Increased release 2021-10-04 14:39:04 +00:00
German Osin
07a9528d39
ISSUE-925 Added delete,compact topics config (#926)
* ISSUE-925 Added delete,compact topics config

* Fixed checkstyle
2021-10-04 17:19:25 +03:00
German Osin
683ab231f4
ISSUE-861 Context path fix (#917) 2021-10-01 20:26:40 +03:00
Ilya Kuramshin
6920a252ad
Server startup banner (#912)
* server startup banner added

* font changed

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-09-29 12:24:38 +03:00
Ilya Kuramshin
0bf8db5e52
Property to tune WebClient's max buffer sized added (#903)
* webclient.max-in-memory-buffer-size property added

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-09-25 14:39:14 +03:00
Ilya Kuramshin
928dbd7a77
Unnecessary casting removed from AvroFormatter to fix primitive values deserialization (#902)
* Unnecessary casting removed from AvroFormatter to prevent primitive values deserialization
2021-09-23 18:36:36 +03:00
German Osin
5e74bda56e
ISSUE-886 Schema registry multiple urls (#888) 2021-09-17 11:35:34 +03:00
German Osin
3c05b60313
ISSUE-876 Fixed array types to oneof for js support (#880) 2021-09-15 14:02:06 +03:00
German Osin
3d537f2bf1
ISSUE-876 Fixed nullable fields (#878) 2021-09-15 12:59:46 +03:00
German Osin
4c231980aa
ISSUE-876 Fixed avro json schema generation & deserializing (#877)
* ISSUE-876 Fixed avro json schema generation & deserializing

* Fixed checkstyle

* Fixed proto test
2021-09-15 11:21:05 +03:00
German Osin
43709cc3be
ISSUE-868 Fix group offsets reseting (#871)
* ISSUE-868 Fix group offsets reseting

* tests fixes

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-09-14 15:42:04 +03:00
Meysam Zarezadeh
64f957771c
ISSUE-849: Use a map between topics and message-names when using ProtobufFile (#854)
* Use a map between topics and message-names when using ProtobufFile
* Validate the given message names for the topics in ProtobufFileRecordSerDe
2021-09-13 09:20:40 +03:00
German Osin
4660bb8759
ISSUE-856 Fixed failing on null topic partitions (#857)
* ISSUE-856 Fixed failing on null topicpartitions

* Fixed checkstyle
2021-09-07 13:50:04 +03:00
github-actions
65884467cf Increased version in pom.xml 2021-09-02 09:47:18 +00:00