Commit graph

69 commits

Author SHA1 Message Date
Ilya Kuramshin
6828a41242
Consumer groups pagination (Backend) (#1318)
* consumer-groups endpoint with pagination added
* consumer group dto mappings moved to controller
* consumer groups loading logic refactored
2022-01-17 13:58:33 +03:00
Roman Zabaluev
32a2e753b0
Allow producing messages with an empty key/value
* [ISSUE 1046] UI allows to submit message with empty key & value (#1264)

* [ISSUE 1046] UI allows to submit message with empty key & value

* Update Contract

(cherry picked from commit 4b730eb288)

* Backend fix

* Refactoring

* Fix nullable & checkstyle

* Fix jsonnullable get

* Remove unnecessary check and add a test

Co-authored-by: Oleg Shur <workshur@gmail.com>
2021-12-24 19:00:27 +03:00
Roman Zabaluev
b2586c41a0
Fix CVE-2021-44228 (#1231)
* Fix CVE-2021-44228

* Get rid of log4j

* Fix build

* Migration logging properties

* Get rid of json logs. Leave commented for local debugging purposes
2021-12-22 15:53:46 +03:00
Ilya Kuramshin
43a0e383cf
Metrics & cache refactoring (#1036)
Metrics retrieval refactoring:
* metrics data moved to separate class with its own storage
* topics list pagination logic changed for better actuality
* some mappings moved to InternalXXX classed
2021-11-17 13:10:55 +03:00
Si Tang
c986bc178c
Sanitize credentials in Kafka Connector configs
* #980: sanitize credentials in Kafka Connector configs. Add a warning to edit page when people try to edit configs with obfuscated field

* #980: make sanitizer patterns configurable

* #980 fix using stream pattern

Co-authored-by: Si Tang <si@indeed.com>
2021-10-30 13:42:08 +03:00
Ilya Kuramshin
627885d0ec
Metrics collection refactoring
* BE Services split:
* Unrelated logic moved from ClusterService to proper services
* KafkaCluster existence check moved to controllers level
* useless interfaces removed

* ConsumingService merged into MessagesService

* sonar fix

* PR fixes

* methods rename

* checkstyle fix

* wip

* wip

* wip

* wip

* wip

* wip

* getTopicDetails partitions set returned

* compilation fix

* Disk usage fields fixes

* typo & unused removal

* features retrieval returned

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-10-28 11:55:43 +03:00
Ilya Kuramshin
c5e5717a98
Handling for 404 responses from connect added (#1025)
* handling for 404 responses from connect added
* connector name uniqness check added (#1026)
2021-10-27 21:31:15 +03:00
Ilya Kuramshin
335e0ea983
ISSUE-993: Cluster names validation moved to ClustersProperties, added default n… (#1010) 2021-10-25 14:51:01 +03:00
Ilya Kuramshin
d0f63aeaa0
BE Services split (#964)
BE Services split:
* Unrelated logic moved from ClusterService to proper services
* KafkaCluster existence check moved to controllers level
* useless interfaces removed
2021-10-14 10:05:07 +03:00
Ilya Kuramshin
b05da3373e
[BE Refactoring] Reactive admin client (#882)
* All AdminClient interactions moved to ReactiveAdminClient
2021-10-08 21:33:36 +03:00
Ilya Kuramshin
da477b2896
DTO suffix added to all generated models (#872)
Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-10-08 18:08:22 +03:00
Ilya Kuramshin
928dbd7a77
Unnecessary casting removed from AvroFormatter to fix primitive values deserialization (#902)
* Unnecessary casting removed from AvroFormatter to prevent primitive values deserialization
2021-09-23 18:36:36 +03:00
German Osin
3c05b60313
ISSUE-876 Fixed array types to oneof for js support (#880) 2021-09-15 14:02:06 +03:00
German Osin
3d537f2bf1
ISSUE-876 Fixed nullable fields (#878) 2021-09-15 12:59:46 +03:00
German Osin
4c231980aa
ISSUE-876 Fixed avro json schema generation & deserializing (#877)
* ISSUE-876 Fixed avro json schema generation & deserializing

* Fixed checkstyle

* Fixed proto test
2021-09-15 11:21:05 +03:00
German Osin
43709cc3be
ISSUE-868 Fix group offsets reseting (#871)
* ISSUE-868 Fix group offsets reseting

* tests fixes

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-09-14 15:42:04 +03:00
Meysam Zarezadeh
64f957771c
ISSUE-849: Use a map between topics and message-names when using ProtobufFile (#854)
* Use a map between topics and message-names when using ProtobufFile
* Validate the given message names for the topics in ProtobufFileRecordSerDe
2021-09-13 09:20:40 +03:00
German Osin
161d887e64
ISSUE-841 Fix null valued headers deserialization (#843) 2021-08-31 19:17:56 +03:00
German Osin
1b2b22f18a
ISSUE-832 Collect features not on startup (#834) 2021-08-27 17:09:59 +03:00
Marsel
5c563de4f1
Issue#727 disable deleting (#768)
* broker config refactoring and adding broker config check before topic deletion

* add TOPIC_DELETION feature, refactor KafkaService, add class for constants (Constants.java)

* annotation fixes and change TOPIC_DELETION check

* [issue-727] Disable delete button for a topic if deletion in restricted for this broker #727

* Rewrite to context

* remove code smells

* small fixes

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
Co-authored-by: mbovtryuk <mbovtryuk@provectus.com>
Co-authored-by: Alexander <mr.afigitelniychuvak@gmail.com>
2021-08-25 09:43:55 +03:00
Chrisss93
840bc5dcee
upgrade kafka dependencies (#791)
Co-authored-by: Chris Lee <chris.lee@ridewithvia.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2021-08-24 18:03:45 +03:00
Marsel
7f66f00008
Issue#517 connector task status bug (#747)
* kafka-ui-connectors.yaml fix

* adding tasks status check

* adding new Connector Status

* adding new Connector Status

* [issue-517] connector task status bug #747

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
Co-authored-by: mbovtryuk <mbovtryuk@provectus.com>
2021-08-18 12:03:41 +03:00
Ilnur Farukhshin
db578dc650 [#207] test(api): fix KsqlServiceTest 2021-08-12 12:38:02 +03:00
German Osin
18f5e1a2b2
Switched messages endpoint to provide sse with phases & consuming info (#645)
* Switched messages endpoint to provide sse with phases & consuming info

* Switched messages endpoint to provide sse with phases & consuming info

* fixed comments

* Fixed comparator

* Fixed tests

* Reduced images size

* Feature/sse for messages (#681)

* [#645] SSE. Cleanup Topic Messages

* New messages page

* Update outdated snapshots

* Specs

* Specs

* Fixed build

* Fixed possible npe in update cluster on init stage

* Provided additional information with messages #677 (to messages_sse branch) (#700)

* Provided additional information with messages #677

* Sse messages front (#725)

* SSE. Messages page

* Fix handleNextClick

* Add the page loader to the list of messages

Co-authored-by: Alexander <mr.afigitelniychuvak@gmail.com>

* Fix merge errors

* fix conflicts

Co-authored-by: Timur Davletov <tdavletov@provectus.com>
Co-authored-by: Oleg Shur <workshur@gmail.com>
Co-authored-by: Alexander <mr.afigitelniychuvak@gmail.com>
2021-08-04 16:30:00 +03:00
Diego Ching Jenkins
1f268579d0
Merge pull request #724 from provectus/703-additional-fields-topicConfig
703 additional fields topic config
2021-08-03 07:56:15 -06:00
Diego Ching
db1456abbd Adding assertNotNull instead of assertEquals 2021-08-03 07:36:53 -06:00
Victor Alfaro
51646e786a
666: Adding new endpoint with corresponding service method. Also a… (#714)
* (#666): Adding new endpoint with corresponding service method. Also adding search box to kafka connect screen with consuming logic for added endopoint.

* Applying feedback: reusing same endpoint and removing '/filtered' version
2021-08-03 16:08:55 +03:00
Diego Ching
b74a643c93 Adding new tests
Rebase from master, resolving conflicts
Adding new fields to builder
Removing unused import
2021-08-02 10:27:20 -06:00
Diego Ching
2a2e651d81 Adding new fields to TopicConfig
Adding tests for TopicConfigs consumer and service

Refactoring the tests

Fixing checkstyle violation
2021-08-02 08:32:06 -06:00
Timur Davletov
fa4ef337a7
#702 Supported incremental config update for brokers (#751) 2021-07-30 12:48:42 +03:00
Timur Davletov
2ab1601a7f
#708 Added log dirs alter operation (#723)
* #708 Added log dirs alter operation
2021-07-29 14:52:02 +03:00
Marsel
699512f706
Issue#701 brokers config (#730)
* adding getBrokerConfigs endpoint

* adding tests

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-29 13:50:44 +03:00
Ilnur Farukhshin
693cd475f3
Merge pull request #682 from provectus/issue207/ksqldb
Add KSQL DB support
2021-07-27 15:16:25 +03:00
Timur Davletov
29a3158df6
#707 Exposed broker log dirs (#720)
#707 Exposed broker log dirs
2021-07-27 13:03:21 +03:00
Ilnur Farukhshin
3bf5a08d3a Merge branch 'master' into issue207/ksqldb 2021-07-26 13:55:25 +03:00
Ilnur Farukhshin
232a17b80d [#207]: fix(api): clean up 2021-07-23 16:32:45 +03:00
Ilnur Farukhshin
82ce538488 [#207] fix(api): lint 2021-07-23 13:15:34 +03:00
Ilnur Farukhshin
c784fc87c4 [#207] fix(api): lint import 2021-07-23 13:04:01 +03:00
Ilnur Farukhshin
0434c48a2d [#207] fix(api): lint 2021-07-23 12:49:11 +03:00
Ilnur Farukhshin
d59b4e69f9 [#207] tests(api): added unit tests for KsqlService, KsqlCommandStrategies 2021-07-23 10:07:54 +03:00
Ildar Almakaev
5f4de1313d
Handle errors when creating topics and return custom one as BAD_REQUEST (#670) 2021-07-14 15:35:45 +03:00
Ilya Kuramshin
73d4e48941
Json Schema support (#651)
* Json schema support implementation

* comments & checkstyle

* unused mapper removed

* Explicit validation added

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-07-12 13:41:38 +03:00
Ilya Kuramshin
dd19cc2eec
Msg sending improvements (#640)
* init

* Messages sending fixes & tests

* Messages sending fixes & tests

* Messages sending json test added

* PR comments fixes

* Setting getTopicMessages & sendTopicMessage key value type to string.

* admin-client-timeout default removed

* sonar fix

* messages filtering changes to String.contains

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-07-09 15:53:30 +03:00
German Osin
71e1370deb
Provide topic offsets in list (#647) 2021-07-07 22:31:45 +03:00
Ilya Kuramshin
66228b00d5
#234: Consumer group offsets reset implementation (#605)
* junit4 annotations replaced with jupiter

* Consumer group offsets reset implementation

* comments added, Sonar warn fix

* minor cleanup

* checkstyle fix

* PR comments fix

* API doc fix

* API path renamed

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-07-05 14:32:01 +03:00
Marsel
09ebd03e71
Issue#314 partitions count increase (#579)
* adding topic's partitions count increase

* adding tests

* making pull request fixes

* making pull request fixes

* adding checkstyle fix

* pull request fixes

* adding cluster update after increasing partitions

* pull requset fix

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-02 14:38:22 +03:00
German Osin
97ec512b00
#122 Fix emitter to consume records in right order (#598)
* #122 Fix emitter to consume records in right order

* Fixed naming
2021-06-29 09:52:18 +03:00
German Osin
1460fef68e
ISSUE-502 Send messages & avro key deserializer (#582)
* ISSUE-502 Send messages & avro key deserializer

* Fixed sonarcube issue

* Fixed sonarcube issues

* Schema endpoint & fixes

* fixed sonar issue
2021-06-28 09:54:20 +03:00
Ildar Almakaev
5dd3944faa
Add API to delete consumer group by id (#578)
* [issue-516] Add API to delete consumer groups by IDs

* Add more tests to check consumer groups deletions

* Refactor and fix code style

* Fix codestyle

* Rethrow OperationInterruptedException with 500 error code if a thread is interrupted

* Use SneakyTrhrows to handle InterruptedException. Refactor

* Change deletion of groups API to single group delete

* Fix codestyle

* Rollback changes in kafka-ui-react-app/package-lock.json
2021-06-23 20:47:32 +03:00
German Osin
d3bf65cfb6
#122 Seek direction backend support (#562) 2021-06-18 11:56:14 +03:00