0ct0pu5/kafka-ui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1637 commits 52 branches 38 tags 1.9 GiB
Commit graph

312 commits

Author SHA1 Message Date
Ilya Kuramshin
9a3cbfa14b
ISSUE-2787: Setting default config values properly (#2788) 
ISSUE-2787:
1. Getting topic config defaults from server response
2. rm KafkaConstants
3. doc field added to TopicConfigDTO
4. ReactiveAdminClient.SupportedFeature refactor
 2022-10-30 21:59:49 +04:00
Egorka Voronyansky
7044e57095
Drop deprecated methods (#2837) 
Co-authored-by: vrnsky <vrnsky@protonmail.com>
 2022-10-28 12:50:04 +04:00
iliax
c1d9f0183d ISSUE-754: UnsupportedVersionException handling added when trying check is ACL enabled 2022-10-26 14:33:32 +04:00
iliax
83bccc1fb8 ISSUE-754: Backend for kafka ACLs 2022-10-25 00:59:56 +04:00
Ilya Kuramshin
d60808a2f2
Drop deprecated ksql api (#2796) 
Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-10-23 19:49:11 +04:00
Ilya Kuramshin
4558466ff6
Emitters logic refactoring (#2729) 
* Emitters logic refactoring:
1. consumers seeking moved to SeekOperations class
2. offsets info gathering moved to OffsetsInfo class

* wip

* checkstyle fix

* checkstyle fix

* minor improvements

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-10-23 19:47:21 +04:00
iliax
86d931af75 ReactiveAdminClient.SupportedFeature refactor 2022-10-20 20:48:29 +04:00
iliax
4f3ae69a77 ISSUE-2787: 
1. Getting topic config defaults from server response
2. rm KafkaConstants
3. doc field added to TopicConfigDTO
 2022-10-20 19:37:42 +04:00
Ilya Kuramshin
63b6bb3fa1
ISSUE-2202: smart filters headers test added (#2763) 2022-10-17 16:24:14 +04:00
Roman Zabaluev
2b5dd270e2
Implement Connectors sorting / backend (#2291) 
Co-authored-by: Artem Kazlanzhy <akazlanzhy@provectus.com>
 2022-10-14 13:16:29 +04:00
Ilya Kuramshin
8b91f50af5 Smart filter offset binding (#2732) 
* adding "offset" var to smart filter binding

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-10-13 22:41:43 +04:00
Ilya Kuramshin
19e38fb1bf
Msk serverless support (BE) (#2737) 
Msk serverless support:
1. ReactiveAdminClient.loadBrokersConfig returns empty map if configs retrieval not supported by kafka backend
2. ReactiveAdminClient.toMone exception unwrapping added
3. FeatureService delete topics enabled set true by default
4. TopicCreationDTO.replicationFactor made optional


Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-10-13 22:30:07 +04:00
Marat Gumarov
6dff8f105e
Support prometheus as a metrics interface (#2190) 
* Unified internal metric representation (RawMetric)
* Prometheus retriever implemented
* Jmx metrics formatted to jmx-exporter openmentrics format

Co-authored-by: Mohamad Choukair <mchoukair@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Daniel Ching <110129035+daching-provectus@users.noreply.github.com>
Co-authored-by: Daniel Ching <daching@provectus.com>
Co-authored-by: German Osin <germanosin@Germans-MacBook-Pro.local>
Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Ilya Kuramshin <iliax@proton.me>
 2022-10-07 14:36:27 +04:00
Ilya Kuramshin
b19b9d82e9
Minor backend fixes (#2696) 
Minor backend fixes:
1. InternalTopic.leader fiels filling fix
2. bytesIn/OutPerSec fields set to TopicDTO
3. "subject" property added to SR SchemaDescription
 2022-10-03 17:16:55 +04:00
Ilya Kuramshin
2f786c080b
ISSUE-2080: Consumer groups not found for topic (#2628) 
* Fixing consumers visibility when offsets not committed
Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-09-30 13:21:54 +04:00
Ilya Kuramshin
97f1c639a3
1. fixing infinite recursion with cyclic references (#2640) 
2. using record names in unions to make possible to use several record
3. tests refactored

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-09-28 14:08:17 +04:00
Ilya Kuramshin
049b35fc99
Pluggable serde (#2125) 
* checkstyle

* node version reverted

* api comments

* unused properties removed

* serde api fix

* renamings

* PR review fixes

* checkstyle fix

* PR fixes

* UUID serde tests added

* UUID serde tests added

* fixed due to review comments

* 1. kafka-ui-serde-api renamed 2. kafka-clients dependency removed from kafka-ui-serde-api module

* dep fix

* Add serde to send message component (#2620)

* Add serde to send message component

* adds serde selects to messages views

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Kristina Kiparoidze <kkiparoidze@provectus.com>
Co-authored-by: Oleg Shur <workshur@gmail.com>
 2022-09-27 19:52:59 +04:00
Ilya Kuramshin
d673ea63a1
Fixing infinite polls in ForwardRecordEmitter for topic where no record found for last offset (compact topic) (#2627) 
Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-09-22 09:19:00 +04:00
Roman Zabaluev
596f4233fc
Disable ldap beans auto configuration (#2605) 2022-09-19 16:32:47 +04:00
Roman Zabaluev
15d09751a6
Fix flaky backend test (#2592) 2022-09-16 05:37:28 +04:00
Roman Zabaluev
5db2c17994
Cognito logout + revamp (#1063) 
* application yml example

* Update SSO guide

* Add cognito logout handler

* Fix annotations

* impl a separate config file for cognito

* cleanup

* Rollback auth.type change

* Add compose example

* Auth revamp

* Review suggestions

* Use configurationProperties, rename urls to uris
 2022-09-15 05:36:21 +04:00
Daniel Ching
fc946a1dd1
Handle error message for schemas (#2520) 
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-09-15 05:00:46 +04:00
Jibin Philipose
9f32abcd09
New documentation for building and running without docker (#2574) 
* New documentation for building and running without docker and some doc fixes and additions.

* Improvements in docs

* spell fix

* improvements in docs

* minor modification

* improvements
 2022-09-15 04:38:05 +04:00
Roman Zabaluev
c8306f5970
Fix consumers sorting (#2447) 
* Fix consumers sorting

* Fix tests

* Review fix

* Review suggestions
 2022-09-02 16:27:33 +04:00
Sergiy-provectus
085dfec389
Make message timestamp format configurable (backend) (#2277) 
* [2163] Make message timestamp format configurable

* [2163] Make message timestamp format configurable - PR comments update

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-08-30 16:28:59 +04:00
Roman Zabaluev
9e1f8d773f
Add a failover recovery for empty cluster versions (#2473) 
* Add a failover recovery for empty cluster versions

* Review suggestions
 2022-08-30 12:06:05 +04:00
Shubham Jain
01127d8f10
Fix SR subject encoding (#2483) (#2471) (#1995) 
* Fix subject encoding frontend (#1995)

* Add tests for schemas with non ascii chars #1995

* Backend: Fix URL encoding while getting schemas (#2471)

Add Test for subject name with non ascii chars
Closes #1995

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-08-26 20:51:00 +04:00
Daniel Ching
757bf9526e
Fixing bug 2243 - Replication Factor validation (#2370) 
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-08-08 14:36:12 -06:00
MichaelGonzalezMurillo
7f74bf312a
fix #2322 (#2410) 
Do not display broker error as "none"
 2022-08-08 11:20:34 -06:00
Oleg Shur
c4f97327c0
Make frontend work properly with custom context url (#2363) 
* Add an ability to run app from subfolder

* linting

* Fix all the static resources URLs and manifest.json

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-08-01 20:47:49 +04:00
Roman Zabaluev
541e4018ec
Active Directory support for LDAP (#2056) 
* AD support for LDAP

* Review suggestions, documentation update
 2022-07-15 18:06:49 +04:00
Artem Kazlanzhy
cbd4e4a52a
KSQLDB: Support Basic Auth (#2247) 
* Support basic authentication for KSQL server

* Resolve mr issues

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-07-07 19:50:26 +04:00
Artem Kazlanzhy
3e5093d101
Make max-in-memory configurable for webclients (#2139) 
* Fix max-in-memory configuration for KsqlApiClient

* Fix tests, resolve mr comments

* Fix max-in-memory configuration for RetryingKafkaConnectClient

* Refactor KafkaConnectClients class

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-06-28 23:58:50 +04:00
Ilya Kuramshin
396341dbf7
Backend: topic analysis (#1965) 
* Topic Analyzer implementation

* small cleanup

* hourly stats added

* imports fix

* compilation fixes

* PR fixes

* PR fixes (renaming)

* tests compilation fix

* apis improved

* checkstyle fix

* renaming

* node version rollback

* Fix naming

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-06-14 15:31:00 +04:00
Ilya Kuramshin
2fcb0d1abe
Fix timeouts with huge amount of topics (#2019) 
* partitioning getTopicsConfig & describeTopics calls for cases where topics count is big

* comments added

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-06-08 16:00:19 +04:00
Roman Zabaluev
c1bdbec2b2
Fix basic auth logout page (#2106) 2022-06-03 16:36:06 +04:00
Ilya Kuramshin
c0b3ca3bc6
ISSUE-2083: New ksql endpoints added to replace deprecated (#2089) 
* New Ksql apis created to replace deprecated
 2022-06-01 15:40:46 +03:00
Ilya Kuramshin
6891138f15
ISSUE-1024: BackwardRecordEmitter fix (#1934) 
BackwardRecordEmitter fix

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-05-19 18:34:04 +03:00
ValentinPrischepa
ae1a400255
Move DTO mappers to controllers (#1805) 
* [ISSUE-949] moved mapper methods to controllers

* [ISSUE-949] Applied code review comments

* [ISSUE-949] fixed formatting issue

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-05-16 15:06:20 +04:00
LEE SUJIN
af7b27bcf8
Add actuator/health endpoints into auth whitelist (#1913) 
Co-authored-by: sjlee <sjlee@mustit.co.kr>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-05-05 01:19:00 +03:00
Marat Gumarov
51438d4d53
issues/1402. Fixed error message on incompatible schema (#1919) 
* issues/1402. Fixed error message on incompatible schema
* issues/1402. Fix checkstyle
 2022-05-04 14:55:07 +03:00
Roman Zabaluev
4b907e1005
Fix schema name nullability on compatibility change (#1872) 
* Fix schema name nullability on compatibility change

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Add nullable

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-04-22 03:57:30 +04:00
Roman Zabaluev
dbc5d0445c
Fix empty base path when forwarding to index page (#1874) 
Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
 2022-04-22 03:51:49 +04:00
Ilya Kuramshin
76c5fae4dd
Fixing AdminClients requesting stucking 
* jmx metrics collection parallelized on elastic scheduler (#1836)
* explicitly setting publishing Scheduler for KafkaFuture-based Monos

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-04-18 12:22:14 +03:00
Naresh Kumar Reddy Gaddam
8d10eb69e8
Kafka Connect: Implement basic auth (#1754) 
* [TRIVIAL]: Enable basic auth for kafka connect cluster

* Update README.md

Co-authored-by: Naresh Kumar Reddy <naresh.kumar.reddy@dnb.no>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-04-06 15:56:43 +04:00
Joseph DeChicchis
1796fd519b
Implement deserializing binary protobuf encoded message keys (#1729) 
* Add protobufMessageNameForKeyByTopic option to config. Message keys are
deserialized using a protobuf schema if the config is set. Otherwise
message keys are treated as strings.

Closes #1699

* Add documentation around kafkaui's protobuf support

* Add protobufMessageNameForKey config option

* Update README with info about default types

* Imeplement support for protobufMessageNameForKeyByTopic

* fallback to FALLBACK_FORMATTER

* Add ability to publish message with protobuf key

* Change log levels to debug and add @Nullable annotations

* Attempt at fixing documentation workflow

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Roman Zabaluev <github@haarolean.dev>
 2022-04-05 16:26:57 +04:00
Ilya Kuramshin
b4df8a73c8
[ISSUE-1773] Ksqldb 0.24 unexpected json stream ending workaround (#1791) 
* Ksqldb 0.24 unexpected json stream ending workaround
* ksql db test added
* SchemaRegistryAwareRecordSerDe potential buffer underflow fixed
* SchemaRegistry magic bytes extracted to constants

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-04-04 18:16:26 +03:00
Ilya Kuramshin
e1f31d27c6
ISSUE-1613: Fix Topic not found error after new topic creation 
* load topic after creation retry added
* TopicService.recreateTopic,cloneTopic formatting improved
* ALLOW_AUTO_CREATE_TOPICS_CONFIG set to false for all created consumers to avoid accidental topic creation

Co-authored-by: iliax <ikuramshin@provectus.com>
 2022-03-28 09:10:06 +03:00
Roman Zabaluev
8908d6839c
Get rid of zookeeper (#1726) 
* Get rid of zookeeper

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix build

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Cleanup

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Review fixes

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Skip unwanted domain check for documentation flow

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-03-23 18:23:37 +03:00
ValentinPrischepa
ed1e2bd405
Clone topic functionality: backend (#1631) 
* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
 2022-03-14 12:39:24 +03:00