Commit graph

452 commits

Author SHA1 Message Date
Ilya Kuramshin
2f786c080b
ISSUE-2080: Consumer groups not found for topic (#2628)
* Fixing consumers visibility when offsets not committed
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-09-30 13:21:54 +04:00
Roman Zabaluev
7db55d5acf
Expose build info for actuator (#2583) 2022-09-28 15:56:03 +04:00
Ilya Kuramshin
97f1c639a3
1. fixing infinite recursion with cyclic references (#2640)
2. using record names in unions to make possible to use several record
3. tests refactored

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-09-28 14:08:17 +04:00
Ilya Kuramshin
049b35fc99
Pluggable serde (#2125)
* checkstyle

* node version reverted

* api comments

* unused properties removed

* serde api fix

* renamings

* PR review fixes

* checkstyle fix

* PR fixes

* UUID serde tests added

* UUID serde tests added

* fixed due to review comments

* 1. kafka-ui-serde-api renamed 2. kafka-clients dependency removed from kafka-ui-serde-api module

* dep fix

* Add serde to send message component (#2620)

* Add serde to send message component

* adds serde selects to messages views

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Kristina Kiparoidze <kkiparoidze@provectus.com>
Co-authored-by: Oleg Shur <workshur@gmail.com>
2022-09-27 19:52:59 +04:00
Ilya Kuramshin
d673ea63a1
Fixing infinite polls in ForwardRecordEmitter for topic where no record found for last offset (compact topic) (#2627)
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-09-22 09:19:00 +04:00
Roman Zabaluev
596f4233fc
Disable ldap beans auto configuration (#2605) 2022-09-19 16:32:47 +04:00
Roman Zabaluev
15d09751a6
Fix flaky backend test (#2592) 2022-09-16 05:37:28 +04:00
Daniel Ching
71aa44a3d3
Get rid of dockerfile-maven-plugin (#2594)
* Resolve #1932

Replacing spotify maven docker plugin to use fabric8 docker maven plugin instead

* Remove unused arg

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-09-16 05:30:55 +04:00
Roman Zabaluev
5db2c17994
Cognito logout + revamp (#1063)
* application yml example

* Update SSO guide

* Add cognito logout handler

* Fix annotations

* impl a separate config file for cognito

* cleanup

* Rollback auth.type change

* Add compose example

* Auth revamp

* Review suggestions

* Use configurationProperties, rename urls to uris
2022-09-15 05:36:21 +04:00
Daniel Ching
fc946a1dd1
Handle error message for schemas (#2520)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-09-15 05:00:46 +04:00
Jibin Philipose
9f32abcd09
New documentation for building and running without docker (#2574)
* New documentation for building and running without docker and some doc fixes and additions.

* Improvements in docs

* spell fix

* improvements in docs

* minor modification

* improvements
2022-09-15 04:38:05 +04:00
Roman Zabaluev
c8306f5970
Fix consumers sorting (#2447)
* Fix consumers sorting

* Fix tests

* Review fix

* Review suggestions
2022-09-02 16:27:33 +04:00
Sergiy-provectus
085dfec389
Make message timestamp format configurable (backend) (#2277)
* [2163] Make message timestamp format configurable

* [2163] Make message timestamp format configurable - PR comments update

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-30 16:28:59 +04:00
Roman Zabaluev
9e1f8d773f
Add a failover recovery for empty cluster versions (#2473)
* Add a failover recovery for empty cluster versions

* Review suggestions
2022-08-30 12:06:05 +04:00
Shubham Jain
01127d8f10
Fix SR subject encoding (#2483) (#2471) (#1995)
* Fix subject encoding frontend (#1995)

* Add tests for schemas with non ascii chars #1995

* Backend: Fix URL encoding while getting schemas (#2471)

Add Test for subject name with non ascii chars
Closes #1995

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-26 20:51:00 +04:00
Roman Zabaluev
5ac52efb7a
Fix transient jre CVEs (#2480) 2022-08-22 21:04:22 +04:00
MichaelGonzalezMurillo
a665fb4d83
Add an ability to build api without frontend based on a property (#2424) 2022-08-17 19:17:37 +04:00
Daniel Ching
757bf9526e
Fixing bug 2243 - Replication Factor validation (#2370)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-08 14:36:12 -06:00
MichaelGonzalezMurillo
7f74bf312a
fix #2322 (#2410)
Do not display broker error as "none"
2022-08-08 11:20:34 -06:00
MichaelGonzalezMurillo
122f90fbb2
fixes #1622 (#2398)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-05 12:27:44 -06:00
Roman Zabaluev
38d795d5a0
Drop unnecessary maven scripts (#1857)
* Drop unnecessary maven scripts

* Get rid of unnecessary files
2022-08-03 16:54:20 +04:00
MichaelGonzalezMurillo
27252393a2
CVE fixes Q2.22 (#2357)
* upgrading alpine to fix CVE-2022-28391 vulnerabilities

* bumping spring-boot-version which includes vulnerabilities fixes

* Bumping one more version to clean high vulnerabilities up u

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-03 15:50:53 +04:00
Oleg Shur
c4f97327c0
Make frontend work properly with custom context url (#2363)
* Add an ability to run app from subfolder

* linting

* Fix all the static resources URLs and manifest.json

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-01 20:47:49 +04:00
Roman Zabaluev
541e4018ec
Active Directory support for LDAP (#2056)
* AD support for LDAP

* Review suggestions, documentation update
2022-07-15 18:06:49 +04:00
Artem Kazlanzhy
cbd4e4a52a
KSQLDB: Support Basic Auth (#2247)
* Support basic authentication for KSQL server

* Resolve mr issues

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-07-07 19:50:26 +04:00
Oleg Shur
5296d42e88
Use pnpm (#2081)
* Migrate FE app to pnpm

* Fix node install cache

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-07-01 12:02:18 +03:00
Artem Kazlanzhy
3e5093d101
Make max-in-memory configurable for webclients (#2139)
* Fix max-in-memory configuration for KsqlApiClient

* Fix tests, resolve mr comments

* Fix max-in-memory configuration for RetryingKafkaConnectClient

* Refactor KafkaConnectClients class

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-06-28 23:58:50 +04:00
Oleg Shur
1b71ccb975
Migrate React app to Vite (#2153)
* Ejected CRA

* Cleanup

* jest

* Cleanup

* refactor cluster widgets

* configure build

* configure build

* configure coverage

* Experiment with lazy

* add ace to vendor

* Cleanup
2022-06-15 16:59:02 +03:00
Ilya Kuramshin
396341dbf7
Backend: topic analysis (#1965)
* Topic Analyzer implementation

* small cleanup

* hourly stats added

* imports fix

* compilation fixes

* PR fixes

* PR fixes (renaming)

* tests compilation fix

* apis improved

* checkstyle fix

* renaming

* node version rollback

* Fix naming

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-06-14 15:31:00 +04:00
Ilya Kuramshin
2fcb0d1abe
Fix timeouts with huge amount of topics (#2019)
* partitioning getTopicsConfig & describeTopics calls for cases where topics count is big

* comments added

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-06-08 16:00:19 +04:00
Roman Zabaluev
c1bdbec2b2
Fix basic auth logout page (#2106) 2022-06-03 16:36:06 +04:00
Ilya Kuramshin
c0b3ca3bc6
ISSUE-2083: New ksql endpoints added to replace deprecated (#2089)
* New Ksql apis created to replace deprecated
2022-06-01 15:40:46 +03:00
Roman Zabaluev
8393232a83
Fix version display (#2044) 2022-05-27 14:29:54 +04:00
Ilya Kuramshin
6891138f15
ISSUE-1024: BackwardRecordEmitter fix (#1934)
BackwardRecordEmitter fix

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-05-19 18:34:04 +03:00
ValentinPrischepa
ae1a400255
Move DTO mappers to controllers (#1805)
* [ISSUE-949] moved mapper methods to controllers

* [ISSUE-949] Applied code review comments

* [ISSUE-949] fixed formatting issue

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-05-16 15:06:20 +04:00
Marat Gumarov
eb32b2eb2b
Configure jacoco reports to sonar (#1925)
* issues/1537. Added jacoco reports to sonar

* issues/1537. fixed sonar property

* issues/1537. fixed jacoco.xml path
2022-05-06 10:03:09 +03:00
Camal Cakar
068b1cbf62
Upgrade aws-msk-iam dependency (#1924)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-05-05 05:56:15 +04:00
LEE SUJIN
af7b27bcf8
Add actuator/health endpoints into auth whitelist (#1913)
Co-authored-by: sjlee <sjlee@mustit.co.kr>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-05-05 01:19:00 +03:00
Marat Gumarov
51438d4d53
issues/1402. Fixed error message on incompatible schema (#1919)
* issues/1402. Fixed error message on incompatible schema
* issues/1402. Fix checkstyle
2022-05-04 14:55:07 +03:00
Roman Zabaluev
4b907e1005
Fix schema name nullability on compatibility change (#1872)
* Fix schema name nullability on compatibility change

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Add nullable

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-04-22 03:57:30 +04:00
Roman Zabaluev
dbc5d0445c
Fix empty base path when forwarding to index page (#1874)
Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
2022-04-22 03:51:49 +04:00
Ilya Kuramshin
76c5fae4dd
Fixing AdminClients requesting stucking
* jmx metrics collection parallelized on elastic scheduler (#1836)
* explicitly setting publishing Scheduler for KafkaFuture-based Monos

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-04-18 12:22:14 +03:00
Naresh Kumar Reddy Gaddam
8d10eb69e8
Kafka Connect: Implement basic auth (#1754)
* [TRIVIAL]: Enable basic auth for kafka connect cluster

* Update README.md

Co-authored-by: Naresh Kumar Reddy <naresh.kumar.reddy@dnb.no>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-04-06 15:56:43 +04:00
Joseph DeChicchis
1796fd519b
Implement deserializing binary protobuf encoded message keys (#1729)
* Add protobufMessageNameForKeyByTopic option to config. Message keys are
deserialized using a protobuf schema if the config is set. Otherwise
message keys are treated as strings.

Closes #1699

* Add documentation around kafkaui's protobuf support

* Add protobufMessageNameForKey config option

* Update README with info about default types

* Imeplement support for protobufMessageNameForKeyByTopic

* fallback to FALLBACK_FORMATTER

* Add ability to publish message with protobuf key

* Change log levels to debug and add @Nullable annotations

* Attempt at fixing documentation workflow

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Roman Zabaluev <github@haarolean.dev>
2022-04-05 16:26:57 +04:00
Ilya Kuramshin
b4df8a73c8
[ISSUE-1773] Ksqldb 0.24 unexpected json stream ending workaround (#1791)
* Ksqldb 0.24 unexpected json stream ending workaround
* ksql db test added
* SchemaRegistryAwareRecordSerDe potential buffer underflow fixed
* SchemaRegistry magic bytes extracted to constants

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-04-04 18:16:26 +03:00
Ilya Kuramshin
e1f31d27c6
ISSUE-1613: Fix Topic not found error after new topic creation
* load topic after creation retry added
* TopicService.recreateTopic,cloneTopic formatting improved
* ALLOW_AUTO_CREATE_TOPICS_CONFIG set to false for all created consumers to avoid accidental topic creation

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-03-28 09:10:06 +03:00
Roman Zabaluev
8908d6839c
Get rid of zookeeper (#1726)
* Get rid of zookeeper

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix build

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Cleanup

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Review fixes

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Skip unwanted domain check for documentation flow

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-23 18:23:37 +03:00
ValentinPrischepa
ed1e2bd405
Clone topic functionality: backend (#1631)
* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-14 12:39:24 +03:00
Jonas Geiregat
07a7836773
Support clustered endpoint for Schema Registry (#1483)
* Add failover support for Schema Registry

* Base schema id on primary node

* Made code thread safe

* Remove unnecessary synchronize

* Remove duplicated url field with InternalSchemaRegistry

* Fix maven warnings about dynamic versioning (#1559)

* Bump @types/react-redux from 7.1.18 to 7.1.22 in /kafka-ui-react-app (#1462)

Bumps [@types/react-redux](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react-redux) from 7.1.18 to 7.1.22.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/react-redux)

---
updated-dependencies:
- dependency-name: "@types/react-redux"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @types/jest from 27.0.3 to 27.4.0 in /kafka-ui-react-app (#1458)

Bumps [@types/jest](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/jest) from 27.0.3 to 27.4.0.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/jest)

---
updated-dependencies:
- dependency-name: "@types/jest"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Console banner updated (#1319)

* banner changed to fix new name

* width adjusted to 80 to fit all terminals

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

* Add an example for SSL w/ kafka (#1568)

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ruslan Ibragimov <ruibragimov@provectus.com>

* Smart filters: Groovy script messages filter implementation (reopened) (#1547)

* groovy script messages filter added

* ISSUE-943: Topic messages tailing implementation (#1515)

* Topic messages tailing implementation

* Implemented topics sorting by size (#1539)

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

* [ISSUE-1512]Added sorting by topics size

* [ISSUE-1512]Added sorting by topics size

* Add sort by Size.Refactoring sort order

* correct a little mistake

* Improve test coverage

* got rid code dupliction

* refactoring

Co-authored-by: ValentinPrischepa <valentin.prischepa@gmail.com>
Co-authored-by: Anton Zorin <ant.zorin@gmail.com>
Co-authored-by: Oleg Shur <workshur@gmail.com>

* Implement recreating a topic

* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

* Run the app in the container as a non-root user (#1575)

* Run as a non-root user. Fixes #1555

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix line break

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ruslan Ibragimov <94184844+5hin0bi@users.noreply.github.com>

* [FIXED issue/1545] added feedback to the user when a message content is copied to clipboard (#1570)

* added alert after "Copy to clipborad"

* moved main logic to useDataSaver

* fixed typographical mistake

* updated useDataSaver test

* made adaptive heigth in connectors config component (#1583)

Co-authored-by: Anton Zorin <zorii4@Antons-MacBook-Pro.local>

* Bump http-proxy-middleware from 2.0.1 to 2.0.3 in /kafka-ui-react-app (#1579)

Bumps [http-proxy-middleware](https://github.com/chimurai/http-proxy-middleware) from 2.0.1 to 2.0.3.
- [Release notes](https://github.com/chimurai/http-proxy-middleware/releases)
- [Changelog](https://github.com/chimurai/http-proxy-middleware/blob/master/CHANGELOG.md)
- [Commits](https://github.com/chimurai/http-proxy-middleware/compare/v2.0.1...v2.0.3)

---
updated-dependencies:
- dependency-name: http-proxy-middleware
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Allow running sonar within PR of a fork (#1581)

* Allow running sonar within PR of a fork

* remove github token from envs on mvn verify

* Wrap failover in Mono.as

* Use failoverable uri instead of primary node one for accessing the schemaregistry

* Added urls to similarly named configureWebClient methods

Co-authored-by: Jonas Geiregat (31198) <jonas.geiregat@tvh.com>
2022-03-14 12:27:49 +03:00
Roman Zabaluev
ea9a145583
Bump dependencies (#1664)
* Bump dependencies

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix tests

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-12 13:26:32 +03:00