Commit graph

414 commits

Author SHA1 Message Date
Marat Gumarov
51438d4d53
issues/1402. Fixed error message on incompatible schema (#1919)
* issues/1402. Fixed error message on incompatible schema
* issues/1402. Fix checkstyle
2022-05-04 14:55:07 +03:00
Roman Zabaluev
4b907e1005
Fix schema name nullability on compatibility change (#1872)
* Fix schema name nullability on compatibility change

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Add nullable

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-04-22 03:57:30 +04:00
Roman Zabaluev
dbc5d0445c
Fix empty base path when forwarding to index page (#1874)
Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
2022-04-22 03:51:49 +04:00
Ilya Kuramshin
76c5fae4dd
Fixing AdminClients requesting stucking
* jmx metrics collection parallelized on elastic scheduler (#1836)
* explicitly setting publishing Scheduler for KafkaFuture-based Monos

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-04-18 12:22:14 +03:00
Naresh Kumar Reddy Gaddam
8d10eb69e8
Kafka Connect: Implement basic auth (#1754)
* [TRIVIAL]: Enable basic auth for kafka connect cluster

* Update README.md

Co-authored-by: Naresh Kumar Reddy <naresh.kumar.reddy@dnb.no>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-04-06 15:56:43 +04:00
Joseph DeChicchis
1796fd519b
Implement deserializing binary protobuf encoded message keys (#1729)
* Add protobufMessageNameForKeyByTopic option to config. Message keys are
deserialized using a protobuf schema if the config is set. Otherwise
message keys are treated as strings.

Closes #1699

* Add documentation around kafkaui's protobuf support

* Add protobufMessageNameForKey config option

* Update README with info about default types

* Imeplement support for protobufMessageNameForKeyByTopic

* fallback to FALLBACK_FORMATTER

* Add ability to publish message with protobuf key

* Change log levels to debug and add @Nullable annotations

* Attempt at fixing documentation workflow

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Roman Zabaluev <github@haarolean.dev>
2022-04-05 16:26:57 +04:00
Ilya Kuramshin
b4df8a73c8
[ISSUE-1773] Ksqldb 0.24 unexpected json stream ending workaround (#1791)
* Ksqldb 0.24 unexpected json stream ending workaround
* ksql db test added
* SchemaRegistryAwareRecordSerDe potential buffer underflow fixed
* SchemaRegistry magic bytes extracted to constants

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-04-04 18:16:26 +03:00
Ilya Kuramshin
e1f31d27c6
ISSUE-1613: Fix Topic not found error after new topic creation
* load topic after creation retry added
* TopicService.recreateTopic,cloneTopic formatting improved
* ALLOW_AUTO_CREATE_TOPICS_CONFIG set to false for all created consumers to avoid accidental topic creation

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-03-28 09:10:06 +03:00
Roman Zabaluev
8908d6839c
Get rid of zookeeper (#1726)
* Get rid of zookeeper

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix build

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Cleanup

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Review fixes

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Skip unwanted domain check for documentation flow

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-23 18:23:37 +03:00
ValentinPrischepa
ed1e2bd405
Clone topic functionality: backend (#1631)
* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-14 12:39:24 +03:00
Jonas Geiregat
07a7836773
Support clustered endpoint for Schema Registry (#1483)
* Add failover support for Schema Registry

* Base schema id on primary node

* Made code thread safe

* Remove unnecessary synchronize

* Remove duplicated url field with InternalSchemaRegistry

* Fix maven warnings about dynamic versioning (#1559)

* Bump @types/react-redux from 7.1.18 to 7.1.22 in /kafka-ui-react-app (#1462)

Bumps [@types/react-redux](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react-redux) from 7.1.18 to 7.1.22.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/react-redux)

---
updated-dependencies:
- dependency-name: "@types/react-redux"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @types/jest from 27.0.3 to 27.4.0 in /kafka-ui-react-app (#1458)

Bumps [@types/jest](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/jest) from 27.0.3 to 27.4.0.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/jest)

---
updated-dependencies:
- dependency-name: "@types/jest"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Console banner updated (#1319)

* banner changed to fix new name

* width adjusted to 80 to fit all terminals

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

* Add an example for SSL w/ kafka (#1568)

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ruslan Ibragimov <ruibragimov@provectus.com>

* Smart filters: Groovy script messages filter implementation (reopened) (#1547)

* groovy script messages filter added

* ISSUE-943: Topic messages tailing implementation (#1515)

* Topic messages tailing implementation

* Implemented topics sorting by size (#1539)

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

* [ISSUE-1512]Added sorting by topics size

* [ISSUE-1512]Added sorting by topics size

* Add sort by Size.Refactoring sort order

* correct a little mistake

* Improve test coverage

* got rid code dupliction

* refactoring

Co-authored-by: ValentinPrischepa <valentin.prischepa@gmail.com>
Co-authored-by: Anton Zorin <ant.zorin@gmail.com>
Co-authored-by: Oleg Shur <workshur@gmail.com>

* Implement recreating a topic

* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>

* Run the app in the container as a non-root user (#1575)

* Run as a non-root user. Fixes #1555

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix line break

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ruslan Ibragimov <94184844+5hin0bi@users.noreply.github.com>

* [FIXED issue/1545] added feedback to the user when a message content is copied to clipboard (#1570)

* added alert after "Copy to clipborad"

* moved main logic to useDataSaver

* fixed typographical mistake

* updated useDataSaver test

* made adaptive heigth in connectors config component (#1583)

Co-authored-by: Anton Zorin <zorii4@Antons-MacBook-Pro.local>

* Bump http-proxy-middleware from 2.0.1 to 2.0.3 in /kafka-ui-react-app (#1579)

Bumps [http-proxy-middleware](https://github.com/chimurai/http-proxy-middleware) from 2.0.1 to 2.0.3.
- [Release notes](https://github.com/chimurai/http-proxy-middleware/releases)
- [Changelog](https://github.com/chimurai/http-proxy-middleware/blob/master/CHANGELOG.md)
- [Commits](https://github.com/chimurai/http-proxy-middleware/compare/v2.0.1...v2.0.3)

---
updated-dependencies:
- dependency-name: http-proxy-middleware
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Allow running sonar within PR of a fork (#1581)

* Allow running sonar within PR of a fork

* remove github token from envs on mvn verify

* Wrap failover in Mono.as

* Use failoverable uri instead of primary node one for accessing the schemaregistry

* Added urls to similarly named configureWebClient methods

Co-authored-by: Jonas Geiregat (31198) <jonas.geiregat@tvh.com>
2022-03-14 12:27:49 +03:00
Roman Zabaluev
ea9a145583
Bump dependencies (#1664)
* Bump dependencies

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix tests

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-12 13:26:32 +03:00
Mohamad Choukair
f3c07b15e5
Fix zookeeper thread leaking (#1574)
* Issue #1472 Added protection to prevent infinite loops when connection is in error with zookeeper

* Issue #1472 Added protection to prevent infinite loops when connection is in error with zookeeper

* Issue #1472 Added protection to prevent infinite loops when connection is in error with zookeeper

* Issue #1472 corrected checkStyle error

* Issue #1472 corrected bug

* Get rid of a successful test

this will always fail since it's not an integration test

* Fix test

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-10 14:13:39 +03:00
Ilya Kuramshin
a8fc61dcff
Integration tests structure unified, unnecessary imports removed (#1711)
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-03-09 15:47:36 +03:00
Ilya Kuramshin
11c6ce25ff
KSQL SSE refactoring (#1479)
* sse refactoring

* checkstyle fix

* checkstyle fix

* refactor

* refactor

* api spec changes

* ReactiveAdminClient toMono fix

* fixes

* fixes

* fixes

* fixes

* small improvement

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Damir Abdulganiev <dabdulganiev@provectus.com>
2022-03-08 20:23:12 +03:00
Roman Zabaluev
8b07a332e6
Fix external resources loading for backend part (#1639)
Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-08 15:07:42 +03:00
Ilya Kuramshin
48d3c3828e
Implement topic existence check for MessagesService (#1694)
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-03-08 14:26:32 +03:00
Ilya Kuramshin
4651c5e308
Add "initializing" state to ServerStatus enum (#1652)
* * initializing status added to cluster
* MetricsCache initializing
* unuseful tests removed BrokerServiceTest

* checkstyle fix

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-02-24 14:18:24 +03:00
German Osin
cd24ff631e
Code optimisations (#1648)
* Code optimisations

Co-authored-by: German Osin <germanosin@Germans-MacBook-Pro.local>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: German Osin <germanosin@Germans-MBP.lan>
2022-02-22 14:49:33 +03:00
German Osin
4cc4175ef2
Minor issues fixes (#1646)
* Fixed minor issues

* fixed review bug

* fixed bug

Co-authored-by: German Osin <germanosin@Germans-MacBook-Pro.local>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-21 15:13:48 +03:00
Mohamad Choukair
e2a3b7b263
Added host & port brokers endpoint (backend) (#1553)
* Added port to endpoint brokers - Issue:1521

* Added port to endpoint brokers - Issue:1521

* Fixed code style - Issue:1521

* Fixed checkStyle violations - Issue:1521

* Issue #1521 added port to mapper

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
2022-02-17 19:23:15 +03:00
Roman Zabaluev
0e227bc0b0
Fix SR failing pending requests (#1609)
* Get rid of unnecessary duplicate check

* Fix typo

* Fix error code duplication

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Add defaultToGlobal, refactoring

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix response entity forwarding

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Additional fixes

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Revert unnecessary changes

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix error code value

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix test

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-17 18:46:52 +03:00
Ilya Kuramshin
b8c43f069e
RESTART_ALL_TASKS & RESTART_FAILED_TASKS actions implemented, small refactoring (#1601)
RESTART_ALL_TASKS & RESTART_FAILED_TASKS kafka connect actions implemented, small refactoring (#1601)
2022-02-17 13:25:46 +03:00
Ilya Kuramshin
b3ef8da446
ISSUE-897: SchemaRegistryAwareRecordSerDe refactor (#1593)
* SchemaRegistryAwareRecordSerDe refactor

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-17 13:15:27 +03:00
Jonas Geiregat
ce8627ea59
Fix hanging schema delete (#1360)
* Fix hanging schema delete

Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
Co-authored-by: Jonas Geiregat (31198) <jonas.geiregat@tvh.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-14 21:26:51 +03:00
Roman Zabaluev
a040a66f09
Run the app in the container as a non-root user (#1575)
* Run as a non-root user. Fixes #1555

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix line break

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: Ruslan Ibragimov <94184844+5hin0bi@users.noreply.github.com>
2022-02-09 17:59:22 +03:00
ValentinPrischepa
edabfca966
Implement recreating a topic
* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-09 16:05:08 +03:00
ValentinPrischepa
529cd0bd6e
Implemented topics sorting by size (#1539)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-09 15:35:33 +03:00
Ilya Kuramshin
772b878d90
ISSUE-943: Topic messages tailing implementation (#1515)
* Topic messages tailing implementation
2022-02-09 14:23:35 +03:00
Ilya Kuramshin
1699663bac
Smart filters: Groovy script messages filter implementation (reopened) (#1547)
* groovy script messages filter added
2022-02-09 13:28:27 +03:00
Ilya Kuramshin
6424a88aca
Console banner updated (#1319)
* banner changed to fix new name

* width adjusted to 80 to fit all terminals

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-08 12:42:15 +03:00
Ruslan Ibragimov
6ab0e40685
Fix maven warnings about dynamic versioning (#1559) 2022-02-07 13:40:43 +03:00
Ilya Kuramshin
81ecea1c91
Sanitizer disable property added (#1531) 2022-02-01 21:35:42 +03:00
ValentinPrischepa
42a004af1c
Implement sorting order for consumers page (#1526)
* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* Create parameters of request for sorting consumer groups. (backend)
2022-02-01 13:14:05 +03:00
ValentinPrischepa
7cdcacf5d5
Implement topics sorting (backend) (#1498)
* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-31 13:38:56 +03:00
ValentinPrischepa
540b8eb79b
Schema registry pagination and search
* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] fixed Checkstyle violation issue.

* WIP: Fixes some frontend issues just to build frontend

* WIP: Fixes fronted just to build it

* WIP: Fixes frontend to build it

* WIP: Schemas tests are failing

* WIP: List tests work

* WIP: Details test work

* WIP: Updates tests

* WIP: Fixes lint errors and comments

* WIP: Changes usePagination, some tests have warns

* WIP: Refreshes with query string works correctly

* cleanup

* WIP: cleanup

* WIP: cleanup

* WIP: Removes ThemeProvider from test as render function uses ThemeProvider

* WIP: Pagination + Search works correcly

* WIP: Cleanup

* WIP: Cleanup

* WIP: Cleanup

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Damir Abdulganiev <dabdulganiev@provectus.com>
Co-authored-by: Damir Abdulganiev <damupka@gmail.com>
2022-01-31 13:24:39 +03:00
aizerin
2c6a197cb3
LDAP: add admin auth and search filter (#1403)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-28 15:33:27 +03:00
Roman Zabaluev
afca54d374
Add missing readonly field (#1506)
Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-28 15:24:50 +03:00
Ilya Kuramshin
f85a340b79
ISSUE-1444: Additional params added to connector restart endpoint to be able to… (#1445)
* Additional params added to connector restart endpoint to be able to restart not only connector instance, but all its tasks
* RESTARTING state added to ConnectorTaskStatus
* Restart connector button rename

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-21 15:24:13 +03:00
Ruslan Ibragimov
79442a7e82
Change the way of release workflow (#1434)
* use version placeholders in pom.xml files

* add release drafter config and workflow

* update master workflow

* update release workflow

* update branch-deploy.yml workflow

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-21 10:47:48 +03:00
github-actions
45b9a10c7c Increased version in pom.xml 2022-01-20 17:35:47 +00:00
github-actions
857a13573a Increased release 2022-01-20 17:35:45 +00:00
Ilya Kuramshin
02b1fc5437
tmp volume declaration removed to prevent unnecessary anonymous volumes creation (#1401) 2022-01-19 14:46:01 +03:00
bystnik
0a7d64de78
URL decoding for cluster names (#1378)
Co-authored-by: Nikita Bystrov <n.bysterov>
2022-01-18 13:32:41 +03:00
Ilya Kuramshin
6828a41242
Consumer groups pagination (Backend) (#1318)
* consumer-groups endpoint with pagination added
* consumer group dto mappings moved to controller
* consumer groups loading logic refactored
2022-01-17 13:58:33 +03:00
Ilya Kuramshin
b54b20aa48
bytesOutPerSec metric added to topic (#1358)
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-10 11:13:38 +03:00
Ilya Kuramshin
40b5b52bd9
ISSUE-1347: system libs added to Dockerfile to support all compressions (#1350)
* libc6 & gcompat libs added to docker image to support all kafka compression codecs
* base image version specified explicitly

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-06 17:53:38 +03:00
github-actions
d87c2a5290 Increased version in pom.xml 2021-12-29 16:55:44 +00:00
github-actions
b506b59866 Increased release 2021-12-29 16:55:41 +00:00
Roman Zabaluev
a023284b0e
Revert "Increased release"
This reverts commit ca1aeab02d.
2021-12-29 19:54:14 +03:00