Commit graph

150 commits

Author SHA1 Message Date
iliax
83bccc1fb8 ISSUE-754: Backend for kafka ACLs 2022-10-25 00:59:56 +04:00
iliax
4f3ae69a77 ISSUE-2787:
1. Getting topic config defaults from server response
2. rm KafkaConstants
3. doc field added to TopicConfigDTO
2022-10-20 19:37:42 +04:00
Roman Zabaluev
2b5dd270e2
Implement Connectors sorting / backend (#2291)
Co-authored-by: Artem Kazlanzhy <akazlanzhy@provectus.com>
2022-10-14 13:16:29 +04:00
Ilya Kuramshin
19e38fb1bf
Msk serverless support (BE) (#2737)
Msk serverless support:
1. ReactiveAdminClient.loadBrokersConfig returns empty map if configs retrieval not supported by kafka backend
2. ReactiveAdminClient.toMone exception unwrapping added
3. FeatureService delete topics enabled set true by default
4. TopicCreationDTO.replicationFactor made optional


Co-authored-by: iliax <ikuramshin@provectus.com>
2022-10-13 22:30:07 +04:00
Marat Gumarov
6dff8f105e
Support prometheus as a metrics interface (#2190)
* Unified internal metric representation (RawMetric)
* Prometheus retriever implemented
* Jmx metrics formatted to jmx-exporter openmentrics format

Co-authored-by: Mohamad Choukair <mchoukair@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Daniel Ching <110129035+daching-provectus@users.noreply.github.com>
Co-authored-by: Daniel Ching <daching@provectus.com>
Co-authored-by: German Osin <germanosin@Germans-MacBook-Pro.local>
Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Ilya Kuramshin <iliax@proton.me>
2022-10-07 14:36:27 +04:00
Ilya Kuramshin
b19b9d82e9
Minor backend fixes (#2696)
Minor backend fixes:
1. InternalTopic.leader fiels filling fix
2. bytesIn/OutPerSec fields set to TopicDTO
3. "subject" property added to SR SchemaDescription
2022-10-03 17:16:55 +04:00
Ilya Kuramshin
2f786c080b
ISSUE-2080: Consumer groups not found for topic (#2628)
* Fixing consumers visibility when offsets not committed
Co-authored-by: iliax <ikuramshin@provectus.com>
2022-09-30 13:21:54 +04:00
Ilya Kuramshin
049b35fc99
Pluggable serde (#2125)
* checkstyle

* node version reverted

* api comments

* unused properties removed

* serde api fix

* renamings

* PR review fixes

* checkstyle fix

* PR fixes

* UUID serde tests added

* UUID serde tests added

* fixed due to review comments

* 1. kafka-ui-serde-api renamed 2. kafka-clients dependency removed from kafka-ui-serde-api module

* dep fix

* Add serde to send message component (#2620)

* Add serde to send message component

* adds serde selects to messages views

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Kristina Kiparoidze <kkiparoidze@provectus.com>
Co-authored-by: Oleg Shur <workshur@gmail.com>
2022-09-27 19:52:59 +04:00
Shubham Jain
6df2d0b602
Disable schemaType during schema edit (#2495)
* Disable schemaType during schema edit

Update Schema API documentation

closes #2197

* Apply suggestion


Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-09-15 05:07:45 +04:00
Sergiy-provectus
085dfec389
Make message timestamp format configurable (backend) (#2277)
* [2163] Make message timestamp format configurable

* [2163] Make message timestamp format configurable - PR comments update

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-30 16:28:59 +04:00
Daniel Ching
757bf9526e
Fixing bug 2243 - Replication Factor validation (#2370)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-08-08 14:36:12 -06:00
Oleg Shur
5296d42e88
Use pnpm (#2081)
* Migrate FE app to pnpm

* Fix node install cache

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-07-01 12:02:18 +03:00
Oleg Shur
1b71ccb975
Migrate React app to Vite (#2153)
* Ejected CRA

* Cleanup

* jest

* Cleanup

* refactor cluster widgets

* configure build

* configure build

* configure coverage

* Experiment with lazy

* add ace to vendor

* Cleanup
2022-06-15 16:59:02 +03:00
Ilya Kuramshin
396341dbf7
Backend: topic analysis (#1965)
* Topic Analyzer implementation

* small cleanup

* hourly stats added

* imports fix

* compilation fixes

* PR fixes

* PR fixes (renaming)

* tests compilation fix

* apis improved

* checkstyle fix

* renaming

* node version rollback

* Fix naming

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-06-14 15:31:00 +04:00
Ilya Kuramshin
c0b3ca3bc6
ISSUE-2083: New ksql endpoints added to replace deprecated (#2089)
* New Ksql apis created to replace deprecated
2022-06-01 15:40:46 +03:00
Roman Zabaluev
8393232a83
Fix version display (#2044) 2022-05-27 14:29:54 +04:00
Naresh Kumar Reddy Gaddam
8d10eb69e8
Kafka Connect: Implement basic auth (#1754)
* [TRIVIAL]: Enable basic auth for kafka connect cluster

* Update README.md

Co-authored-by: Naresh Kumar Reddy <naresh.kumar.reddy@dnb.no>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-04-06 15:56:43 +04:00
Roman Zabaluev
8908d6839c
Get rid of zookeeper (#1726)
* Get rid of zookeeper

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Fix build

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Cleanup

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Review fixes

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>

* Skip unwanted domain check for documentation flow

Signed-off-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-23 18:23:37 +03:00
ValentinPrischepa
ed1e2bd405
Clone topic functionality: backend (#1631)
* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

* [ISSUE-1013]Clone topic functionality

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-03-14 12:39:24 +03:00
Ilya Kuramshin
11c6ce25ff
KSQL SSE refactoring (#1479)
* sse refactoring

* checkstyle fix

* checkstyle fix

* refactor

* refactor

* api spec changes

* ReactiveAdminClient toMono fix

* fixes

* fixes

* fixes

* fixes

* small improvement

Co-authored-by: iliax <ikuramshin@provectus.com>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Damir Abdulganiev <dabdulganiev@provectus.com>
2022-03-08 20:23:12 +03:00
Ilya Kuramshin
4651c5e308
Add "initializing" state to ServerStatus enum (#1652)
* * initializing status added to cluster
* MetricsCache initializing
* unuseful tests removed BrokerServiceTest

* checkstyle fix

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-02-24 14:18:24 +03:00
Mohamad Choukair
e2a3b7b263
Added host & port brokers endpoint (backend) (#1553)
* Added port to endpoint brokers - Issue:1521

* Added port to endpoint brokers - Issue:1521

* Fixed code style - Issue:1521

* Fixed checkStyle violations - Issue:1521

* Issue #1521 added port to mapper

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Ilya Kuramshin <ilia-2k@rambler.ru>
2022-02-17 19:23:15 +03:00
Ilya Kuramshin
b8c43f069e
RESTART_ALL_TASKS & RESTART_FAILED_TASKS actions implemented, small refactoring (#1601)
RESTART_ALL_TASKS & RESTART_FAILED_TASKS kafka connect actions implemented, small refactoring (#1601)
2022-02-17 13:25:46 +03:00
ValentinPrischepa
edabfca966
Implement recreating a topic
* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

* [ISSUE-998][backend] Add functionality to re-create topic in one click

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-09 16:05:08 +03:00
ValentinPrischepa
529cd0bd6e
Implemented topics sorting by size (#1539)
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-02-09 15:35:33 +03:00
Ilya Kuramshin
772b878d90
ISSUE-943: Topic messages tailing implementation (#1515)
* Topic messages tailing implementation
2022-02-09 14:23:35 +03:00
Ilya Kuramshin
1699663bac
Smart filters: Groovy script messages filter implementation (reopened) (#1547)
* groovy script messages filter added
2022-02-09 13:28:27 +03:00
Ruslan Ibragimov
6ab0e40685
Fix maven warnings about dynamic versioning (#1559) 2022-02-07 13:40:43 +03:00
ValentinPrischepa
42a004af1c
Implement sorting order for consumers page (#1526)
* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* Create parameters of request for sorting consumer groups. (backend)
2022-02-01 13:14:05 +03:00
ValentinPrischepa
7cdcacf5d5
Implement topics sorting (backend) (#1498)
* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

* [ISSUE-1383]Create parameters of request for sorting topics. (backend)

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-31 13:38:56 +03:00
ValentinPrischepa
540b8eb79b
Schema registry pagination and search
* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] Implemented search and pagination for schema registry overview page.

* [ISSUE-1191, ISSUE-1208] fixed Checkstyle violation issue.

* WIP: Fixes some frontend issues just to build frontend

* WIP: Fixes fronted just to build it

* WIP: Fixes frontend to build it

* WIP: Schemas tests are failing

* WIP: List tests work

* WIP: Details test work

* WIP: Updates tests

* WIP: Fixes lint errors and comments

* WIP: Changes usePagination, some tests have warns

* WIP: Refreshes with query string works correctly

* cleanup

* WIP: cleanup

* WIP: cleanup

* WIP: Removes ThemeProvider from test as render function uses ThemeProvider

* WIP: Pagination + Search works correcly

* WIP: Cleanup

* WIP: Cleanup

* WIP: Cleanup

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
Co-authored-by: Damir Abdulganiev <dabdulganiev@provectus.com>
Co-authored-by: Damir Abdulganiev <damupka@gmail.com>
2022-01-31 13:24:39 +03:00
Ilya Kuramshin
f85a340b79
ISSUE-1444: Additional params added to connector restart endpoint to be able to… (#1445)
* Additional params added to connector restart endpoint to be able to restart not only connector instance, but all its tasks
* RESTARTING state added to ConnectorTaskStatus
* Restart connector button rename

Co-authored-by: iliax <ikuramshin@provectus.com>
2022-01-21 15:24:13 +03:00
Ruslan Ibragimov
79442a7e82
Change the way of release workflow (#1434)
* use version placeholders in pom.xml files

* add release drafter config and workflow

* update master workflow

* update release workflow

* update branch-deploy.yml workflow

Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2022-01-21 10:47:48 +03:00
github-actions
45b9a10c7c Increased version in pom.xml 2022-01-20 17:35:47 +00:00
github-actions
857a13573a Increased release 2022-01-20 17:35:45 +00:00
Ilya Kuramshin
6828a41242
Consumer groups pagination (Backend) (#1318)
* consumer-groups endpoint with pagination added
* consumer group dto mappings moved to controller
* consumer groups loading logic refactored
2022-01-17 13:58:33 +03:00
github-actions
d87c2a5290 Increased version in pom.xml 2021-12-29 16:55:44 +00:00
github-actions
b506b59866 Increased release 2021-12-29 16:55:41 +00:00
Roman Zabaluev
a023284b0e
Revert "Increased release"
This reverts commit ca1aeab02d.
2021-12-29 19:54:14 +03:00
Roman Zabaluev
0ecf229be0
Revert "Increased version in pom.xml"
This reverts commit 3d2f885801.
2021-12-29 19:54:13 +03:00
github-actions
3d2f885801 Increased version in pom.xml 2021-12-29 16:42:40 +00:00
github-actions
ca1aeab02d Increased release 2021-12-29 16:42:37 +00:00
github-actions
460fc0ec14 Increased version in pom.xml 2021-12-27 10:16:10 +00:00
github-actions
d33150123a Increased release 2021-12-27 10:16:07 +00:00
Roman Zabaluev
32a2e753b0
Allow producing messages with an empty key/value
* [ISSUE 1046] UI allows to submit message with empty key & value (#1264)

* [ISSUE 1046] UI allows to submit message with empty key & value

* Update Contract

(cherry picked from commit 4b730eb288)

* Backend fix

* Refactoring

* Fix nullable & checkstyle

* Fix jsonnullable get

* Remove unnecessary check and add a test

Co-authored-by: Oleg Shur <workshur@gmail.com>
2021-12-24 19:00:27 +03:00
Roman Zabaluev
fd83f190f5
Revert "[ISSUE 1046] UI allows to submit message with empty key & value (#1264)"
This reverts commit 4b730eb288.
2021-12-18 06:01:34 +03:00
Oleg Shur
4b730eb288
[ISSUE 1046] UI allows to submit message with empty key & value (#1264)
* [ISSUE 1046] UI allows to submit message with empty key & value

* Update Contract
2021-12-17 20:44:13 +03:00
Oleg Shur
7e5e8d9268
Redesign (#1045)
* Refactor topic creation

* Remove unused thunk

* Remove excess interface

* Add New page snapshot test

* Refactor new component tests

* Remove excess function

* Add typography variables and classes

* Add font families

* Implement custom button

* Get rid of enums

* Add theme

* Separate styles from logic

* Feature/layout redesign (#862)

* Refactor pages general layout

* Refactor breadcrumbs

* Refactor brokers metrics

* Fix toggle position

Co-authored-by: azat.belgibayev <azat.belgibayev@almatech.dev>

* add redesigned new menu item

* remove styles from theme

* update tests

* fix local and app wide styles

* add tests

* Add theme

* Add types to the styles

* update menu item prop prefixes, minor fixes

* add theme styles, move interface, update test, snapshot

* add optional styling

* add isActive props, propagate component, update tests

* remove button

* Revert "remove button"

This reverts commit 4a9c87d8d8.

* add tests for styled button

* remove ternary operator from style

* import styled from lib/

* Custom Inputs  (#890)

* Implement and test custom input

* Custom select (#896)

* Implement custom select

* Fix Metrics component (#914)

* Add styled table header cell component (#901)

* Redesign menu (#918)

* Finish styling menu

* Styled Table

* Fix styled table

* Allow custom buttons work as links

* Restyle Breadcrumb

* Topics list (#946)

* Redesign pagination

* Fix styled components usage

* Topic messages (#959)

* Topic Consumer Groups

* Message settings

* Finish styling indicators

* Style the dashboard

* Finish with the topics page

* Style consumer groups list

* Restyle the consumer group details

* Style alerts

* Style confirmation modal

* Update DangerZone.spec.tsx

* redesign schema registry

* Add Topic details snapshot

* Style Page Loader

* Style connectors list

* Style KSQL

* Remove all the classes from the styled components (#1049)

* Redesign topic form (#1051)

* Redesign connect details (#1053)

* Update types for styled-components (#1054)

* Redesign some minor forms in the app (#1062)

* Fix alert styles

* Get rid of bulma/layout styles

* Fix form styling

* Custom Switch component

* fix border-radius property of metrick widgets

* get rid of warnings in tests

* use jest-styled-components

* cleanup

* get rid of some bulma modules

* refactor metrics component

* get rid of JSON-tree. Json Editor redesign

* update proxy config

* Refactor Alerts component (#1124)

* Refactor tests (#1129)

* App layout update (#1127)

* ‘App-layout-update’

* toBeNull changed to toBeInDocument

* scss file removed

* App navbar layout update

* navbar test

* code smells local refactoring

* StyledMenuItem code smells refactoring

* StyledClusterTab code smells refactoring

* ConfirmationModalWrapper code smells refactoring

* input icon and label code smells refactoring

* navburger displaying fixed

* Get rid of classes

* fix code smells

* refactor styles

* refactor styles

Co-authored-by: Oleg Shuralev <workshur@gmail.com>

* Refactored Cluster nav (#1147)

* Update caniuse

* refactor Nav component

* Update sonars config

* refactor Nav component + specs

* Specs

* Feature/code smells removing (#1148)

* StyledSelect code smell refactoring

* SecondaryTabs code smell refactoring

* TextareaStyled code smell refactoring

* TableStyled code smell refactoring

* StyledTableHeaderCell code smell refactoring

* Add custom render with theme provider wrapper for testing lib (#1152)

* Added cleanupPolicy to topic details. Closes #999 (#1067)

* Rename "latest first" to "oldest first"

* Switch to redux-toolkit. Refactoring (#1171)

* Switch to redux-toolkit

* Fix #1207 (cherry-pick)

* refactor metrics (#1253)

Co-authored-by: Azat Belgibayev <belg.azat@gmail.com>
Co-authored-by: Alexander <mr.afigitelniychuvak@gmail.com>
Co-authored-by: azat.belgibayev <azat.belgibayev@almatech.dev>
Co-authored-by: sergei <scheremnov@provectus.com>
Co-authored-by: Alexander Krivonosov <31561808+GneyHabub@users.noreply.github.com>
Co-authored-by: Alina Miryuk <alinamiryuk@mail.ru>
Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com>
2021-12-15 12:10:36 +03:00
Ilya Kuramshin
ec42c37f24
Ksql functionality reimplemented (#1161)
* Ksql functionality reimplemented

Co-authored-by: iliax <ikuramshin@provectus.com>
2021-12-13 13:16:47 +03:00
Ilya Kuramshin
062367efcc
1. stacktrace field added to error responses (#1145)
1. stacktrace field added to error responses (#1145)
2. lastError added to Cluster responce
3. blocking metrics initialization on startup changed to async init (returned to prev behavior)
2021-11-30 13:07:51 +03:00