Commit graph

336 commits

Author SHA1 Message Date
Anton Petrov
bf23e9c193 Fix NPE if no offsets were found for specified timestamp 2020-08-11 17:23:37 +03:00
66632
dd5389cb1c Increased version in pom.xml 2020-08-05 13:26:31 +00:00
66632
7a4e7820f4 Increased version in pom.xml 2020-08-03 12:47:46 +00:00
German Osin
8057dc123f
Fixed bugs (#90)
* Fixed bugs

* More fixes
2020-08-03 15:40:58 +03:00
66632
bc2efc9bee Increased version in pom.xml 2020-08-03 07:50:57 +00:00
German Osin
f5bb336a75
Fixed initial config and docker images names (#89) 2020-08-03 10:39:19 +03:00
66632
cb0c1661da Increased version in pom.xml 2020-07-31 12:53:43 +00:00
Bulat Yusupov
ed08f278f9
moved tagging before creating release notes (#88)
Co-authored-by: Bulat Yusupov <byusupov@provectus.com>
2020-07-31 15:37:01 +03:00
66632
d96ec48cc3 Increased version in pom.xml 2020-07-31 12:08:47 +00:00
Bulat Yusupov
db6824d19e
Fixed ci/cd release notes (#87)
* initial commit

* added timestamps and email recipient

* Revert "added timestamps and email recipient"

This reverts commit 41085705

* added steps to Jenkins pipeline

* added steps to Jenkins pipeline

* added script for creating release notes

* fixed script for creating release notes

* fixed script for creating release notes

* Increased version

* Revert "Increased version"

This reverts commit 86949059

* added steps to Jenkins pipeline

* Increased version

* moved ci-cd from ci-cd branch to master

* Revert "Increased version"

This reverts commit 666ee948

* fixes in pipeline

* fixed version for docker

* fixed version for docker

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* added conditions to jenkinsfile

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* testing PR build

* fixed release_json.sh script

* fixed release_json.sh script

* fixed release_json.sh script

* testing PR build

* testing PR build

* testing PR build

Co-authored-by: Bulat Yusupov <byusupov@provectus.com>
Co-authored-by: 66632 <>
2020-07-31 14:46:08 +03:00
66632
f0559d0646 Increased version in pom.xml 2020-07-31 07:48:57 +00:00
Roman Nedzvetskiy
efc35a9cfb
Backend jmx metrics (#64)
* Start doing endpoint for jmx metrics

* Added endpoint for getting jmx metric per broker

* Cluster jmx metrics sum endpoit added

* Added endpoints for cluster metrics and broker metrics

* Cleared some code

* Fixed jmxmetrics names

* Changed to all values in metrics

* Removed redundant imports

* Renamed param constant

* Changed to calculate brokers and clusters metrics in one place

* Removed redundant imports

* Fixed some mistakes

* Replaced multiple method usage into single

* Fixed mulptiple call

* Removed cluster level metrics, now only broker-level metrics in cluster

* Just small fixes

* removed redundant variable

* Renamed method for cluster level metrics

* Fixed after PR and added sum for number cluster metrics by num and persec keywords in canonicalname

* Added metricdto object

* Added list of metrics to enum

* Renames and optimizings

* Renamed jmxmetrics objects param to metrics

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-07-30 14:03:07 +03:00
Roman Nedzvetskiy
66afaa4971
Added begin and end offset param (#78)
* Added begin and end offset param

* moved consumer to try with resources block

* Fixed some problems

* Moved to gettopicdetails

* Cleanup code

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
Co-authored-by: German Osin <german.osin@gmail.com>
2020-07-24 14:16:49 +03:00
Anton Petrov
5ad3f5ce79
Do not wait for a full batch if there's no messages in the topic (#77) 2020-07-09 12:40:39 +03:00
Anton Petrov
4ed5f2dd10
Add optional authentication (#67)
* Add optional authentication

* Add example config for Google OAuth
2020-07-07 14:46:33 +03:00
Roman Nedzvetskiy
84807405d6
Fixed issue with wrong parameter type (#65)
* Fixed issue with wrong parameter type

* Changed object to number

* Changede object to number jmx metrics

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-06-25 14:32:45 +03:00
Anton Petrov
fd60bdafa8
Text search for topic messages (#62)
* Text search for topic messages

* Code optimization
2020-06-23 14:01:14 +03:00
Roman Nedzvetskiy
32a09faa95
Added bytesIn/OutPerSec params for clusterMetrics object (#56)
* Added bytesIn/OutPerSec params for clusterMetrics object

* Removed redundant todos, cleaned imports

* Jmx connections moved to pool, methods moved to separate classes

* Added pool handling and returning methods

* Fix after previous PR comments - fixed result map, configured pool, removed redundant methods and code

* Removed redundant imports and empty initialization

* Removed fill method

* Closing connection replaced to destroyObject method

* Try catch block while returning object to pool was fixed

* Removed redundant logs and try catch

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-06-17 14:44:34 +03:00
Anton Petrov
5a0b23ed59
Fix messages waiting for empty topic (#60) 2020-06-15 13:12:56 +03:00
Anton Petrov
b60f2a357e
Feature/10 record deserialization (#57)
* Record deserialization

* Check avro schema for topic

* Fix sdp docker config

* Code cleanup

* Code review changes

* Move Avro schema name template to cluster-level config
2020-06-11 14:07:31 +03:00
Anton Petrov
465a3726e8
Feature/10 seek offsets (#54)
* Seek offsets

* Seek and limit
2020-06-02 14:08:22 +03:00
Anton Petrov
ec7c8bbf5e
Fix compilation error (#53) 2020-05-28 14:37:23 +03:00
Roman Nedzvetskiy
f3f6e74b1e
Backend for updating topics, fixed backend from another pr branches (#52)
* Backend for updating topics, fixed backend from another pr branches

* Changed caching of extendedAdminClient instances

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-05-28 14:18:22 +03:00
Roman Nedzvetskiy
9a5ffc9eb5
Added segmentSize for topic level (#48)
* Added segmentSize for topic level

* Added segmentSize to clusterMetrics object

* Added internalClusterState for storing clusterMetrics linked to cluster's brokersIds

* InternalBrokersMetrics param added to InternalClusterMetrics

* Changed topic segment counting logic by finding the partition leader, added partition collecting in topic

* Added segmentSize info to cluster, broker, topic and topicPartition level

* Reduce to map moved to clusterutil, leader moved in cache

* Cleared some code

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-05-28 13:11:50 +03:00
Anton Petrov
803f0be7d7
Topic messages API. Reactive consumer (#50)
* Topic messages API. Reactive consumer

* Topic messages API. Reactive consumer

* Review changes
2020-05-27 17:16:55 +03:00
soffest
0815739d79
Consumer group details view. (#18)
* Added concumer groups list with search.

* Added consumer group details view.

* Minor tweaks.

* Backend group details (#19)

* temp result commit

* consumer group details api done

* fixes

* changed calls from loop into vars, changed foreach to map

* changes

* removed redundant import

* Refactoring, fixed contract

* Fixed useless group query

* fix-consumer-groups-retaining-cluster-on-cluster-switch

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
Co-authored-by: German Osin <german.osin@gmail.com>
Co-authored-by: Azat Gataullin <gataniel@gmail.com>

* Add loader, fix details

* Add empty text for consumer groups

Co-authored-by: Sofia Shnaidman <sshnaidman@provectus.com>
Co-authored-by: Roman Nedzvetskiy <gmcodemail@gmail.com>
Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
Co-authored-by: German Osin <german.osin@gmail.com>
Co-authored-by: Azat Gataullin <gataniel@gmail.com>
Co-authored-by: Maxim Tereshin <tereshin93@gmail.com>
2020-05-21 14:09:59 +03:00
Anton Petrov
7813c5e5ab Topic messages API. Contract 2020-05-12 19:02:55 +03:00
Roman Nedzvetskiy
5b4a9c5a03
GetBrokers endpoint fixed, now returns just brokers ids, also removed id param from Cluster and KafkaCluster (#46)
Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-05-12 14:12:50 +03:00
Azat Gataullin
5d0b783abb
issue-31/add-ui-prefix-for-react-routes (#34)
* issue-31/add-ui-prefix-for-react-routes

* added route for /ui path (#40)

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>

Co-authored-by: Roman Nedzvetskiy <gmcodemail@gmail.com>
Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-04-28 14:17:52 +03:00
Roman Nedzvetskiy
b2465775e5
Refactor for mono (#28)
* starting refactor mono

* topics and cluster refactored into mono way instead of get

* fixed dirty mistakes

* param

* changed collecttopicdata method to correctly

* refactored metrics to copyonwrite methoology

* metrics params updated

* fixed silly mistake

* Let's think immutable

* immutable

* dumb mistakes fixed

* changed to immutable

* added new mappers

* changed to immutable

* typo was fixed

* imports were cleared

* Refactored

* imports were optimized

Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
Co-authored-by: German Osin <german.osin@gmail.com>
2020-04-24 11:15:58 +03:00
soffest
c26edd1316
WIP: Consumer groups list with search. (#17)
* Added concumer groups list with search.

* added endpoint for group consumers

* removed redundand code and imports

* changed method to async mono

* method located better

* changes after review

* changed foreach to map

Co-authored-by: Sofia Shnaidman <sshnaidman@provectus.com>
Co-authored-by: Roman Nedzvetskiy <roman@Romans-MacBook-Pro.local>
2020-04-07 11:15:48 +03:00
Zhenya Taran
8b64575bd5 use cluster name instead of cluster id 2020-03-01 16:07:33 +02:00
Zhenya Taran
01c2c8b20b add isr count and out of sync replicas count 2020-03-01 12:52:11 +02:00
Zhenya Taran
ef39834651 add swagger-ui on /swagger-ui.html 2020-03-01 12:08:26 +02:00
Zhenya Taran
6a15b18d4a fix build and issue with offline cluster 2020-02-27 15:28:57 +02:00
Yevgen Taran
498eb96bee
Feature/backend init (#3)
* move react-app to its own folder inside project

* move backend to kafka-ui repo

* setup react inside netty

* make application ready in 2 commands

* update readme

* update readme

* update readme

* update readme

* update profiles for application start inside (sdp profile) and outside docker (local profile)

* broker metrics endpoint

* topics endpoint start commit

* topics details endpoint start commit //
dependencies and versions fix

* small pom updates //
continue review fixes

* fix review issues //
save errors //
save connections and update connection logic //
save jmx, zookeeper, kafka statuses //
error with getting one topic doesn't fail others //
async metrics processing //
cluster data storage refactoring

* properties version extracting

* properties versions

* topic details

* remove jmx, topic details, topic configs

* create topic

* final fixes, topic creation

* topic creation ui fixes

* add check for cases when cluster is offline
2020-02-27 15:55:53 +03:00