Commit graph

389 commits

Author SHA1 Message Date
Jakub Štiller
f156302c47 Remove default cluster configuration.
When this default cluster configuration is setup, user have to override complete first cluster. Eg have to set KAFKA_CLUSTERS_0_ZOOKEEPER to empty string to override default localhost.
2021-05-11 14:17:47 +03:00
German Osin
a427a55c30
ISSUE-408 Mark underscored topics as internal (#430)
* ISSUE-408 Mark underscored topics as internal

* ISSUE-408 Mark underscored topics as internal
2021-05-07 18:06:02 +03:00
Jakub Štiller
632bcd20e9 Use spring oauth2 starter as dependency to be able use various oauth2 providers. 2021-05-07 17:14:11 +03:00
Marat Adiyatullin
16e63f2c35 Add connect views 2021-05-03 13:33:53 +03:00
Ramazan Yapparov
f3c0866940
#187 added search and sorting (#388)
* - added search by topic name
- added filter by internal topics
- added sort by multiple columns
- added tests

* moved sorting later in the stream
2021-04-27 13:32:08 +03:00
Ramazan Yapparov
eef45fc6ab
#356 added endpoint to fetch all cluster connectors (#361)
* added endpoint to fetch all cluster connectors

* - refactoring code
- refactoring schema
- added connector class property
2021-04-15 11:15:25 +03:00
German Osin
7bfae45162
ISSUE-121 Topic level consumer groups & consumerr group details (#360) 2021-04-08 11:49:44 +03:00
Rustam Gimadiev
7bc01811c3
Display info about app version (#335)
* inject VERSION to npm build

* [issues#315] add new component VersionApp. Display application version in UI

* [CHORE] Adds info about app vesrsion

* fix mvn envs

* [CHORE] Cleanup and specs

Co-authored-by: mbovtryuk <mbovtryuk@provectus.com>
Co-authored-by: Oleg Shuralev <workshur@gmail.com>
2021-04-05 13:44:08 +03:00
Ildar Almakaev
e9a0a1af91
Get only numeric values of JMX metrics (#318)
* Use only numeric JMX metrics
* Propagate all exceptions from JmxClusterUtil.getJmxMetric to upper call
2021-03-31 12:34:43 +03:00
iliax
21a090f102
No such schema message formating fix (#316)
Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-03-25 14:15:34 +03:00
iliax
8d2f929a52
ISSUE-309: Topic create & update models split (#312)
* ISSUE-309: Topic create & update models split
2021-03-25 11:24:51 +03:00
iliax
31fe89d1c9
ISSUE-297: Sonar warnings fixes (#298)
* ISSUE-297: Sonar warnings fixes
2021-03-23 21:54:03 +03:00
iliax
106c42e4cc
ISSUE-257: ErrorResponse format description (#294)
* ISSUE-257: ErrorResponse format description & processing added
2021-03-23 16:44:57 +03:00
iliax
992e8b0898
#253: Get messages implementation improvement (#286)
* 1. End offsets check added to RecordEmitter
2. Tests for OffsetsSeek, RecordEmitter added

* Tests improvements

* ISSUE-257: checkstyle

* ISSUE-257: withSchemaType sonar fix

* ISSUE-257: withSchemaType sonar fix

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-03-23 14:55:04 +03:00
German Osin
590bdfb610
Added checkstyle (#296) 2021-03-23 10:55:28 +03:00
Ramazan Yapparov
217b363076
added features field to kafka cluster (#256) 2021-03-18 21:16:59 +03:00
Ramazan Yapparov
a8ed4ff37f
#188 added pagination for get topics api (#249)
* added pagination for get topics api

* frontend fix

* - fixed merge conflicts
- renamed pageSize to perPage
2021-03-15 21:37:36 +03:00
German Osin
909e196011
Feature refactoring, structure simplifying (#250) 2021-03-15 17:41:25 +03:00
Ramazan Yapparov
881a2167b7
#211 Feature/clear topic messages (#241)
* added delete action

* added test for delete action

* added 404 status in contract

* fixed typo

* added partition parameter

* big refactoring
2021-03-15 11:51:33 +03:00
Ildar Almakaev
e02dd84491
#200 Update schema subject object (#229)
* Return id, version, schema, and subject after creating a new schema

* Throw 422 error code if incoming new schema is unprocessable entity due to invalid fields

* Return 409/Conflict error code if schema is duplicate. Change endpoint of createNewSchema method

* Fix submitting new subject or new version if the subject already exists

* Include schema type to schema objects. By default it's AVRO

* [ISSUE-200] Update FE to support new version of api

* Add one more schema-registry with version 5.5.0 to docker-compose files and app properties

* Upgrade Confluent service versions in tests up to 5.5.0

* Set schemaType is required and ignore when submitting to Schema Registry if it's NULL

Co-authored-by: Oleg Shuralev <workshur@gmail.com>
2021-03-10 15:14:15 +03:00
Ramazan Yapparov
58df6c1a7e
#222 Fix npe in consumer (#223)
* add null handling
* replaced hashmaps with immutable map in deserializer returns
* added simple test for previously failing case
2021-03-09 17:15:12 +03:00
Ramazan Yapparov
e29ea3599d
updated confluent images versions to 5.2.4 (#226) 2021-03-09 16:53:06 +03:00
Ramazan Yapparov
a9cb9567d6
#224 added deleteTopic operation api (#228)
* added deleteTopic operation

* added not found response
2021-03-04 17:51:18 +03:00
Ramazan Yapparov
ae1acbce9b
added wrapping to mono (#227) 2021-03-04 17:24:56 +03:00
Ramazan Yapparov
be96bbc381
Testcontainers speedup and stabilization (#220)
* - moved testcontainers lifecycle control back to singleton
- changed kafka connect container wait strategy from logs to http

* refactoring

* reduced startup timeout to 5 minutes
2021-03-03 13:08:51 +03:00
Ramazan Yapparov
73f8991517
#164 readonly mode (#218)
* added ReadOnlyModeFilter

* added tests

* refactored kafka connect and schema registry tests
2021-03-01 19:51:58 +03:00
DementevNikita
4eb690d782
Fix kafka-ui image name in docker-compose file (#210)
* Fix kafka-ui image name in docker-compose file

* fix docker image name in pom.xml docker build section

* fix indentation
2021-03-01 15:20:20 +03:00
Ramazan Yapparov
377fa830c6
#163 Kafka connect crud (#182)
* - added kafka connect to docker-compose files
- added kafka connect property to application

* - added /connectors endpoint
- added /connectors/{name} endpoint

* - added /connectors/{name}/(restart/pause/resume) endpoints
- updated connector config model
- added FileStream connectors configs

* - added /connectors post endpoint

* - added all other kafka connect endpoints
- reverted config file

* - moved kafka connect related endpoints to separate tag/controller

* - added kafka connect container
- added simple test for kafka connect service
- added assertj dependency

* - added tests for KafkaConnectService

* - added more tests
- moved kafkaConnect rest client calls to separate class
- added validation

* - removed additional validation
- removed Client class
- removed client test and replaced with proper integration test
- added retries

* - cleanup

* moved to using generated kafka connect client

* updated rest schema

* added new maven clean plugin configuration so it deletes generated sources in kafka-ui-react-app/src directory

* changed restart/pause/resume action schema

* - added test
- refactoring

* added more error handling

* added more tests for error handling

* fixed schema registry tests

* changed /connect to /connects

* - fixed mutating connector object during getConnector request
- added new retrying kafka connect client with common retry logic
- fixed dependency scope

* - removed unnecessary `.cache()`

* - reverted testcontainers initialization code

* - added missing UNASSIGNED status to response enum

* - fixed configurations
- fixed testcontainers lifecycle management

* fixed application-local.yml
2021-02-26 15:48:04 +03:00
github-actions
655aa41a72 Increased version in pom.xml 2021-02-24 12:07:32 +00:00
Ildar Almakaev
6ec516345e
Issue-181 Refactor schema CRUD API (#192)
* Rename attribute 'schemaName' to 'subject' for consistency with Schema Registry terms

* Refactor 'GET /schemas' and 'GET .../schemas/{subject}/versions' to get the latest schemas data at once

* Fix getting error code from attributes in our custom GlobalErrorWebExceptionHandler
2021-02-15 11:52:44 +03:00
German Osin
b9e92114e6
Fixed Zookeeper connecion leak (#185) 2021-02-11 17:37:59 +03:00
Ildar Almakaev
ba4e1748ee
ISSUE-166 Pass ProtobufSchemaProvider to CachedSchemaRegistryClient to deserialize protobuf records (#178) 2021-02-10 22:28:32 +03:00
Ildar Almakaev
961d14454a
Add CRUD actions for Schema Registry service (#165)
* Map schema registry port to 8081 in kafka-clusters-only.yaml

* Add endpoint to retrieve subjects from schema registry by cluster name

* Add endpoint to retrieve subject versions from schema registry

* Get subject schema by version from schema-registry

* Add ability to create/delete schema subjects in/from schema-registry service

* Create WebClient bean and refactor its usage

* Refactor schema api contract

* Return 'Bad request' if there is 'Internal Server Error' from Schema Registry

* Add GET/PUT methods to get/update a schema compatibility level globally or only for a scepific schema

* Add SchemaRegistryContainer.java and testcontainers dependencies for integration tests

* Add junit-jupiter5 for testing

* Add GET/DELETE actions for the latest schema version

* Add endpoint to check schema compatibility

* Set up configuration for testing

* Add basic test for SchemaRegistryService

* Fix mapping from dto to web model

* Change createNewSchema action's endpoint

* Update tests in SchemaRegistryServiceTests

* Rename getLatestSchema method and update tests

* Add more test in SchemaRegistryServiceTests

* Include compatibility level info to schema response. Change Flux to Mono

* Update tests

* Pass schema-registry url for secondLocal cluster too

* Remove explicit returns of 404 status code (it'll be processed by global error handler)

* Add global error handler to response with exception details

* Autoconfigure WebTestClient in SchemaRegistryServiceTest
2021-02-09 10:40:11 +03:00
German Osin
481c321d06
ISSUE-169 Sort topics (#172) 2021-02-01 18:01:18 +03:00
66632
e2ca126354 Increased version in pom.xml 2021-01-22 11:14:20 +00:00
German Osin
c27dfb8ff9 Merge branch 'master' of github.com:provectus/kafka-ui 2021-01-20 14:38:05 +03:00
German Osin
4921f61457 Fixed npe 2021-01-20 14:37:52 +03:00
66632
c701a1763a Increased version in pom.xml 2021-01-20 09:40:13 +00:00
German Osin
1e249cb7a5 NPE check before metrics sum 2021-01-20 12:26:07 +03:00
German Osin
29887cb4e0 Hot fix polling 2020-12-14 13:08:57 +03:00
German Osin
cbc54f8416
Added custom properties & fixed reset policy (#134)
* Added custom properties support
2020-12-02 21:47:57 +03:00
soffest
9fd3697062
Kafka ui contract: Updated schemas required props. (#119)
* Updated schemas required props.

* Renamed long to int64 params

Co-authored-by: Sofia Shnaidman <sshnaidman@provectus.com>
Co-authored-by: German Osin <german.osin@gmail.com>
2020-11-19 15:38:28 +03:00
German Osin
d593e6f70e Fixed empty protobuf file 2020-11-12 14:16:43 +03:00
German Osin
238631ac0c
Protobuf support (#116)
* Added schema registry protobuf support

* Fixed detection

* Added support for local protobuf file

* Fixed minor issues
2020-11-10 09:43:28 +03:00
German Osin
3c196587a3
Fixed metrics and stats endpoints (#115) 2020-11-09 20:25:48 +03:00
German Osin
198c97403f
Update topic info after create/update ops (#114) 2020-11-09 14:24:45 +03:00
German Osin
88cc301bb6
Added common deserializer (#109) 2020-11-02 15:21:07 +03:00
66632
e9a6b52f2a Increased version in pom.xml 2020-10-30 15:00:38 +00:00
66632
2a743a5bf4 Increased version in pom.xml 2020-10-30 14:52:14 +00:00
66632
944fb19cb9 Increased version in pom.xml 2020-09-16 12:42:09 +00:00