Commit graph

181 commits

Author SHA1 Message Date
Timur Davletov
2ab1601a7f
#708 Added log dirs alter operation (#723)
* #708 Added log dirs alter operation
2021-07-29 14:52:02 +03:00
Marsel
699512f706
Issue#701 brokers config (#730)
* adding getBrokerConfigs endpoint

* adding tests

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-29 13:50:44 +03:00
Ilnur Farukhshin
693cd475f3
Merge pull request #682 from provectus/issue207/ksqldb
Add KSQL DB support
2021-07-27 15:16:25 +03:00
Timur Davletov
29a3158df6
#707 Exposed broker log dirs (#720)
#707 Exposed broker log dirs
2021-07-27 13:03:21 +03:00
Ilnur Farukhshin
3bf5a08d3a Merge branch 'master' into issue207/ksqldb 2021-07-26 13:55:25 +03:00
Ilnur Farukhshin
d59b4e69f9 [#207] tests(api): added unit tests for KsqlService, KsqlCommandStrategies 2021-07-23 10:07:54 +03:00
Ilnur Farukhshin
fb68d19802 [#207] feat(api, contract): added strategies for statements, return message or data with datble as response 2021-07-20 15:39:34 +03:00
Marsel
cac9069774
Issue#634 clean up policy in topic list (#665)
* adding cleanup policy to InternalTopic

* adding CleanupPolicy enum

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-20 11:57:13 +03:00
Ilnur Farukhshin
3686e75c8f [#207] feat(api, contract): return ksql command result as table 2021-07-19 17:21:23 +03:00
Ilnur Farukhshin
3d5bbc854a [issue207] feat(api, contract): ksqldb controller, client, service, statement strategies 2021-07-15 15:05:34 +03:00
Roman Zabaluev
9b6952c480
Implements #610 (#673) 2021-07-14 11:08:42 +03:00
Bogdan Volodarskiy
b2f3561405
Merge branch 'master' into checks/447-creating-topic-via-api 2021-07-12 10:22:05 +03:00
German Osin
13463fe95f
Refactor consumer groups requests (#636)
* Refactor consumer groups requests

* Fixed offsets tests

* Moved state enum to separate class

* Adjust frontend for the new API

Co-authored-by: Alexander <mr.afigitelniychuvak@gmail.com>
2021-07-09 15:55:43 +03:00
Ilya Kuramshin
dd19cc2eec
Msg sending improvements (#640)
* init

* Messages sending fixes & tests

* Messages sending fixes & tests

* Messages sending json test added

* PR comments fixes

* Setting getTopicMessages & sendTopicMessage key value type to string.

* admin-client-timeout default removed

* sonar fix

* messages filtering changes to String.contains

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-07-09 15:53:30 +03:00
Marsel
df1d3bbfc7
adding sorting parameter (#646)
Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-07 18:50:27 +03:00
Marsel
0ec40dd7e4
Issue#314 replication factor change (#599)
* adding replication factor change feature

* adding comments for algorithm and some fixes

* small fix

* checkstyle fixes

* fix

* adding updateCluster endpoint and algorithm fixes

* hot fixes

* update algorithm and add brokers list to KafkaCluster

* pull request fix

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-07 17:59:52 +03:00
Ilya Kuramshin
66228b00d5
#234: Consumer group offsets reset implementation (#605)
* junit4 annotations replaced with jupiter

* Consumer group offsets reset implementation

* comments added, Sonar warn fix

* minor cleanup

* checkstyle fix

* PR comments fix

* API doc fix

* API path renamed

Co-authored-by: Ilya Kuramshin <ikuramshin@provectus.com>
2021-07-05 14:32:01 +03:00
German Osin
e3b2ea1052
Added cluster version to api (#609) 2021-07-02 15:33:52 +03:00
Marsel
09ebd03e71
Issue#314 partitions count increase (#579)
* adding topic's partitions count increase

* adding tests

* making pull request fixes

* making pull request fixes

* adding checkstyle fix

* pull request fixes

* adding cluster update after increasing partitions

* pull requset fix

Co-authored-by: marselakhmetov <makhmetov@provectus.com>
2021-07-02 14:38:22 +03:00
Oleg Shur
106bd8dfbf
Bump packages (#596)
* Bump prettier from 2.3.1 to 2.3.2 in /kafka-ui-react-app (#592)

Bumps [prettier](https://github.com/prettier/prettier) from 2.3.1 to 2.3.2.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prettier/prettier/compare/2.3.1...2.3.2)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @typescript-eslint/parser in /kafka-ui-react-app (#595)

Bumps [@typescript-eslint/parser](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser) from 4.27.0 to 4.28.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/master/packages/parser/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v4.28.0/packages/parser)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/parser"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @typescript-eslint/eslint-plugin in /kafka-ui-react-app (#594)

Bumps [@typescript-eslint/eslint-plugin](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin) from 4.27.0 to 4.28.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/master/packages/eslint-plugin/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v4.28.0/packages/eslint-plugin)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/eslint-plugin"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @types/react-dom from 17.0.7 to 17.0.8 in /kafka-ui-react-app (#593)

Bumps [@types/react-dom](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react-dom) from 17.0.7 to 17.0.8.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/react-dom)

---
updated-dependencies:
- dependency-name: "@types/react-dom"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump react-hook-form from 7.6.9 to 7.9.0 in /kafka-ui-react-app (#569)

Bumps [react-hook-form](https://github.com/react-hook-form/react-hook-form) from 7.6.9 to 7.9.0.
- [Release notes](https://github.com/react-hook-form/react-hook-form/releases)
- [Changelog](https://github.com/react-hook-form/react-hook-form/blob/master/CHANGELOG.md)
- [Commits](https://github.com/react-hook-form/react-hook-form/compare/v7.6.9...v7.9.0)

---
updated-dependencies:
- dependency-name: react-hook-form
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @hookform/resolvers from 2.5.2 to 2.6.0 in /kafka-ui-react-app (#570)

Bumps [@hookform/resolvers](https://github.com/react-hook-form/resolvers) from 2.5.2 to 2.6.0.
- [Release notes](https://github.com/react-hook-form/resolvers/releases)
- [Commits](https://github.com/react-hook-form/resolvers/compare/v2.5.2...v2.6.0)

---
updated-dependencies:
- dependency-name: "@hookform/resolvers"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix contract

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-28 18:43:04 +03:00
German Osin
1460fef68e
ISSUE-502 Send messages & avro key deserializer (#582)
* ISSUE-502 Send messages & avro key deserializer

* Fixed sonarcube issue

* Fixed sonarcube issues

* Schema endpoint & fixes

* fixed sonar issue
2021-06-28 09:54:20 +03:00
Ildar Almakaev
5dd3944faa
Add API to delete consumer group by id (#578)
* [issue-516] Add API to delete consumer groups by IDs

* Add more tests to check consumer groups deletions

* Refactor and fix code style

* Fix codestyle

* Rethrow OperationInterruptedException with 500 error code if a thread is interrupted

* Use SneakyTrhrows to handle InterruptedException. Refactor

* Change deletion of groups API to single group delete

* Fix codestyle

* Rollback changes in kafka-ui-react-app/package-lock.json
2021-06-23 20:47:32 +03:00
German Osin
d3bf65cfb6
#122 Seek direction backend support (#562) 2021-06-18 11:56:14 +03:00
Bogdan Volodarskiy
11e57b0221 changed api interaction to openapi generated jar 2021-06-16 11:59:46 +03:00
github-actions
081695d5e6 Increased version in pom.xml 2021-06-09 11:37:21 +00:00
github-actions
54581bee63 Increased release 2021-06-09 11:37:18 +00:00
Ildar Almakaev
721cf0e750
[Kafka Connect] Fix getting list of connector's topics (#504)
* [Kafka Connect] Fix getting list of connector's topics

* Fix code style in KafkaConnectService.java

* Fix code style
2021-05-31 12:30:29 +03:00
German Osin
345e1e2b85
Use npm codegen instead of maven (#451) 2021-05-12 15:50:05 +03:00
Marat Adiyatullin
01213c96db Add object->any type mapping for openapi generator config 2021-05-12 13:28:00 +03:00
Marat Adiyatullin
16e63f2c35 Add connect views 2021-05-03 13:33:53 +03:00
Ramazan Yapparov
f3c0866940
#187 added search and sorting (#388)
* - added search by topic name
- added filter by internal topics
- added sort by multiple columns
- added tests

* moved sorting later in the stream
2021-04-27 13:32:08 +03:00
Ramazan Yapparov
eef45fc6ab
#356 added endpoint to fetch all cluster connectors (#361)
* added endpoint to fetch all cluster connectors

* - refactoring code
- refactoring schema
- added connector class property
2021-04-15 11:15:25 +03:00
German Osin
7bfae45162
ISSUE-121 Topic level consumer groups & consumerr group details (#360) 2021-04-08 11:49:44 +03:00
iliax
8d2f929a52
ISSUE-309: Topic create & update models split (#312)
* ISSUE-309: Topic create & update models split
2021-03-25 11:24:51 +03:00
Alexander Krivonosov
a153ce7b21
#289: Negative segment size (#295)
* Fix the negative segment size problem

* Fixed contract topic size bug

Co-authored-by: German Osin <german.osin@gmail.com>
2021-03-24 12:08:54 +03:00
iliax
106c42e4cc
ISSUE-257: ErrorResponse format description (#294)
* ISSUE-257: ErrorResponse format description & processing added
2021-03-23 16:44:57 +03:00
Ramazan Yapparov
217b363076
added features field to kafka cluster (#256) 2021-03-18 21:16:59 +03:00
Ramazan Yapparov
a8ed4ff37f
#188 added pagination for get topics api (#249)
* added pagination for get topics api

* frontend fix

* - fixed merge conflicts
- renamed pageSize to perPage
2021-03-15 21:37:36 +03:00
German Osin
909e196011
Feature refactoring, structure simplifying (#250) 2021-03-15 17:41:25 +03:00
Ramazan Yapparov
881a2167b7
#211 Feature/clear topic messages (#241)
* added delete action

* added test for delete action

* added 404 status in contract

* fixed typo

* added partition parameter

* big refactoring
2021-03-15 11:51:33 +03:00
Ildar Almakaev
e02dd84491
#200 Update schema subject object (#229)
* Return id, version, schema, and subject after creating a new schema

* Throw 422 error code if incoming new schema is unprocessable entity due to invalid fields

* Return 409/Conflict error code if schema is duplicate. Change endpoint of createNewSchema method

* Fix submitting new subject or new version if the subject already exists

* Include schema type to schema objects. By default it's AVRO

* [ISSUE-200] Update FE to support new version of api

* Add one more schema-registry with version 5.5.0 to docker-compose files and app properties

* Upgrade Confluent service versions in tests up to 5.5.0

* Set schemaType is required and ignore when submitting to Schema Registry if it's NULL

Co-authored-by: Oleg Shuralev <workshur@gmail.com>
2021-03-10 15:14:15 +03:00
Ramazan Yapparov
a9cb9567d6
#224 added deleteTopic operation api (#228)
* added deleteTopic operation

* added not found response
2021-03-04 17:51:18 +03:00
Oleg Shur
36a5bbf9b1
[CHORE] Add openapi-generator-cli to generate sources on FE side (#221)
* [CHORE] Add openapi generator to react app

* [CHORE] Use consistent config for gens in mvn & react app

* [CHORE] Update enums to follow new format

* [CHORE] Fix linter issue
2021-03-03 20:56:28 +03:00
Ramazan Yapparov
73f8991517
#164 readonly mode (#218)
* added ReadOnlyModeFilter

* added tests

* refactored kafka connect and schema registry tests
2021-03-01 19:51:58 +03:00
Ramazan Yapparov
377fa830c6
#163 Kafka connect crud (#182)
* - added kafka connect to docker-compose files
- added kafka connect property to application

* - added /connectors endpoint
- added /connectors/{name} endpoint

* - added /connectors/{name}/(restart/pause/resume) endpoints
- updated connector config model
- added FileStream connectors configs

* - added /connectors post endpoint

* - added all other kafka connect endpoints
- reverted config file

* - moved kafka connect related endpoints to separate tag/controller

* - added kafka connect container
- added simple test for kafka connect service
- added assertj dependency

* - added tests for KafkaConnectService

* - added more tests
- moved kafkaConnect rest client calls to separate class
- added validation

* - removed additional validation
- removed Client class
- removed client test and replaced with proper integration test
- added retries

* - cleanup

* moved to using generated kafka connect client

* updated rest schema

* added new maven clean plugin configuration so it deletes generated sources in kafka-ui-react-app/src directory

* changed restart/pause/resume action schema

* - added test
- refactoring

* added more error handling

* added more tests for error handling

* fixed schema registry tests

* changed /connect to /connects

* - fixed mutating connector object during getConnector request
- added new retrying kafka connect client with common retry logic
- fixed dependency scope

* - removed unnecessary `.cache()`

* - reverted testcontainers initialization code

* - added missing UNASSIGNED status to response enum

* - fixed configurations
- fixed testcontainers lifecycle management

* fixed application-local.yml
2021-02-26 15:48:04 +03:00
github-actions
655aa41a72 Increased version in pom.xml 2021-02-24 12:07:32 +00:00
Ildar Almakaev
6ec516345e
Issue-181 Refactor schema CRUD API (#192)
* Rename attribute 'schemaName' to 'subject' for consistency with Schema Registry terms

* Refactor 'GET /schemas' and 'GET .../schemas/{subject}/versions' to get the latest schemas data at once

* Fix getting error code from attributes in our custom GlobalErrorWebExceptionHandler
2021-02-15 11:52:44 +03:00
Ildar Almakaev
961d14454a
Add CRUD actions for Schema Registry service (#165)
* Map schema registry port to 8081 in kafka-clusters-only.yaml

* Add endpoint to retrieve subjects from schema registry by cluster name

* Add endpoint to retrieve subject versions from schema registry

* Get subject schema by version from schema-registry

* Add ability to create/delete schema subjects in/from schema-registry service

* Create WebClient bean and refactor its usage

* Refactor schema api contract

* Return 'Bad request' if there is 'Internal Server Error' from Schema Registry

* Add GET/PUT methods to get/update a schema compatibility level globally or only for a scepific schema

* Add SchemaRegistryContainer.java and testcontainers dependencies for integration tests

* Add junit-jupiter5 for testing

* Add GET/DELETE actions for the latest schema version

* Add endpoint to check schema compatibility

* Set up configuration for testing

* Add basic test for SchemaRegistryService

* Fix mapping from dto to web model

* Change createNewSchema action's endpoint

* Update tests in SchemaRegistryServiceTests

* Rename getLatestSchema method and update tests

* Add more test in SchemaRegistryServiceTests

* Include compatibility level info to schema response. Change Flux to Mono

* Update tests

* Pass schema-registry url for secondLocal cluster too

* Remove explicit returns of 404 status code (it'll be processed by global error handler)

* Add global error handler to response with exception details

* Autoconfigure WebTestClient in SchemaRegistryServiceTest
2021-02-09 10:40:11 +03:00
66632
e2ca126354 Increased version in pom.xml 2021-01-22 11:14:20 +00:00
66632
c701a1763a Increased version in pom.xml 2021-01-20 09:40:13 +00:00