Commit graph

85 commits

Author SHA1 Message Date
Ildar Almakaev
b572a6e866 For backward compatibility with Schema Registry API set schemaType as optional in NewSchemaSubject and ignore if it's NULL 2021-03-10 09:20:37 +03:00
Ildar Almakaev
0ee3a0e546 Update test of Kafka Connect integration 2021-03-10 00:01:00 +03:00
Ildar Almakaev
e34152c48f Upgrade Confluent service versions up to 5.5.0 2021-03-10 00:00:03 +03:00
Ildar Almakaev
58c62b8fa6 Add one more schema-registry with version 5.5.0 to docker-compose files and app properties 2021-03-09 23:58:53 +03:00
Ildar Almakaev
065790b912 Merge branch 'master' into issue-200-update-schema-subject-object 2021-03-09 20:04:43 +03:00
Ildar Almakaev
ff1d823572 Add more test when creating new schemas/versions 2021-03-09 20:00:28 +03:00
Ramazan Yapparov
58df6c1a7e
#222 Fix npe in consumer (#223)
* add null handling
* replaced hashmaps with immutable map in deserializer returns
* added simple test for previously failing case
2021-03-09 17:15:12 +03:00
Ramazan Yapparov
e29ea3599d
updated confluent images versions to 5.2.4 (#226) 2021-03-09 16:53:06 +03:00
Ramazan Yapparov
a9cb9567d6
#224 added deleteTopic operation api (#228)
* added deleteTopic operation

* added not found response
2021-03-04 17:51:18 +03:00
Ramazan Yapparov
ae1acbce9b
added wrapping to mono (#227) 2021-03-04 17:24:56 +03:00
Ildar Almakaev
7f15bf1c0b Update SchemaRegistryService tests 2021-03-04 16:45:16 +03:00
Ildar Almakaev
b3a3d965b3 Don't submit schemaType when creating a new schema. It's made for backward compatibility with its API 2021-03-04 16:44:20 +03:00
Ildar Almakaev
a617a09bc5 Include schema type to schema objects. By default it's AVRO 2021-03-04 15:02:09 +03:00
Ildar Almakaev
239f7e1158 Merge branch 'master' into issue-200-update-schema-subject-object 2021-03-04 12:58:36 +03:00
Ramazan Yapparov
be96bbc381
Testcontainers speedup and stabilization (#220)
* - moved testcontainers lifecycle control back to singleton
- changed kafka connect container wait strategy from logs to http

* refactoring

* reduced startup timeout to 5 minutes
2021-03-03 13:08:51 +03:00
Ildar Almakaev
85dffa7dae Merge branch 'master' into issue-200-update-schema-subject-object 2021-03-02 15:28:51 +03:00
Ildar Almakaev
a68fa15354 Refactor registerNewSchema method 2021-03-02 15:27:24 +03:00
Ildar Almakaev
35736033a8 Fix submittin new subject or new version if subject already exists 2021-03-02 13:53:33 +03:00
Ildar Almakaev
705377612c Return 409/Conflict error code if schema is duplicate. Change endpoint of createNewSchema method 2021-03-01 22:31:53 +03:00
Ramazan Yapparov
73f8991517
#164 readonly mode (#218)
* added ReadOnlyModeFilter

* added tests

* refactored kafka connect and schema registry tests
2021-03-01 19:51:58 +03:00
DementevNikita
4eb690d782
Fix kafka-ui image name in docker-compose file (#210)
* Fix kafka-ui image name in docker-compose file

* fix docker image name in pom.xml docker build section

* fix indentation
2021-03-01 15:20:20 +03:00
Ramazan Yapparov
377fa830c6
#163 Kafka connect crud (#182)
* - added kafka connect to docker-compose files
- added kafka connect property to application

* - added /connectors endpoint
- added /connectors/{name} endpoint

* - added /connectors/{name}/(restart/pause/resume) endpoints
- updated connector config model
- added FileStream connectors configs

* - added /connectors post endpoint

* - added all other kafka connect endpoints
- reverted config file

* - moved kafka connect related endpoints to separate tag/controller

* - added kafka connect container
- added simple test for kafka connect service
- added assertj dependency

* - added tests for KafkaConnectService

* - added more tests
- moved kafkaConnect rest client calls to separate class
- added validation

* - removed additional validation
- removed Client class
- removed client test and replaced with proper integration test
- added retries

* - cleanup

* moved to using generated kafka connect client

* updated rest schema

* added new maven clean plugin configuration so it deletes generated sources in kafka-ui-react-app/src directory

* changed restart/pause/resume action schema

* - added test
- refactoring

* added more error handling

* added more tests for error handling

* fixed schema registry tests

* changed /connect to /connects

* - fixed mutating connector object during getConnector request
- added new retrying kafka connect client with common retry logic
- fixed dependency scope

* - removed unnecessary `.cache()`

* - reverted testcontainers initialization code

* - added missing UNASSIGNED status to response enum

* - fixed configurations
- fixed testcontainers lifecycle management

* fixed application-local.yml
2021-02-26 15:48:04 +03:00
Ildar Almakaev
c6ebfac54a Throw 422 error code if incoming new schema is unprocessable entity due to invalid fields 2021-02-26 10:58:09 +03:00
Ildar Almakaev
82f879c916 Return id, version, schema, and subject after creating a new schema 2021-02-26 10:41:08 +03:00
github-actions
655aa41a72 Increased version in pom.xml 2021-02-24 12:07:32 +00:00
Ildar Almakaev
6ec516345e
Issue-181 Refactor schema CRUD API (#192)
* Rename attribute 'schemaName' to 'subject' for consistency with Schema Registry terms

* Refactor 'GET /schemas' and 'GET .../schemas/{subject}/versions' to get the latest schemas data at once

* Fix getting error code from attributes in our custom GlobalErrorWebExceptionHandler
2021-02-15 11:52:44 +03:00
German Osin
b9e92114e6
Fixed Zookeeper connecion leak (#185) 2021-02-11 17:37:59 +03:00
Ildar Almakaev
ba4e1748ee
ISSUE-166 Pass ProtobufSchemaProvider to CachedSchemaRegistryClient to deserialize protobuf records (#178) 2021-02-10 22:28:32 +03:00
Ildar Almakaev
961d14454a
Add CRUD actions for Schema Registry service (#165)
* Map schema registry port to 8081 in kafka-clusters-only.yaml

* Add endpoint to retrieve subjects from schema registry by cluster name

* Add endpoint to retrieve subject versions from schema registry

* Get subject schema by version from schema-registry

* Add ability to create/delete schema subjects in/from schema-registry service

* Create WebClient bean and refactor its usage

* Refactor schema api contract

* Return 'Bad request' if there is 'Internal Server Error' from Schema Registry

* Add GET/PUT methods to get/update a schema compatibility level globally or only for a scepific schema

* Add SchemaRegistryContainer.java and testcontainers dependencies for integration tests

* Add junit-jupiter5 for testing

* Add GET/DELETE actions for the latest schema version

* Add endpoint to check schema compatibility

* Set up configuration for testing

* Add basic test for SchemaRegistryService

* Fix mapping from dto to web model

* Change createNewSchema action's endpoint

* Update tests in SchemaRegistryServiceTests

* Rename getLatestSchema method and update tests

* Add more test in SchemaRegistryServiceTests

* Include compatibility level info to schema response. Change Flux to Mono

* Update tests

* Pass schema-registry url for secondLocal cluster too

* Remove explicit returns of 404 status code (it'll be processed by global error handler)

* Add global error handler to response with exception details

* Autoconfigure WebTestClient in SchemaRegistryServiceTest
2021-02-09 10:40:11 +03:00
German Osin
481c321d06
ISSUE-169 Sort topics (#172) 2021-02-01 18:01:18 +03:00
66632
e2ca126354 Increased version in pom.xml 2021-01-22 11:14:20 +00:00
German Osin
c27dfb8ff9 Merge branch 'master' of github.com:provectus/kafka-ui 2021-01-20 14:38:05 +03:00
German Osin
4921f61457 Fixed npe 2021-01-20 14:37:52 +03:00
66632
c701a1763a Increased version in pom.xml 2021-01-20 09:40:13 +00:00
German Osin
1e249cb7a5 NPE check before metrics sum 2021-01-20 12:26:07 +03:00
German Osin
29887cb4e0 Hot fix polling 2020-12-14 13:08:57 +03:00
German Osin
cbc54f8416
Added custom properties & fixed reset policy (#134)
* Added custom properties support
2020-12-02 21:47:57 +03:00
soffest
9fd3697062
Kafka ui contract: Updated schemas required props. (#119)
* Updated schemas required props.

* Renamed long to int64 params

Co-authored-by: Sofia Shnaidman <sshnaidman@provectus.com>
Co-authored-by: German Osin <german.osin@gmail.com>
2020-11-19 15:38:28 +03:00
German Osin
d593e6f70e Fixed empty protobuf file 2020-11-12 14:16:43 +03:00
German Osin
238631ac0c
Protobuf support (#116)
* Added schema registry protobuf support

* Fixed detection

* Added support for local protobuf file

* Fixed minor issues
2020-11-10 09:43:28 +03:00
German Osin
3c196587a3
Fixed metrics and stats endpoints (#115) 2020-11-09 20:25:48 +03:00
German Osin
198c97403f
Update topic info after create/update ops (#114) 2020-11-09 14:24:45 +03:00
German Osin
88cc301bb6
Added common deserializer (#109) 2020-11-02 15:21:07 +03:00
66632
e9a6b52f2a Increased version in pom.xml 2020-10-30 15:00:38 +00:00
66632
2a743a5bf4 Increased version in pom.xml 2020-10-30 14:52:14 +00:00
66632
944fb19cb9 Increased version in pom.xml 2020-09-16 12:42:09 +00:00
German Osin
7e259c8528
Delete application-bet.yml 2020-08-18 14:07:34 +03:00
German Osin
a4f1908fb6 Small fixes 2020-08-18 14:01:06 +03:00
Anton Petrov
dce98a06a8
Fix cluster-only docker config (#99)
* Fix cluster-only docker config

* CI test

* CI test

* CI test

* Add replica back
2020-08-17 15:21:06 +03:00
Anton Petrov
bf23e9c193 Fix NPE if no offsets were found for specified timestamp 2020-08-11 17:23:37 +03:00