
* created wizard * Create wizard form schema * Wizard kafka cluster form (#3245) * created wizard Kafka Cluster form * created error message Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * Update schema.ts * Wizard authentication (#3268) * created authentication form * changed SaslType.tsx switch case * remove console.log * commented unused variables * auth validation * auth Security Protocol * changed schema.ts username, password * added Delegation tokens validation schema * changed auth form --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * New Dashboard flow. Add an ability to configure clusters * wizard kafka cluster validate (#3294) * kafka cluster validate * fixed bootstrap server uncontrolled input warning error --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * Wizard schema registry (#3286) * created schema registry * unused variables * Prevent Default on click --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * feat: cleanup * Application config API (#3242) * wip * wip * wip * wip * OAuthProperties added to dynamic config api * wip * files upload endpoint added * rbac conf api added * rbac conf api improvements * App configuration validation endpoint (#3264) Co-authored-by: iliax <ikuramshin@provectus.com> --------- Co-authored-by: iliax <ikuramshin@provectus.com> Co-authored-by: Oleg Shur <workshur@gmail.com> * add app config api client * refactor cluster section * refactor cluster section * linting * refactor Registry Form (#3311) * refactor Registry Form * refactor Registry --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * auth form improvements * refactoring * linting * file upload API changes * Auth * Start connecting to schema & payload * Auth * fileupload * Wizard JMX Metrics form (#3303) * created JMX Metrics form * refactor JMXMetrics.tsx styles * added cursor on checkbox, changed styles submit button * refactor Metrics * refactoring * uncomment schema connect validation --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * validate api * refactor * Wizard Kafka Connect form (#3300) * created Kafka Connect form * renaming functions and variables * refactor * changed button name * refactoring kafka connect * made handler function, reset replace with set value, * refactoring * uncomment schema metrics validation --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> * fixing AdminClient validation * fixing AdminClient validation * refactor kafka connect * refactor metrics * Per-cluster SSL verification settings (#3336) * ssl configuration moved to app & cluster level * documentations changes * trust all removed, global app settings removed * extracting ssl properties settings to SslPropertiesUtil * wip * documentation fix --------- Co-authored-by: iliax <ikuramshin@provectus.com> Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com> * SSL properties NPE fixes * api integration * custom fields for existing auth config * OffsetsResetServiceTest fix * cluster.properties structure flattening added * kafka-ssl.yml: ssl properties moved to separate section, producer ssl properties copy added * custom auth * error messaging * form submit * feedback * 1. defaulting metrics type to JMX 2. AdminClient id generation made uniq * checkstyle fix * checkstyle fix * refactoring * feedback * feedback * feedback * feedback * feedback * feedback * Wizard: Application info API (#3391) * Application info API added, cluster features enum renamed to `ClusterFeature` * show config for specific envs only * refactor widget * Cluster connection validation err msg improved * KSQL DB section * Refactor + deps upgrade * experiment: get rid of babel * BE validations refactoring * Update kafka-ui.yaml fixed to string type param * fixes #3397 * linting * #3399 adjust size of port input * disable selects for disabled form * Wizard: Keystore separation (#3425) * wip * wip * compose fix * dto structure fix --------- Co-authored-by: iliax <ikuramshin@provectus.com> * dynamic ops enablement properties improvements * own keystore for each section * linting * fix keystore submit * fix keystore submit * feedback * feedback * refactoring * Connect config userName field renamed * metrics configs mapping fix * feedback * Wizard: Jmx ssl (#3448) JMX SSL implementation. Added ability to set specific ssl keystore for each cluster when connection to jmx endpoint. * Review fixes * upd compareVersionsOperation qase id * add toBeAutomated into manual suite * DYNAMIC_CONFIG_ENABLED property description added * Resolve conflicts * Fix issue with 400 error * fix SR edit form --------- Co-authored-by: davitbejanyan <dbejanyan@provectus.com> Co-authored-by: Alexander Krivonosov <31561808+GneyHabub@users.noreply.github.com> Co-authored-by: Oleg Shur <workshur@gmail.com> Co-authored-by: Ilya Kuramshin <iliax@proton.me> Co-authored-by: iliax <ikuramshin@provectus.com> Co-authored-by: Roman Zabaluev <rzabaluev@provectus.com> Co-authored-by: bkhakimov <bkhakimov@provectus.com> Co-authored-by: Mgrdich <mgotm13@gmail.com> Co-authored-by: VladSenyuta <vlad.senyuta@gmail.com>
113 lines
5.9 KiB
YAML
113 lines
5.9 KiB
YAML
---
|
|
version: '2'
|
|
services:
|
|
|
|
kafka-ui:
|
|
container_name: kafka-ui
|
|
image: provectuslabs/kafka-ui:latest
|
|
ports:
|
|
- 8080:8080
|
|
depends_on:
|
|
- kafka0
|
|
- schemaregistry0
|
|
environment:
|
|
kafka.clusters.0.name: SerdeExampleCluster
|
|
kafka.clusters.0.bootstrapServers: kafka0:29092
|
|
kafka.clusters.0.schemaRegistry: http://schemaregistry0:8085
|
|
|
|
# optional SSL settings for cluster (will be used by SchemaRegistry serde, if set)
|
|
#kafka.clusters.0.ssl.keystoreLocation: /kafka.keystore.jks
|
|
#kafka.clusters.0.ssl.keystorePassword: "secret"
|
|
#kafka.clusters.0.ssl.truststoreLocation: /kafka.truststore.jks
|
|
#kafka.clusters.0.ssl.truststorePassword: "secret"
|
|
|
|
# optional auth properties for SR
|
|
#kafka.clusters.0.schemaRegistryAuth.username: "use"
|
|
#kafka.clusters.0.schemaRegistryAuth.password: "pswrd"
|
|
|
|
kafka.clusters.0.defaultKeySerde: Int32 #optional
|
|
kafka.clusters.0.defaultValueSerde: String #optional
|
|
|
|
kafka.clusters.0.serde.0.name: ProtobufFile
|
|
kafka.clusters.0.serde.0.topicKeysPattern: "topic1"
|
|
kafka.clusters.0.serde.0.topicValuesPattern: "topic1"
|
|
kafka.clusters.0.serde.0.properties.protobufFilesDir: /protofiles/
|
|
kafka.clusters.0.serde.0.properties.protobufMessageNameForKey: test.MyKey # default type for keys
|
|
kafka.clusters.0.serde.0.properties.protobufMessageName: test.MyValue # default type for values
|
|
kafka.clusters.0.serde.0.properties.protobufMessageNameForKeyByTopic.topic1: test.MySpecificTopicKey # keys type for topic "topic1"
|
|
kafka.clusters.0.serde.0.properties.protobufMessageNameByTopic.topic1: test.MySpecificTopicValue # values type for topic "topic1"
|
|
|
|
kafka.clusters.0.serde.1.name: String
|
|
#kafka.clusters.0.serde.1.properties.encoding: "UTF-16" #optional, default is UTF-8
|
|
kafka.clusters.0.serde.1.topicValuesPattern: "json-events|text-events"
|
|
|
|
kafka.clusters.0.serde.2.name: AsciiString
|
|
kafka.clusters.0.serde.2.className: com.provectus.kafka.ui.serdes.builtin.StringSerde
|
|
kafka.clusters.0.serde.2.properties.encoding: "ASCII"
|
|
|
|
kafka.clusters.0.serde.3.name: SchemaRegistry # will be configured automatically using cluster SR
|
|
kafka.clusters.0.serde.3.topicValuesPattern: "sr-topic.*"
|
|
|
|
kafka.clusters.0.serde.4.name: AnotherSchemaRegistry
|
|
kafka.clusters.0.serde.4.className: com.provectus.kafka.ui.serdes.builtin.sr.SchemaRegistrySerde
|
|
kafka.clusters.0.serde.4.properties.url: http://schemaregistry0:8085
|
|
kafka.clusters.0.serde.4.properties.keySchemaNameTemplate: "%s-key"
|
|
kafka.clusters.0.serde.4.properties.schemaNameTemplate: "%s-value"
|
|
#kafka.clusters.0.serde.4.topicValuesPattern: "sr2-topic.*"
|
|
# optional auth and ssl properties for SR (overrides cluster-level):
|
|
#kafka.clusters.0.serde.4.properties.username: "user"
|
|
#kafka.clusters.0.serde.4.properties.password: "passw"
|
|
#kafka.clusters.0.serde.4.properties.keystoreLocation: /kafka.keystore.jks
|
|
#kafka.clusters.0.serde.4.properties.keystorePassword: "secret"
|
|
#kafka.clusters.0.serde.4.properties.truststoreLocation: /kafka.truststore.jks
|
|
#kafka.clusters.0.serde.4.properties.truststorePassword: "secret"
|
|
|
|
kafka.clusters.0.serde.5.name: UInt64
|
|
kafka.clusters.0.serde.5.topicKeysPattern: "topic-with-uint64keys"
|
|
volumes:
|
|
- ./proto:/protofiles
|
|
|
|
kafka0:
|
|
image: confluentinc/cp-kafka:7.2.1
|
|
hostname: kafka0
|
|
container_name: kafka0
|
|
ports:
|
|
- "9092:9092"
|
|
- "9997:9997"
|
|
environment:
|
|
KAFKA_BROKER_ID: 1
|
|
KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: 'CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT'
|
|
KAFKA_ADVERTISED_LISTENERS: 'PLAINTEXT://kafka0:29092,PLAINTEXT_HOST://localhost:9092'
|
|
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
|
|
KAFKA_GROUP_INITIAL_REBALANCE_DELAY_MS: 0
|
|
KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1
|
|
KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
|
|
KAFKA_JMX_PORT: 9997
|
|
KAFKA_JMX_HOSTNAME: localhost
|
|
KAFKA_JMX_OPTS: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djava.rmi.server.hostname=kafka0 -Dcom.sun.management.jmxremote.rmi.port=9997
|
|
KAFKA_PROCESS_ROLES: 'broker,controller'
|
|
KAFKA_NODE_ID: 1
|
|
KAFKA_CONTROLLER_QUORUM_VOTERS: '1@kafka0:29093'
|
|
KAFKA_LISTENERS: 'PLAINTEXT://kafka0:29092,CONTROLLER://kafka0:29093,PLAINTEXT_HOST://0.0.0.0:9092'
|
|
KAFKA_INTER_BROKER_LISTENER_NAME: 'PLAINTEXT'
|
|
KAFKA_CONTROLLER_LISTENER_NAMES: 'CONTROLLER'
|
|
KAFKA_LOG_DIRS: '/tmp/kraft-combined-logs'
|
|
volumes:
|
|
- ./scripts/update_run.sh:/tmp/update_run.sh
|
|
command: "bash -c 'if [ ! -f /tmp/update_run.sh ]; then echo \"ERROR: Did you forget the update_run.sh file that came with this docker-compose.yml file?\" && exit 1 ; else /tmp/update_run.sh && /etc/confluent/docker/run ; fi'"
|
|
|
|
schemaregistry0:
|
|
image: confluentinc/cp-schema-registry:7.2.1
|
|
ports:
|
|
- 8085:8085
|
|
depends_on:
|
|
- kafka0
|
|
environment:
|
|
SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS: PLAINTEXT://kafka0:29092
|
|
SCHEMA_REGISTRY_KAFKASTORE_SECURITY_PROTOCOL: PLAINTEXT
|
|
SCHEMA_REGISTRY_HOST_NAME: schemaregistry0
|
|
SCHEMA_REGISTRY_LISTENERS: http://schemaregistry0:8085
|
|
|
|
SCHEMA_REGISTRY_SCHEMA_REGISTRY_INTER_INSTANCE_PROTOCOL: "http"
|
|
SCHEMA_REGISTRY_LOG4J_ROOT_LOGLEVEL: INFO
|
|
SCHEMA_REGISTRY_KAFKASTORE_TOPIC: _schemas
|