Skip to content

Add --kafka-cluster flag to usm connect register - #3434

Open
Arman Garg (FlamedHunter) wants to merge 2 commits into
mainfrom
CC-43569-usm-changes
Open

Add --kafka-cluster flag to usm connect register#3434
Arman Garg (FlamedHunter) wants to merge 2 commits into
mainfrom
CC-43569-usm-changes

Conversation

@FlamedHunter

@FlamedHunter Arman Garg (FlamedHunter) commented Aug 10, 2026

Copy link
Copy Markdown

Release Notes

Breaking Changes

  • NA

New Features

  • Add a new --kafka-cluster flag to confluent unified-stream-manager connect register, accepting either a Confluent Platform Kafka cluster ID or a Confluent Cloud Kafka cluster ID (lkc-...), as an alternative to --confluent-platform-kafka-cluster.

Bug Fixes

  • NA

Checklist

  • I have successfully built and used a custom CLI binary, without linter issues from this PR.
  • I have clearly specified in the What section below whether this PR applies to Confluent Cloud, Confluent Platform, or both.
  • I have verified this PR in Confluent Cloud pre-prod or production environment, if applicable.
  • I have verified this PR in Confluent Platform on-premises environment, if applicable.
  • I have attached manual CLI verification results or screenshots in the Test & Review section below.
  • I have added appropriate CLI integration or unit tests for any new or updated commands and functionality.
  • I confirm that this PR introduces no breaking changes or backward compatibility issues.
  • I have indicated the potential customer impact if something goes wrong in the Blast Radius section below.
  • I have put checkmarks below confirming that the feature associated with this PR is enabled in:
    • Confluent Cloud prod
    • Confluent Cloud stag
    • Confluent Platform
    • Check this box if the feature is enabled for certain organizations only

What

  • Add a new --kafka-cluster flag to confluent unified-stream-manager connect register, accepting either a Confluent Platform Kafka cluster ID or a Confluent Cloud Kafka cluster ID (lkc-...), as an alternative to --confluent-platform-kafka-cluster.
  • The two flags are mutually exclusive, and exactly one is required.
  • --confluent-platform-kafka-cluster's behavior and response shape are unchanged.
  • --kafka-cluster registrations print a new, simplified response (a single "Kafka Cluster" field) containing the value passed to the flag as-is. The CP-to-USM resolution lookup still runs internally but its result isn't surfaced in this response.
  • No backend/API contract change — both flags populate the same kafka_cluster_id field on the existing usm/v1/connect-clusters create request.

Blast Radius

  • Connect cluster registration for USM (Hybrid connect)

References

Test & Review

For cloud Kafka cluster (registered on USM as hybrid)

Existing behaviour

./confluent usm connect register connect-cc-cluster \
    --confluent-platform-kafka-cluster lkc-stgcqoxq3p \
    --cloud aws --region us-west-2
+--------------------------------+----------------------------------------+
| ID                             | usmcc-stgc30gb03wlh93wdqzslkjef43mnapp |
| Confluent Platform Connect     | connect-cc-cluster                     |
| Cluster                        |                                        |
| USM Kafka Cluster ID           | usmkc-stgceuimd7uloqul5uwkmlrbhb5blnfu |
| Confluent Platform Kafka       | lkc-stgcqoxq3p                         |
| Cluster ID                     |                                        |
| Cloud                          | AWS                                    |
| Region                         | us-west-2                              |
| Environment                    | env-stgcnqgrj3                         |
+--------------------------------+----------------------------------------+

Using new flag (kafka-cluster)

./confluent usm connect register connect-cc-cluster \
    --kafka-cluster lkc-stgcqoxq3p \
    --cloud aws --region us-west-2
+----------------------+----------------------------------------+
| ID                   | usmcc-stgc8aq12lv354p6uf0klhrzx2vwrzm6 |
| Connect Cluster      | connect-cc-cluster                     |
| USM Kafka Cluster ID | usmkc-stgcfpn5laljl8avz7te44hgdh06688  |
| Kafka Cluster        | lkc-stgcqoxq3p                         |
| Cloud                | AWS                                    |
| Region               | us-west-2                              |
| Environment          | env-stgcnqgrj3                         |
+----------------------+----------------------------------------+

For cloud Kafka cluster

Existing behaviour

 ./confluent usm connect register connect-cc-cluster \
    --confluent-platform-kafka-cluster lkc-stgcqoxq3p \
    --cloud aws --region us-west-2
2026-08-10T22:01:17.679+0530 [ERROR] USM Kafka cluster corresponding to Confluent Platform Kafka cluster lkc-stgcqoxq3p not found
+--------------------------------+---------------------------------------+
| ID                             | usmcc-stgcgs8m3qmv6xm359enzrtm8p7gv77 |
| Confluent Platform Connect     | connect-cc-cluster                    |
| Cluster                        |                                       |
| USM Kafka Cluster ID           |                                       |
| Confluent Platform Kafka       | lkc-stgcqoxq3p                        |
| Cluster ID                     |                                       |
| Cloud                          | AWS                                   |
| Region                         | us-west-2                             |
| Environment                    | env-stgcnqgrj3                        |
+--------------------------------+---------------------------------------+

Using new flag (kafka-cluster)

./confluent usm connect register connect-cc-cluster \
    --kafka-cluster lkc-stgcqoxq3p \
    --cloud aws --region us-west-2
2026-08-12T16:12:27.970+0530 [ERROR] USM Kafka cluster corresponding to Confluent Platform Kafka cluster lkc-stgcqoxq3p not found
+----------------------+----------------------------------------+
| ID                   | usmcc-stgc9jya08relxfv0k6ujlrmv6pnajgt |
| Connect Cluster      | connect-cc-cluster                     |
| USM Kafka Cluster ID |                                        |
| Kafka Cluster        | lkc-stgcqoxq3p                         |
| Cloud                | AWS                                    |
| Region               | us-west-2                              |
| Environment          | env-stgcnqgrj3                         |
+----------------------+----------------------------------------+

For on-prem Kafka Cluster

Existing behaviour

./confluent usm connect register argarg-setu-20260809-11f7f8c9-029e-4239-9f12-1ae0ff6a6a29-main-connect \
    --confluent-platform-kafka-cluster JaH5VfLdRxi_CXfrA_jHxw \
    --cloud aws --region us-west-2
+--------------------------------+------------------------------------------------------------------------+
| ID                             | usmcc-stgcx9ejliupphptsdbky9k4g5bgvaqy                                 |
| Confluent Platform Connect     | argarg-setu-20260809-11f7f8c9-029e-4239-9f12-1ae0ff6a6a29-main-connect |
| Cluster                        |                                                                        |
| USM Kafka Cluster ID           | usmkc-stgcppuy2f6x8q1dbkskllrgzlt84bb                                  |
| Confluent Platform Kafka       | JaH5VfLdRxi_CXfrA_jHxw                                                 |
| Cluster ID                     |                                                                        |
| Cloud                          | AWS                                                                    |
| Region                         | us-west-2                                                              |
| Environment                    | env-stgcn37oy6                                                         |
+--------------------------------+------------------------------------------------------------------------+

Using new flag (kafka-cluster)

./confluent usm connect register argarg-setu-20260809-11f7f8c9-029e-4239-9f12-1ae0ff6a6a29-main-connect \
    --kafka-cluster JaH5VfLdRxi_CXfrA_jHxw \
    --cloud aws --region us-west-2
+----------------------+------------------------------------------------------------------------+
| ID                   | usmcc-stgcz0stkyddf3eqzex436ofpwtxmxje                                 |
| Connect Cluster      | argarg-setu-20260809-11f7f8c9-029e-4239-9f12-1ae0ff6a6a29-main-connect |
| USM Kafka Cluster ID | usmkc-stgcppuy2f6x8q1dbkskllrgzlt84bb                                  |
| Kafka Cluster        | JaH5VfLdRxi_CXfrA_jHxw                                                 |
| Cloud                | AWS                                                                    |
| Region               | us-west-2                                                              |
| Environment          | env-stgcn37oy6                                                         |
+----------------------+------------------------------------------------------------------------+

@FlamedHunter
Arman Garg (FlamedHunter) requested a review from a team as a code owner August 10, 2026 12:12
Copilot AI lite review requested due to automatic review settings August 10, 2026 12:12
@confluent-cla-assistant

Copy link
Copy Markdown

🎉 All Contributor License Agreements have been signed. Ready to merge.
Please push an empty commit if you would like to re-run the checks to verify CLA status for all contributors.

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds support for registering a USM Connect cluster using a new --kafka-cluster flag (in addition to the existing --confluent-platform-kafka-cluster), including updated help text and integration fixtures.

Changes:

  • Add --kafka-cluster flag to usm connect register, making the two Kafka cluster flags mutually exclusive and requiring one of them.
  • Introduce a “hybrid” output shape for the --kafka-cluster flow.
  • Update integration tests and golden outputs to reflect the new flag behavior and validation errors.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
internal/unified-stream-manager/command_connect_register.go Adds the new flag, updates examples, and adjusts flag validation/registration flow.
internal/unified-stream-manager/command_connect.go Adds a new output struct + printer used by the --kafka-cluster registration path.
test/usm_test.go Extends integration test coverage for new flag validation; currently includes commented-out success-path cases.
test/fixtures/output/unified-stream-manager/connect/register-help.golden Updates help output to include the new flag and example.
test/fixtures/output/unified-stream-manager/connect/create-fail-paired-flag-missing.golden Updates usage/help output shown on paired-flag validation error.
test/fixtures/output/unified-stream-manager/connect/create-fail-mutually-exclusive-kafka-flags.golden Adds fixture for mutually-exclusive Kafka flag error.
test/fixtures/output/unified-stream-manager/connect/create-fail-missing-kafka-flag.golden Adds fixture for “one required” Kafka flag validation error.
test/fixtures/output/unified-stream-manager/connect/create-cp-kafka.golden Adds fixture for the --kafka-cluster success-path output currently exercised by tests.
Suppressed comments (1)

internal/unified-stream-manager/command_connect_register.go:69

  • The --kafka-cluster path still flows through the on-prem→cloud Kafka ID mapping and the "not found" logging. For cloud IDs like "lkc-...", this will always miss the map, log a misleading error on success, and can even fail early if ListUsmKafkaClusters requires permissions (even though the mapping is irrelevant for --kafka-cluster).
	if cmd.Flags().Changed("kafka-cluster") {
		kafkaClusterId, err = cmd.Flags().GetString("kafka-cluster")
		if err != nil {
			return err
		}
	}

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment on lines 33 to +34
cmd.Flags().String("confluent-platform-kafka-cluster", "", "The ID of the metadata Kafka cluster for the Connect Cluster.")
cmd.Flags().String("kafka-cluster", "", `The ID of the metadata Kafka cluster for the Connect Cluster.`)
Comment thread test/usm_test.go
Comment on lines +43 to +46
//{args: "usm connect register connect-group-xyz123 --kafka-cluster lkc-abc123 --cloud aws --region us-east-1", fixture: "unified-stream-manager/connect/create-cloud-kafka.golden"},
//{args: "usm connect register connect-group-xyz123 --kafka-cluster lkc-abc123 --cloud aws --region us-east-1 -o json", fixture: "unified-stream-manager/connect/create-cloud-kafka-json.golden"},
{args: "usm connect register connect-group-xyz123 --kafka-cluster 4k0R9d1GTS5tI9f4Y2xZ0Q --cloud aws --region us-east-1", fixture: "unified-stream-manager/connect/create-cp-kafka.golden"},
{args: "usm connect register connect-group-xyz123 --confluent-platform-kafka-cluster 4k0R9d1GTS5tI9f4Y2xZ0Q --kafka-cluster lkc-abc123 --cloud aws --region us-east-1", fixture: "unified-stream-manager/connect/create-fail-mutually-exclusive-kafka-flags.golden", exitCode: 1},
@sonarqube-confluent

Copy link
Copy Markdown

type connectHybridOut struct {
Id string `human:"ID" serialized:"id"`
ConnectCluster string `human:"Connect Cluster" serialized:"connect_cluster"`
USMKafkaClusterId string `human:"USM Kafka Cluster ID" serialized:"usm_kafka_cluster_id"`

@rishabhbits038 Rishabh Sharma (rishabhbits038) Aug 13, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we check with the cli team is it is okay to remove this flag altogether?
or is the recommendation to deprecate this first?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants