-
Notifications
You must be signed in to change notification settings - Fork 120
docs: add SeaTunnel Source and Sink quick start #464
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Changes from all commits
62baf2a
5bb8ee0
e4e9e08
1ab58f1
ba74766
af87f8a
512b51c
c4107b6
c773933
dff6ba1
ea90243
e4660a6
34bfab5
13b6d1f
5840b8b
966a459
b55fe2b
d533820
90f21e5
51e334f
4ae78ff
68a004a
7851a25
c886b49
d15c312
08381d2
a136574
7031a56
d64dedb
b9c6d5c
378b7dd
3c42928
8956f3b
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,31 @@ | ||
| # Add SeaTunnel Connector Integration Guide (CN only) | ||
|
|
||
| ## Purpose | ||
|
|
||
| - 新增 Apache SeaTunnel Connector 集成快速上手文档,作为 HugeGraph 工具链的生态入口之一 | ||
| - 帮助新用户理解 SeaTunnel 与 Loader / Tools 的选型边界,并给出 JDBC / Kafka / graph2graph 三类常见用法 | ||
|
|
||
| ## Changes | ||
|
|
||
| - **New**: `content/cn/docs/quickstart/toolchain/hugegraph-seatunnel-connector.md` — CN 快速上手: | ||
| - 发布版(2.3.13,`schema_config`)与 dev(Source + `mappings`)分开讲解,示例按上游 commit 钉住核对 | ||
| - sql2graph(JDBC 顶点/边写入)、kafka2graph(流式写入)、graph2graph(图迁移,dev)三个场景,含完整 HOCON 配置与验证命令 | ||
| - dev 示例与上游最新状态对齐(2026-08):HugeGraph Source 与 `mappings` 多映射已随 PR apache/seatunnel#11413 合入 dev(2026-08-05),将随 SeaTunnel **3.0.0** 发布;2.3.13 内置 Client 1.5.0,dev 已升 1.7.0 | ||
| - 补充 dev Source 要点:省略 `label` 读全量(多表输出、不可配 `schema`/`filter`)、`parallelism > 1` 分片并行要求可扫描后端(RocksDB / HBase / Cassandra)且与 `filter` 互斥、`~id`/`~source_id`/`~target_id` 保留列克隆 | ||
| - 常用配置表区分 `schema_config`(2.3.13)与 `mappings`(dev),并列出 dev 新增选项(`schema_save_mode`、`data_save_mode`、`check_vertex`、失败回退、重试、`updateStrategies`、`listFormat`、`unfold*` 等) | ||
| - 参考文档补齐官网版本化链接(2.3.13 Sink)与上游追踪链接(apache/seatunnel#10001 / #10002 / #11413 / #11329) | ||
| - **New images**: `content/cn/docs/images/seatunnel/*.png`(总览 / sql2graph / kafka2graph / graph2graph 示意图) | ||
| - **Modified**: `content/cn/docs/introduction/_index.md` — 工具链表新增 SeaTunnel-connector 条目(Sink 2.3.13+;Source 已合入 dev,随 3.0.0 发布);新增全栈生态全景图 | ||
|
|
||
| ## Notes for reviewers | ||
|
|
||
| - 按 review 意见先出纯 CN 版本,EN 版本通过后再补 | ||
| - dev 示例按上游 commit `f1a1a0a` 核对(含 #11413 合入后的 Source / Sink 文档),`dev` 会继续变化,文档已注明需重新核对 | ||
| - Source 尚未随正式 Release 发布(已合入 dev,随 SeaTunnel 3.0.0 发布);3.0.0 发版后可将 dev 示例链接切换为官网版本化地址 | ||
|
|
||
| ## Related | ||
|
|
||
| - 功能请求:apache/seatunnel#10001 | ||
| - Sink Connector(已随 SeaTunnel 2.3.13 发布):apache/seatunnel#10002 | ||
| - Source Connector + 多映射重构(2026-08-05 合入 dev,随 3.0.0 发布):apache/seatunnel#11413 | ||
| - 文档改进:apache/seatunnel#11329 | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -23,18 +23,9 @@ HugeGraph 支持百亿以上的顶点和边的快速存储与查询,具备出 | |
|
|
||
| ### 生态系统全景 | ||
|
|
||
| ``` | ||
| ┌──────────────────────────────────────────────────────────────┐ | ||
| │ Apache HugeGraph - Full-Stack Graph System │ | ||
| ├──────────────────┬────────────────────┬──────────────────────┤ | ||
| │ Graph DB (OLTP) │ Graph Compute │ Graph AI │ | ||
| │ HugeGraph │ Vermeer (Memory) │ HugeGraph-AI │ | ||
| │ Server │ Computer (Dist.) │ GraphRAG/GNN/Py │ | ||
| ├──────────────────┴────────────────────┴──────────────────────┤ | ||
| │ HugeGraph Toolchain │ | ||
| │ Hubble | Loader | Client(Java/Go/Py) | Spark | Tools │ | ||
| └──────────────────────────────────────────────────────────────┘ | ||
| ``` | ||
|  | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Please keep an ecosystem figure here, replacing the ASCII block with a diagram of the same scope if the alignment problems are the reason for dropping it. The SeaTunnel figure already appears on the new connector page at line 12, which is the right place for it. |
||
|
|
||
| HugeGraph 负责图存储和查询,Toolchain 负责导入、管理和连接外部数据系统。需要把 JDBC、Kafka 等数据接入图数据库时,可以从 [SeaTunnel Connector 快速开始](/cn/docs/quickstart/toolchain/hugegraph-seatunnel-connector) 开始。 | ||
|
|
||
| --- | ||
|
|
||
|
|
@@ -94,6 +85,7 @@ HugeGraph 独立的 AI 组件,连接图与大语言模型(LLM): | |
| | [Loader](/cn/docs/quickstart/toolchain/hugegraph-loader) | 数据导入工具:支持本地文件、HDFS、MySQL 等多数据源,TXT/CSV/JSON 等格式 | | ||
| | [Client](/cn/docs/quickstart/client/hugegraph-client) | 多语言 SDK:Java / Python / Go | | ||
| | [Spark-connector](/cn/docs/quickstart/toolchain/hugegraph-spark-connector) | Spark 集成:支持通过 Spark 批量读写图数据,适合大数据离线处理场景 | | ||
| | [SeaTunnel Connector](/cn/docs/quickstart/toolchain/hugegraph-seatunnel-connector) | 提供 HugeGraph Sink(2.3.13+);Source 已合入 dev,随 SeaTunnel 3.0.0 发布 | | ||
| | [Tools](/cn/docs/quickstart/toolchain/hugegraph-tools) | 命令行运维工具:图管理、备份恢复、Gremlin 执行等 | | ||
|
|
||
| --- | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
AGENTS.md,README.mdandcontribution.md; nothing references this file and.gitignoredoes not cover it, so it would ship as a permanent stray file. The same information already belongs in the PR description field. It also begins with a UTF-8 BOM:git show 8956f3b:PR_DESCRIPTION.md | head -c 6 | xxdreturnsefbb bf23 2041.Please delete
PR_DESCRIPTION.mdfrom the branch.