Skip to content

Commit 23fc3a5

Browse files
authored
Merge branch 'master' into pg_track_settings
2 parents b805bb2 + d9247e2 commit 23fc3a5

6 files changed

Lines changed: 142 additions & 3 deletions

File tree

CN/modules/ROOT/nav.adoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,7 @@
7676
*** xref:master/ecosystem_components/zhparser.adoc[zhparser]
7777
*** xref:master/ecosystem_components/pgbackrest.adoc[pgBackRest]
7878
*** xref:master/ecosystem_components/set_user.adoc[set_user]
79+
*** xref:master/ecosystem_components/pg_jieba.adoc[pg_jieba]
7980
*** xref:master/ecosystem_components/pg_track_settings.adoc[pg_track_settings]
8081
* 监控运维
8182
** xref:master/getting-started/daily_monitoring.adoc[日常监控]

CN/modules/ROOT/pages/master/ecosystem_components/ecosystem_overview.adoc

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,8 @@ IvorySQL 作为一款兼容 Oracle 且基于 PostgreSQL 的高级开源数据库
4141
| 28 | xref:master/ecosystem_components/zhparser.adoc[zhparser] | master branch | 用于中文全文搜索的PostgreSQL插件,基于SCWS(即:简易中文分词系统)实现了一个中文解析器 | 搜索引擎、关键字提取
4242
| 29 | xref:master/ecosystem_components/pgbackrest.adoc[pgBackRest] | 2.58.0 | 可靠的 PostgreSQL 备份和恢复解决方案 | 容灾备份、大库备份、异地/多层容灾
4343
| 30 | xref:master/ecosystem_components/set_user.adoc[set_user] | REL4_2_0 | PostgreSQL 安全审计扩展,可控角色切换,支持白名单、强制审计、拦截高危操作 | 可控角色切换、权限管理、审计日志
44-
| 31 | xref:master/ecosystem_components/pg_track_settings.adoc[pg_track_settings] | 2.1.2 | PostgreSQL 配置跟踪扩展,记录配置变更历史 | 配置审计、变更追踪
44+
| 31 | xref:master/ecosystem_components/pg_jieba.adoc[pg_jieba] | master branch | 中文分词扩展,能够将连续的中文文本切分成有意义的词语序列,为中文全文搜索提供基础支持 | 全文搜索、自然语言处理
45+
| 32 | xref:master/ecosystem_components/pg_track_settings.adoc[pg_track_settings] | 2.1.2 | PostgreSQL 配置跟踪扩展,记录配置变更历史 | 配置审计、变更追踪
4546
|====
4647

4748
这些插件均经过 IvorySQL 团队的测试和适配,确保在 IvorySQL 环境下稳定运行。用户可以根据业务需求选择合适的插件,进一步提升数据库系统的能力和灵活性。
Lines changed: 68 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,68 @@
1+
2+
:sectnums:
3+
:sectnumlevels: 5
4+
5+
= pg_jieba
6+
7+
== 概述
8+
9+
pg_jieba 是PostgreSQL的一个中文分词扩展,基于著名的结巴分词(Jieba)开发。它能够将连续的中文文本切分成有意义的词语序列,为中文全文搜索提供基础支持。
10+
11+
== 功能特点
12+
13+
* *支持三种分词模式*:精确模式、全模式和搜索引擎模式。
14+
* *与PostgreSQL/IvorySQL无缝集成*
15+
* *支持自定义词典*
16+
* *支持词性标注*
17+
18+
== 安装部署
19+
20+
=== 编译安装 pg_jieba
21+
22+
假设IvorySQL已经安装在 ~/ivy_5/inst 目录中。
23+
24+
[source,shell]
25+
----
26+
git clone https://github.com/jaiminpan/pg_jieba.git
27+
cd pg_jieba
28+
git submodule update --init --recursive
29+
mkdir build;cd build
30+
cmake -DCMAKE_PREFIX_PATH=~/ivy_5/inst ..
31+
make; make install
32+
----
33+
34+
安装成功后,`pg_jieba.so` 等文件会被放置到 IvorySQL 的安装目录中。
35+
36+
=== 创建扩展并验证
37+
38+
[source,sql]
39+
----
40+
CREATE EXTENSION IF NOT EXISTS pg_jieba;
41+
SELECT name,
42+
default_version,
43+
installed_version,
44+
comment
45+
FROM pg_available_extensions
46+
WHERE name = 'pg_jieba';
47+
----
48+
49+
== 使用
50+
51+
执行如下sql示例:
52+
53+
[source,sql]
54+
----
55+
select * from to_tsquery('jiebacfg', '是拖拉机学院手扶拖拉机专业的。不用多久,我就会升职加薪,当上CEO,走上人生巅峰。');
56+
to_tsquery
57+
-----------------------------------------------------------------------------------------------
58+
'拖拉机' & '学院' & '手扶拖拉机' & '专业' & '不用' & '多久' & '会' & '升职' & '加薪' & '当上' & 'ceo' & '走上' & '人生' & '巅峰'
59+
(1 row)
60+
61+
select * from to_tsvector('jiebacfg', '是拖拉机学院手扶拖拉机专业的。不用多久,我就会升职加薪,当上CEO,走上人生巅峰。');
62+
to_tsvector
63+
-----------------------------------------------------------------------------------------------------
64+
'ceo':18 '不用':8 '专业':5 '人生':21 '会':13 '加薪':15 '升职':14 '多久':9 '学院':3 '巅峰':22 '当上':17 '手扶拖拉机':4 '拖拉机':2 '走上':20
65+
(1 row)
66+
----
67+
68+

EN/modules/ROOT/nav.adoc

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,7 @@
7676
*** xref:master/ecosystem_components/zhparser_en.adoc[zhparser]
7777
*** xref:master/ecosystem_components/pgbackrest.adoc[pgBackRest]
7878
*** xref:master/ecosystem_components/set_user.adoc[set_user]
79+
*** xref:master/ecosystem_components/pg_jieba.adoc[pg_jieba]
7980
*** xref:master/ecosystem_components/pg_track_settings.adoc[pg_track_settings]
8081
* Monitor and O&M
8182
** xref:master/getting-started/daily_monitoring.adoc[Monitoring]

EN/modules/ROOT/pages/master/ecosystem_components/ecosystem_overview.adoc

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -41,8 +41,9 @@ IvorySQL, as an advanced open-source database compatible with Oracle and based o
4141
|*27*| xref:master/ecosystem_components/pg_readonly_en.adoc[pg_read_only] | 1.0.5 | Allows to set all PostgreSQL cluster databases read only. | System debugging、disaster recevory
4242
|*28*| xref:master/ecosystem_components/zhparser_en.adoc[zhparser] | master branch | PostgreSQL extension for full-text search of Chinese language (Mandarin Chinese). It implements a Chinese language parser base on the | Search engine、keyword extraction
4343
|*29*| xref:master/ecosystem_components/pgbackrest.adoc[pgBackRest] | 2.58.0 | pgBackRest is a reliable backup and restore solution for PostgreSQL that seamlessly scales up to the largest databases and workloads | Disaster recovery backup, large database backup, off-site/multi-tier disaster recovery
44-
| *30* | xref:master/ecosystem_components/set_user.adoc[set_user] | REL4_2_0 | PostgreSQL security auditing extension with controlled role switching, supporting allowlists, enforced auditing, and blocking of high-risk operations | Controlled role switching, privilege management, audit logging
45-
| *31* | xref:master/ecosystem_components/pg_track_settings.adoc[pg_track_settings] | 2.1.2 | PostgreSQL configuration tracking extension that records configuration change history | Configuration auditing, change tracking
44+
|*30*| xref:master/ecosystem_components/set_user.adoc[set_user] | REL4_2_0 | PostgreSQL security auditing extension with controlled role switching, supporting allowlists, enforced auditing, and blocking of high-risk operations | Controlled role switching, privilege management, audit logging
45+
|*31*| xref:master/ecosystem_components/pg_jieba.adoc[pg_jieba] | master branch | Chinese word segmentation extension, which segments continuous Chinese text into meaningful word sequences, providing fundamental support for full-text search | Full-text search and natural language processing (NLP)
46+
|*32*| xref:master/ecosystem_components/pg_track_settings.adoc[pg_track_settings] | 2.1.2 | PostgreSQL configuration tracking extension that records configuration change history | Configuration auditing, change tracking
4647
|====
4748

4849
These plugins have all been tested and adapted by the IvorySQL team to ensure stable operation in the IvorySQL environment. Users can select appropriate plugins based on business needs to further enhance the capabilities and flexibility of the database system.
Lines changed: 67 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,67 @@
1+
2+
:sectnums:
3+
:sectnumlevels: 5
4+
5+
= pg_jieba
6+
7+
== Overview
8+
9+
pg_jieba is a Chinese word segmentation extension for PostgreSQL, developed based on the well-known Jieba (结巴分词) segmentation library. It can split continuous Chinese text into meaningful sequences of words, providing foundational support for Chinese full-text search.
10+
11+
== Features
12+
13+
* *Supports three segmentation modes*: precise mode, full mode, and search engine mode.
14+
* *Seamless integration with PostgreSQL/IvorySQL*
15+
* *Supports custom dictionaries*
16+
* *Supports part-of-speech tagging*
17+
18+
== Installation and Deployment
19+
20+
=== Building and Installing pg_jieba
21+
22+
Assume IvorySQL has already been installed in the `~/ivy_5/inst` directory.
23+
24+
[source,shell]
25+
----
26+
git clone https://github.com/jaiminpan/pg_jieba.git
27+
cd pg_jieba
28+
git submodule update --init --recursive
29+
mkdir build;cd build
30+
cmake -DCMAKE_PREFIX_PATH=~/ivy_5/inst ..
31+
make; make install
32+
----
33+
34+
After a successful installation, files such as `pg_jieba.so` will be placed into IvorySQL's installation directory.
35+
36+
=== Creating and Verifying the Extension
37+
38+
[source,sql]
39+
----
40+
CREATE EXTENSION IF NOT EXISTS pg_jieba;
41+
SELECT name,
42+
default_version,
43+
installed_version,
44+
comment
45+
FROM pg_available_extensions
46+
WHERE name = 'pg_jieba';
47+
----
48+
49+
== Usage
50+
51+
Run the following SQL example:
52+
53+
[source,sql]
54+
----
55+
select * from to_tsquery('jiebacfg', '是拖拉机学院手扶拖拉机专业的。不用多久,我就会升职加薪,当上CEO,走上人生巅峰。');
56+
to_tsquery
57+
-----------------------------------------------------------------------------------------------
58+
'拖拉机' & '学院' & '手扶拖拉机' & '专业' & '不用' & '多久' & '会' & '升职' & '加薪' & '当上' & 'ceo' & '走上' & '人生' & '巅峰'
59+
(1 row)
60+
61+
select * from to_tsvector('jiebacfg', '是拖拉机学院手扶拖拉机专业的。不用多久,我就会升职加薪,当上CEO,走上人生巅峰。');
62+
to_tsvector
63+
-----------------------------------------------------------------------------------------------------
64+
'ceo':18 '不用':8 '专业':5 '人生':21 '会':13 '加薪':15 '升职':14 '多久':9 '学院':3 '巅峰':22 '当上':17 '手扶拖拉机':4 '拖拉机':2 '走上':20
65+
(1 row)
66+
----
67+

0 commit comments

Comments
 (0)