Skip to content

Starrocks Connector for Kafka

容器化安装

注:

  • starrocks-connector-for-kafka 基于 kafka 3.9.0 版本打包 docker 镜像,支持 kafka 3.9.x ~ 4.0.0

build image docker pull ghcr.io/someone/starrocks-connector-for-kafka:25.03.28

shell
export PATH_DATA=$HOME/v/data/starrocks-connector-for-kafka
mkdir -p $PATH_DATA

export PATH_ETC=$HOME/v/etc/starrocks-connector-for-kafka
mkdir -p $PATH_ETC


cat << EOF > $PATH_ETC/connect-standalone.properties
...
EOF

cat << EOF > $PATH_ETC/connect-starrocks-sink.properties
...
EOF


docker run \
-d \
--restart unless-stopped \
--name src \
--network kaf_cluster \
-p 8083:8083 \
-v PATH_DATA:/tmp/ \
-v $PATH_ETC/connect-standalone.properties:/opt/kafka/config/connect-standalone.properties \
-v $PATH_ETC/connect-starrocks-sink.properties:/opt/kafka/config/connect-starrocks-sink.properties \
ghcr.io/someone/starrocks-connector-for-kafka:25.03.28

NOTICES

  • connector 会将 JSON 类型字段值自动序列化为 string 写入 db varchar type column ;
  • starrocks-connector-for-kafka 1.0.4 不兼容 kafka 4.0.0 jar/class,只兼容 kafka 3.9.0;基于 3.9.0 打 docker 镜像包后,可读 4.0.0 版本的 kafka 集群。

Released under the CC-BY-NC-4.0