'Stream geometry points into kafka topic using kafka JDBC source connector
I am trying to stream a table from PostgreSQL to Kafka topic using Kafka JDBC connector.
This table contains a geometry column with data type Point
Here is my JDBC connector configuration:
curl -i -X PUT http://localhost:8083/connectors/source-jdbc-pg-00/config \
-H "Content-Type: application/json" -d '{
"connector.class" : "io.confluent.connect.jdbc.JdbcSourceConnector",
"connection.url" : "jdbc:postgresql://postgres:5432/postgres",
"connection.user" : "me",
"connection.password" : "12345",
"topic.prefix" : "pg-",
"mode" : "bulk",
"poll.interval.ms" : 3600000
}'
The connector is running successfully, but when I check the topic, the geometry column is missing.
Is it possible to stream geospatial data using Kafka JDBC connectors? Does anyone have any advice?
UPDATE 2021-04-12
I can see the postgis-jdbc-2.5.0.jar had been installed properly in this directory:
cd /usr/share/confluent-hub-components/confluentinc-kafka-connect-jdbc/lib
But when I checked the kafka-connect log, it seemed that the postgis jdbc plugin was not working properly,
kafka-connect | [2021-04-11 23:38:25,275] WARN [source-jdbc-pg-00|task-0] JDBC type 1111 ("public"."geometry") not currently supported (io.confluent.connect.jdbc.dialect.PostgreSqlDatabaseDialect:1153)
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
