Reset JDBC Kafka connector to start pulling rows from the beginning of time?

The Kafka connector can use the primary key and timestamp to determine which rows to process.

I am looking for a way to reset a Connector so that it is handled from the start.

+3


source to share


1 answer


Because the requirement is distributed in a distributed fashion, the easiest way is to update the connector name to the new value. This will cause a new entry to be made to the connect-offset topic as it looks like a brand new connector. The connector must then start reading again as if nothing had been written by Kafka yet. You can also manually send a tombstone message to the key in the join-offset topic associated with that particular connector, but renaming is much easier than dealing with it. This method applies to all source connectors, not just the JDBC described here.



+2


source







All Articles