Reset the JDBC Kafka Connector to start pulling rows from the beginning of time?(重置 JDBC Kafka 连接器以从一开始就开始拉行?)
问题描述
Kafka 连接器可以使用主键和时间戳来确定需要处理哪些行.
The Kafka Connector can make use of a primary key and a timestamp to determine which rows need to be processed.
我正在寻找一种重置连接器的方法,以便它从一开始就进行处理.
I'm looking for a way to reset the Connector so that it will process from the beginning of time.
推荐答案
因为要求是在分布式模式下运行,所以最简单的做法是将连接器名称更新为新值.这将提示在 connect-offsets 主题中创建一个新条目,因为它看起来像一个全新的连接器.然后连接器应该再次开始读取,好像还没有向 Kafka 写入任何内容.您还可以手动向与该特定连接器关联的连接偏移主题中的键发送墓碑消息,但重命名比处理它容易得多.此方法适用于所有源连接器,而不仅仅是此处描述的 JDBC 连接器.
Because the requirement is to run in distributed mode, the easiest thing to do is to update the connector name to a new value. This will prompt a new entry to be made into the connect-offsets topic as it looks like a totally new connector. Then the connector should start reading again as if nothing has been written to Kafka yet. You could also manually send a tombstone message to the key in the connect-offsets topic associated with that particular connector, but renaming is much easier than dealing with that. This method applies to all source connectors, not only the JDBC one described here.
这篇关于重置 JDBC Kafka 连接器以从一开始就开始拉行?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持编程学习网!
本文标题为:重置 JDBC Kafka 连接器以从一开始就开始拉行?
基础教程推荐
- 将数据从 MS SQL 迁移到 PostgreSQL? 2022-01-01
- SQL Server 中单行 MERGE/upsert 的语法 2021-01-01
- SQL Server 2016更改对象所有者 2022-01-01
- 如何在 SQL Server 的嵌套过程中处理事务? 2021-01-01
- Sql Server 字符串到日期的转换 2021-01-01
- 在 VB.NET 中更新 SQL Server DateTime 列 2021-01-01
- SQL Server:只有 GROUP BY 中的最后一个条目 2021-01-01
- ERROR 2006 (HY000): MySQL 服务器已经消失 2021-01-01
- 无法在 ubuntu 中启动 mysql 服务器 2021-01-01
- 使用pyodbc“不安全"的Python多处理和数据库访问? 2022-01-01