【问题标题】:Is Confluent required for JDBC source and sink connectors?JDBC 源连接器和接收器连接器是否需要 Confluent?
【发布时间】:2021-08-30 06:33:26
【问题描述】:

我需要专门为 Kafka JDBC 源和接收器连接器使用 Confluent,还是可以使用默认的 apache Kafka 实现?我尝试使用 JDBC 源配置作为工作属性启动独立连接,但出现以下异常:

Failed to find any class that implements Connector and which name matches io.confluent.connect.jdbc.JdbcSourceConnector, available connectors are: PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSinkConnector, name='org.apache.kafka.connect.file.FileStreamSinkConnector', version='2.8.0', encodedVersion=2.8.0, type=sink, typeName='sink', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSourceConnector, name='org.apache.kafka.connect.file.FileStreamSourceConnector', version='2.8.0', encodedVersion=2.8.0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorCheckpointConnector, name='org.apache.kafka.connect.mirror.MirrorCheckpointConnector', version='1', encodedVersion=1, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorHeartbeatConnector, name='org.apache.kafka.connect.mirror.MirrorHeartbeatConnector', version='1', encodedVersion=1, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.mirror.MirrorSourceConnector, name='org.apache.kafka.connect.mirror.MirrorSourceConnector', version='1', encodedVersion=1, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockConnector, name='org.apache.kafka.connect.tools.MockConnector', version='2.8.0', encodedVersion=2.8.0, type=connector, typeName='connector', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockSinkConnector, name='org.apache.kafka.connect.tools.MockSinkConnector', version='2.8.0', encodedVersion=2.8.0, type=sink, typeName='sink', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockSourceConnector, name='org.apache.kafka.connect.tools.MockSourceConnector', version='2.8.0', encodedVersion=2.8.0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.SchemaSourceConnector, name='org.apache.kafka.connect.tools.SchemaSourceConnector', version='2.8.0', encodedVersion=2.8.0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.VerifiableSinkConnector, name='org.apache.kafka.connect.tools.VerifiableSinkConnector', version='2.8.0', encodedVersion=2.8.0, type=source, typeName='source', location='classpath'}, PluginDesc{klass=class org.apache.kafka.connect.tools.VerifiableSourceConnector, name='org.apache.kafka.connect.tools.VerifiableSourceConnector', version='2.8.0', encodedVersion=2.8.0, type=source, typeName='source', location='classpath'}

我有一个如下所示的插件目录(从 Confluent 下载插件):

我的standalone.bat 如下所示:

【问题讨论】:

  • 安装插件后有没有重启worker?
  • 是的,我做到了。我不确定这里的问题是什么以及为什么它无法读取这些罐子。

标签: java apache-kafka apache-kafka-connect confluent-platform


【解决方案1】:

不,不需要 Confluent 平台。

在 Windows 中,属性文件中的文件路径需要双反斜杠 - 例如C:\\kafka\\plugins。还要确保该行没有尾随空格

另外请注意,Kafka 在 Windows 上的测试并没有得到很好的测试,所以你可能想try WSL2 instead

【讨论】:

    猜你喜欢
    • 2019-08-08
    • 2019-06-11
    • 2021-05-07
    • 1970-01-01
    • 2020-12-09
    • 1970-01-01
    • 2018-10-01
    • 1970-01-01
    • 2019-06-17
    相关资源
    最近更新 更多