Clever Geek Handbook

Kafka Confluent S3 Connector "Class could not be found"

I am trying a simple quick start example and I am getting:

Caused by: org.apache.kafka.connect.errors.ConnectException: Could not find any class that implements Connector and what name matches io.confluent.connect.s3.S3SinkConnector, available sockets: io.confluent.connect.jdbc.JdbcSinkConnector, io.confluent.connect.jdbc.JdbcSourceConnector, org.apache.kafka.connect.tools.MockSinkConnector, org.apache.kafka.connect.file.FileStreamSourceConnector, org.apache.kafka.connect.sink.SinkConnector, .io connect.elasticsearch.ElasticsearchSinkConnector, org.apache.kafka.connect.tools.MockConnector, io.confluent.connect.hdfs.HdfsSinkConnector, org.apache.kafka.connect.file.FileStreamSinkConnector, org.apache.kafile VerifiableSourceConnector, org.apache.kafka.connect.tools.VerifiableSinkConnector, org.apache.kafka.connect.tools.SchemaSourceConnector, org.apache.kafka.connect.source.SourceConnector, org.apache.kafka.connect.tools.MockSourceConnector, io.confluent.connect.hdfs.tools.SchemaSourceConnector

This is a new virtual machine that has the latest Confluent Platform 3.2.0 installed via the Debian apt package. I see that this definitely works CP 3.2.0. Why won't the S3 class be available?

Not sure if this is related, but if I do this:

ls -l /etc/ | grep kafka
drwxr-xr-x 2 root root           4096 Apr  5 04:41 kafka
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-connect-elasticsearch
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-connect-hdfs
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-connect-jdbc
drwxr-xr-x 2 root root           4096 Apr  5 04:39 kafka-rest

The docs refer to the kafka-connect-s3 directory, which clearly does not exist in the installation.

I'm using the Open Source variant of the Confluent Platform, but according to https://www.confluent.io/product/compare/ , the open source version includes Confluent Amazon S3 Connect connector.

+3


source to share


3 answers


This was a packaging bug in 3.2.0 and was fixed in the latest version of Confluent which is 3.2.1 as of today (May 17, 2017)



Version 3.2.1 also has a bug fix for the S3 connector, so it's better to use that version anyway.

+1


source


I am using CP version 3.2 and I have a bottom folder in the download that contains the required jar (kafka-connect-s3-3.2.0) in windows but when installed using RPM it is not available.

Windows contains below:



"degenerate-os-3.2.0-2.11 \ merging-3.2.0 \ share \ java \ kafka-connect-s3".

For RPM, a problem should be raised.

+1


source


As a workaround, you can download the zip or tar version from http://confluent.io

From there you will find kafka-connect-s3

in the directory etc

and share/java

.

+1


source






More articles:


All Articles