what would cause this debezium kafka connector error? - apache-kafka-connect

Question

I'm looking to connect mysql --> debezium --> kafka (confluent cloud). I was wondering if someone can help me with this error msg:
Failed to find any class that implements Connector and which name matches io.debezium.connector.mysql.MySqlConnector.
I have the jar files for debezium in my kafka worker's file:
plugin.path=/home/ec2-user/kafka/plugins
The content of the plugin folder has the following:
-antlr4-runtime-4.7.2.jar
-debezium-api-1.5.3.Final.jar
-debezium-connector-mysql-1.5.3.Final.jar
-debezium-core-1.5.3.Final.jar
-debezium-ddl-parser-1.5.3.Final.jar
-failureaccess-1.0.1.jar
-guava-30.0-jre.jar
-mysql-binlog-connector-java-0.25.1.jar
-mysql-connector-java-8.0.21.jar
when I started up the distributor, I see that the plugins are added:
[2021-06-24 23:01:54,680] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-api-1.5.3.Final.jar}
[2021-06-24 23:01:54,684] INFO Loading plugin from: /home/ec2-user/kafka/plugins/debezium-connector-mysql-1.5.3.Final.jar
[2021-06-24 23:01:54,744] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-connector-mysql-
[2021-06-24 23:01:54,745] INFO Added plugin 'io.debezium.connector.mysql.transforms.ReadToInsertEvent'
[2021-06-24 23:01:54,745] INFO Loading plugin from: /home/ec2-user/kafka/plugins/debezium-core-1.5.3.Final.jar
[2021-06-24 23:01:54,866] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-core-1.5.3.Final.jar}
[2021-06-24 23:01:54,867] INFO Added plugin 'io.debezium.converters.CloudEventsConverter'
[2021-06-24 23:01:54,871] INFO Added plugin 'io.debezium.transforms.outbox.EventRouter'
[2021-06-24 23:01:54,872] INFO Added plugin 'io.debezium.transforms.ExtractNewRecordState'
[2021-06-24 23:01:54,872] INFO Added plugin 'io.debezium.transforms.ByLogicalTableRouter'
[2021-06-24 23:01:54,873] INFO Added plugin 'io.debezium.transforms.tracing.ActivateTracingSpan'
[2021-06-24 23:01:54,873] INFO Loading plugin from: /home/ec2-user/kafka/plugins/debezium-ddl-parser-1.5.3.Final.jar
[2021-06-24 23:01:55,060] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/debezium-ddl-parser-1.5.3.Final.jar}
[2021-06-24 23:01:55,061] INFO Loading plugin from: /home/ec2-user/kafka/plugins/failureaccess-1.0.1.jar
[2021-06-24 23:01:55,069] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/failureaccess-1.0.1.jar}
[2021-06-24 23:01:55,070] INFO Loading plugin from: /home/ec2-user/kafka/plugins/guava-30.0-jre.jar
[2021-06-24 23:01:55,307] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/ec2-user/kafka/plugins/guava-30.0-jre.jar}
However, when I run my curl command:
curl -s -X POST -H 'Content-Type: application/json' --data
#debe-connector.json http://localhost:8083/connectors -v
I get the error:
Failed to find any class that implements Connector and which name matches io.debezium.connector.mysql.MySqlConnector.
Any idea what I might be missing?
Thanks,

Answer 1

You need to put all the jar files of the debezium mysql connector inside a directory
/home/ec2-user/kafka/plugins/debezium-connector-mysql
instead of just under
/home/ec2-user/kafka/plugins

Answer 2

You can use the curl command
curl -X GET http://localhost:8083/connector-plugins
to see which plugins are installed correctly. If debezium is not listed here, that means there is a problem with the installation. You may want to check file permissions.