0
votes

I am trying to make oracle-kafka connection with . There is a sqoop-kafka connector in this website, but documentation here is https://sqoop.apache.org/docs/1.99.7/user/connectors/Connector-Kafka.html but there is not clean explanation in this documantation and also anywhere. And I am stuck on this problem. I know there are connectors for oracle and kafka but I am trying in this way.

sqoop import --connect "jdbc:oracle:thin:@IP:1521/dbname --username user --password pass --table result --topic testing

ERROR tool.BaseSqoopTool: Error parsing arguments for import:
ERROR tool.BaseSqoopTool: Unrecognized argument: --topic
ERROR tool.BaseSqoopTool: Unrecognized argument: test

and also I tried this and I also get error

sqoop import --connect "jdbc:oracle:thin:@IP:1521/dbname --username user --password pass --table result --broker-list IP --topic testing

ERROR tool.BaseSqoopTool: Error parsing arguments for import:
ERROR tool.BaseSqoopTool: Unrecognized argument: --broker-list
ERROR tool.BaseSqoopTool: Unrecognized argument: testing
1
I would suggest looking into Kafka Connect rather than Sqoop for this, and I think you are using the wrong Sqoop installation because Sqoop 1.99 is a mostly a re-write that uses a REST API not a CLIOneCricketeer
I know kafka-connect confluent and any other github projects but I am trying in this way, which I wrote in my question. I dont get it what was wrong the sqoop code?newUser
You're using Sqoop1, not Sqoop2. There is no sqoop import for Sqoop2 sqoop.apache.org/docs/1.99.7/user/Sqoop5MinutesDemo.htmlOneCricketeer
@OneCricketeer I dont know which sqoop command what to use to send data to kafka topic. Because there is not clear explanation about it. I just write it import.newUser
The documentation covers it, but it's spread out. That "5 minute tutorial" covers every step though... Start Sqoop2 server. Connect shell to Sqoop2 server. Create a link with connector and job with connector. Start the job. That's it. You use sqoop2-shell or the REST API linked in the sidebarOneCricketeer

1 Answers

-1
votes

Try to add quote to the end of connection string:

"jdbc:oracle:thin:@IP:1521/dbname"