Hi,
I am trying to import data to hive (HDP 2.4) from teradata 14.10 using TDCH.
TDCH ver is 1.3.4 as for 1.4.1 the hadoop jar .... command gives invalid jar file error. here is command i am using.
export HADOOP_HOME=/usr/hdp/current/hadoop-client/
export HIVE_HOME=/usr/hdp/current/hive-client/
export HCAT_HOME=/usr/hdp/current/hive-webhcat/
export USERLIBTDCH=/usr/lib/tdch/1.3/lib/teradata-connector-1.3.4.jar
export LIB_JARS=/usr/hdp/2.4.0.0-169/sqoop/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/sqoop/lib/avro-mapred-1.7.5-hadoop2.jar,$HIVE_HOME/conf,$HIVE_HOME/lib/antlr-runtime-3.4.jar,$HIVE_HOME/lib/commons-dbcp-1.4.jar,$HIVE_HOME/lib/commons-pool-1.5.4.jar,$HIVE_HOME/lib/datanucleus-api-jdo-3.2.6.jar,$HIVE_HOME/lib/datanucleus-core-3.2.10.jar,$HIVE_HOME/lib/datanucleus-rdbms-3.2.9.jar,$HIVE_HOME/lib/hive-cli.jar,$HIVE_HOME/lib/hive-exec.jar,$HIVE_HOME/lib/hive-jdbc.jar,$HIVE_HOME/lib/hive-metastore.jar,$HIVE_HOME/lib/jdo-api-3.0.1.jar,$HIVE_HOME/lib/libfb303-0.9.2.jar,$HIVE_HOME/lib/libthrift-0.9.2.jar,$HCAT_HOME/share/hcatalog/hive-hcatalog-core.jar,/usr/lib/ambari-agent/DBConnectionVerification.jar
yarn jar $USERLIBTDCH com.teradata.connector.common.tool.ConnectorImportTool -libjars $LIB_JARS \
-url jdbc:teradata://ipaddress/database=db1 -username user1 -password pwd1 \
-jobtype hive -fileformat rcfile -sourcetable ITEM_GROUP_TYPE -nummappers 1 \
-targettable ITEM_GROUP_TYPE
when i run above command. following error is returned
16/07/30 21:33:46 INFO tool.ConnectorImportTool: ConnectorImportTool starts at 1469914426192
16/07/30 21:33:49 INFO common.ConnectorPlugin: load plugins in file:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/hadoop-unjar561556663592675147/teradata.connector.plugins.xml
16/07/30 21:33:50 INFO tool.ConnectorImportTool: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/metastore/api/NoSuchObjectException
at com.teradata.connector.common.tool.ConnectorImportTool.processArgs(ConnectorImportTool.java:607)
at com.teradata.connector.common.tool.ConnectorImportTool.run(ConnectorImportTool.java:57)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at com.teradata.connector.common.tool.ConnectorImportTool.main(ConnectorImportTool.java:721)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.metastore.api.NoSuchObjectException
there is no such file created /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/hadoop-unjar561556663592675147/teradata.connector.plugins.xml
am i missing something in commadn line or do i need to install any pluging explicity?
Thanks