Quantcast
Channel: Teradata Forums - Hadoop
Browsing latest articles
Browse All 62 View Live

Big Analytics Appliance - forum topic by abhishes

I saw a presentation on big analytics appliance which gives Hadoop, aster and teradata all in one appliance. and then a language called sql-h which allows query on all 3.  A question I had was that the...

View Article



Teradata Commodity Hardware for Hadoop - forum topic by abhishes

Suppose a customer is using Teradata already and wants to move some of the unused data to Hadoop. Suppse we use the "Teradata Commodity Offering for Hadoop"1  to build a hadoop cluster using commodity...

View Article

Will sqoop import command work with Teradata Dbase 15? - forum topic by steveka

Hello, I am new to Teradata.  For our project, we are currently using Teradata 13.10, and planning an upgrade to V. 15 soon. The client is doing "Big Data Analysis"  To pull the data into Hadoop, they...

View Article

Will sqoop import command work with Teradata Dbase 15? - response (1) by...

Dear @Steveka, 1) You can use the same Sqoop import for TD 15 just make sure that you are using latest Teradata driver (v15.0) https://downloads.teradata.com/download/connectivity/jdbc-driver  2) I...

View Article

Teradata Commodity Hardware for Hadoop - response (1) by prasaddhoble

Dear @Abhishes, Teradata has discontinued the SQL-H from version 15 onwards. But you can use Teradata QueryGrid for same purpose. QueryGrid works independent of your hardware. It is currently (v15)...

View Article


Sqoop export fails with untranslatable character error - response (2) by...

Hi nandkarthik, I am also facing same issue while exporting data from Hdfs to Teradata using sqoop export (internally uses teradata connector for hadoop). are you able to find any solution for the...

View Article

Free Webinar on Big Data and Hadoop Developer - forum topic by poonam patel

Hi Everyone, Learn Big Data and Hadoop Developer course with GreyCampus and get better job opportunities with Bigger organisations on the technology front   Topics What is big data? What is the need...

View Article

Grave Mistakes that Companies Make in Big Data Projects - forum topic by...

Hi All,  Big Data helps enterprises capture the information using software. Do you know what are the mistakes that enterprises do while implementing Big Data Projects?  Ubiquitous in the contemporary...

View Article


Sqoop export fails with untranslatable character error - response (3) by...

Hi, I am also facing similar issue. I am able to load data with 1K bytes but data is more than 1MB it throws following error  Error: com.teradata.hadoop.exception.TeradataHadoopSQLException:...

View Article


Big Data Governance – What is it? How to get started? - forum topic by poonam...

Security concerns are key for organizations in many industries today. Data governance can feel like a daunting prospect with organizations unsure of where to start and put off by the every increasing...

View Article

Can we recommend TDCH for Extract-Load process - forum topic by TDThrottle

Hi, We all knew TDCH use JDBC connectivity to establish connectivity between Hadoop and Teradata and to move data across these platforms. My question is using JDBC, if FastLoad operation is interrupted...

View Article

Can we recommend TDCH for Extract-Load process - response (1) by tomnolan

You are correct that the Teradata JDBC Driver does not support FastLoad checkpoints when using a TYPE=FASTLOAD connection.  However, that is a separate topic from TDCH's internal.fastload feature...

View Article

Can we recommend TDCH for Extract-Load process - response (2) by ToddAWalter

It would be worthwhile to diagnose why the connections/jobs are failing.  An enhancement request is a great idea but it is not as simple as turning on checkpointing. A whole mechanism to reposition the...

View Article


Can we recommend TDCH for Extract-Load process - response (3) by TDThrottle

Thanks Tom and Todd for sharing expertise inputs.@Tom Yes, we are Teradata customers will submit an enhancement request to "Teradata At Your Service" for TDCH internal.fastload to support FastLoad...

View Article

Multithreaded/MultiProcess inserts in teradata (Sqoop with teradata) - forum...

Hi all, I am trying to export a hive table to teradata using sqoop with teradata jdbc driver. The sqoop export works well only when I use a single mapper. With multiple mappers, the jdbc driver throws...

View Article


Free Webinar on Big Data and Hadoop Developer - forum topic by poonam patel

Hi,  GreyCampus is conducting Free Webinar on Big Data and Hadoop Developer(link is external). Learn Big Data & Hadoop Developer and become a Hadoop Expert by mastering MapReduce, Yarn, Pig, Hive,...

View Article

Can the TDCH be used to load data into view (in teradata) - forum topic by...

I was trying use TDCH connector to load the data from Hive table to Teradata table. But, I want to load the data into the targt table (in teradata) via VIEW instead of accessing the table directly....

View Article


Can the TDCH be used to load data into view (in teradata) - response (1) by...

Hi, Please see the TDCH README for a description of the 'tdch.output.teradata.data.dictionary.use.xview' property. You cannot use TDCH's internal.fastload method to load TD views; please try using...

View Article

Need to get common users to multiple users mapped to it - forum topic by Ram912

Hi, I have a table which has one user ID mapped to multiple user IDs. I want to get the common user IDs mapped to each of the two user IDs My Data looks in the following way User ID User ID 1 1 2 1 3 1...

View Article

Need to get common users for every combination of user IDs - forum topic by...

Hi, I have a table which has one user ID mapped to multiple other user IDs. I want to get the common user IDs mapped to every two user IDs  My Data looks in the following way User ID User ID 1 1 2 1 3...

View Article

Need to get common users for every combination of user IDs - response (1) by...

SELECT t1.UserId, t2.UserId, COUNT(*) FROM tab AS t1 JOIN tab AS t2 ON t1.UserId < t2.UserId -- different user id AND t1.UserId1 = t2.UserId1 -- same user id 1 GROUP BY 1,2  

View Article


Need to get common users for every combination of user IDs - response (2) by...

Thanks Dieter for the solution

View Article


Sqoop export fails with untranslatable character error - response (4) by...

Hi, We haven't found the solution. We restricted characters only to ASCII solved this issue on our side. -Karthik

View Article

Splitsize for the Hive table in TDCH - forum topic by ehbhaskar

I'm using TDCH to export a hive data into teradata table. For this I need to specify the number of mappers to my TDCH job. So, my question is "is this number of mappers option we give to TDCH job is...

View Article

Hive table export to Teradata using TDCH failing... due to connection reset -...

when exporting 2billion+ records into teradata from hadoop using TDCH (Teradata Connector for Hadoop) using the below command with "batch.insert", hadoop jar teradata-connector-1.3.2-hadoop210.jar...

View Article


Sqoop export fails with untranslatable character error - response (5) by...

I have a similar issue.  The data is already ASCII and per the customers request we are using ASCII \037 as a seperator in our tdch cli scripts.  Upon execution we error out because the data is being...

View Article

Sqoop export fails with untranslatable character error - response (6) by...

We found a solution to this problem.  TDCH will take an ASCII seperator in the form of unicode.  '\037' = '\u001F'  --Josh

View Article

How to load data from a hive table defined with custom serde to teradata...

Currently TDCH supports 4 file formats (RCFILE|ORCFILE|SEQUENCEFILE|TEXTFILE) . Is there a way to load data from a custom serde formatted table .? Any suggestions please ?  Thanks, RNForums: Hadoop

View Article

Image may be NSFW.
Clik here to view.

Why Big Data? - Live Webinar - forum topic by RathnaPC

Big Data refers to large sets of data that cannot be analyzed with traditional tools. Techfetch.com has planned to conduct a webinar “Why Big Data?” on Oct 23, 2015. You can come to know about various...

View Article



Hive table export to Teradata using TDCH failing... due to connection reset -...

Did you set the environment variables? Export these variables first and run your command. export TDCH_JAR=/usr/lib/tdch/1.3/lib/teradata-connector-1.3.3.jar export HADOOP_HOME=/usr/lib/hadoop export...

View Article

Teradata Binary file to Hadoop Sequence File - forum topic by muthu1802

Could Some one please help on how to convert teradata binary file to hadoop sequence file. I have exported data from teradata table to binary file using TPT in binary mode. How to convert that binary...

View Article

TDCH Import command - Export Data from Teradata to HADOOP - forum topic by...

All, Please can you help and advise on the following:- We are in the process of exporting data from Teradata to Hadoop using the TDCH (Teradata Connector for Hadoop). We have managed to successfully...

View Article

TDCH Import command - Export Data from Teradata to HADOOP - response (1) by...

Hanif, When importing data into Hadoop from Teradata, if you were to use a "sourcetable" option in your TDCH job, you have the ability to use either split.by.hash, split.by.value or even split.by.amp....

View Article


Teradata Binary file to Hadoop Sequence File - response (2) by td_admirer

Not sure what you meant by a teradata binary file, but if you have data loaded in a Teradata table, you can use TDCH to import the data into the Hadoop table created as "Sequence file".

View Article

Hadoop Interview - forum topic by Sonam

I am preparing for my Haddop Interview. Please suggest me some good questions. Tags: #Hadoop#BigData#jobForums: Hadoop

View Article

Hadoop Interview - response (1) by gryback

I would ensure you understand all the Hadoop software projects, both ones in incubation as well as active. A good starting place would be:  http://incubator.apache.org/projects/index.html 

View Article


Can we recommend TDCH for Extract-Load process - response (4) by wmmiteff

Is the 1.4.2 release also known for having these issues?  We are looking at using this for weekly unloads from Hadoop and loading to Teradata.

View Article


TDCH Import command - Export Data from Teradata to HADOOP - response (2) by...

Hi, When you use the "sourcequery" and the number of mappers > 1, by default it will take split.by.partition. You can force the number of mappers to 1 (--num-mappers 1). This would force it to opt...

View Article

Support for SUSE v12 on Teradata Appliance - forum topic by richoconnell

Hi, I'm trying to match up a configuration of Informatica's Big Data Management (BDM) tool with our Teradata Hadoop appliance.  The BDM tool will support SUSE v12 in May 2016.   What are the plans for...

View Article

Support for SUSE v12 on Teradata Appliance - response (1) by gryback

Our partner vendors don't support SLES12 yet. Check back with Informatica as they mentioned certifying with SLES11 as well. 

View Article

Top 10 Don’ts Of Big Data Project - forum topic by poonam patel

Hello Guys, These Top 10 don’ts of Big Data projects speak of practices that disallow the creation of data lakes for profit. Steer clear of them and go the right way to make your project a success....

View Article


Can the TDCH be used to load data into view (in teradata) - response (2) by...

Which TDCH README are you reading?  The only one I can find is the Teradata Connector for Hadoop Tutorial v 1.0 which has nothing of which you speak.

View Article

Using TDCH Export to move data from Hive view or query into Teradata - forum...

I have a Hive table that is too big for my Teradata database, but if I can exclude some of the columns, it should be OK.  Since I don't want to have a duplicate copy of the table with fewer columns on...

View Article


POM.xml for mapreduce development - "Hadoop 2.7.1.2.3.2.0-2950" - forum topic...

Hi - My organization uses Hadoop 2.7.1.2.3.2.0-2950. I am new to whole hadoop and mapreduce programming. I am looking for POM.xml for mapreduce program development. is there seperate repository detail...

View Article

Teradata connector points to old lib when runing TPT TDCH to import from...

Hi everyone, I have installed Teradata connector for hadoop 1.4.4 using teradata-connector-1.4.4-hadoop2.x.noarch.rpm and I can run "hadoop jar /usr/lib/tdch/1.4/lib/teradata-connector-1.4.4.jar" using...

View Article


Teradata connector points to old lib when runing TPT TDCH to import from...

OK, further investigation shows that the pre-existing TDCH 1.3.4 i.e. /opt/teradata/client/15.00/tbuild/jar/teradata- connector-hdp2.1.jar is part of installation of TPT release 15.00.00.05.  It is...

View Article

teradata.connector.plugins.xml - forum topic by ahhmedbilal

Hi,  I am trying to import data to hive (HDP 2.4) from teradata 14.10 using TDCH.  TDCH ver is 1.3.4 as for 1.4.1 the hadoop jar .... command gives invalid jar file error. here is command i am using....

View Article

Sqoop importing into Hive - supported file formats - forum topic by JaimeHolland

Hi, I'm new to Hadoop.  We are using CDH5.  I am managing to use sqoop to load from Teradata into Hive as textfile, but that seems to be the only supported option.  It seems like avro should work, but...

View Article

TDCH to Hive inserts NULL values - forum topic by vijitv

I have been trying to import Teradata Tables into Hive using the TDCH utility. The utility seems to be working fine since the connection is successful. However after the job completes and when I check...

View Article


What is the best way to import multiple tables into Hive from Teradata using...

Using TDCH, What is the best way to import multiple tables into Hive from Teradata? Is there an option to move an entire database from Teradata to Hive?Tags: tdchHiveimportmultipleForums: Hadoop

View Article

Browsing latest articles
Browse All 62 View Live




Latest Images