File formats supported by Talend Data Preparation
From a local file
You can import the following file types to use as datasets:
- .xls or .xlsx
- Files with separator
Preparations based on local files can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
For more information, see Adding a dataset from a local file.
From a Talend Job
In addition to the previous file types, you have the possibility to use datasets created directly from a Talend Job in Talend Studio.
You can do that by using the tDatasetOutput component as output for your Job in Talend Studio.Then you can either:
- Run the Job directly in Talend Studio. For more information, see the documentation for the Data Preparation components.
- Use the live dataset feature to run it via Talend Administration Center and access the data directly in Talend Data Preparation. For more information, see "Working with live datasets".
Preparations based on Talend Jobs can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
From a database
Talend Data Preparation is able to connect to various databases and use them as source to create a new dataset. The data is still stored in your database, and only a sample is retrieved on-demand.
Preparations based on database datasets can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
- HDFS as file with separator, Avro or Parquet
For more information, see Adding a dataset from a database.
From HDFS
You can access data that is stored on a Hadoop file system (HDFS), and import it in the form of a dataset, directly in the Talend Data Preparation interface.
You can import the following file types stored on HDFS:
- File with separator
- .xlsx
- Avro
- Parquet
Preparations based on HDFS files can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
- HDFS as file with separator, Avro or Parquet
For more information, see "Adding a dataset from HDFS".
From Salesforce
You can access data that is stored on Salesforce, and import it in the form of a dataset, directly in the Talend Data Preparation interface.
Preparations based on Salesforce datasets can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
For more information, see Adding a dataset from Salesforce.
From Amazon S3
You can access data that is stored on Amazon S3, and import it in the form of a dataset, directly in the Talend Data Preparation interface.
You can import the following file types stored on Amazon S3:
- File with separator
- .xlsx
- Avro
- Parquet
Preparations based on Amazon S3 files can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
- HDFS as file with separator, Avro or Parquet
For more information, see Adding a dataset from Amazon S3.
From Azure Data Lake Storage Gen2
You can access data that is stored on ADLS Gen2, and import it in the form of a dataset, directly in the Talend Data Preparation interface.
You can import the following file types stored on ADLS Gen2:
- Local file with separator
- Avro
- Parquet
- JSON
Preparations based on ADLS Gen2 datasets can be exported to the following formats:
- Local file with separator
- Local .xlsx
- Local Tableau
- Amazon S3
For more information, see Adding a dataset from Azure DLS Gen2.