Configuring Talend Data Preparation
Configuring Talend Data Preparation after installation
Procedure
-
Open the
<Data_Preparation_Path>/config/application.properties
file and edit the following Talend Data Preparation properties:
Field Action public.ip Enter the hostname you want to use to access Talend Data Preparation. server.port Enter the port you want to use for Talend Data Preparation user interface. iam.ip Enter the URL to your Talend Identity and Access Management instance. spring.security.oauth2.client.registration.oidc.clientId Enter the Talend Identity and Access Management OIDC client identifier. spring.security.oauth2.resourceserver.iam.opaque-token.clientId Enter the Talend Identity and Access Management OIDC client identifier. spring.security.oauth2.client.registration.oidc.clientSecret Enter the Talend Identity and Access Management OIDC client password. spring.security.oauth2.resourceserver.iam.opaque-token.clientSecret Enter the Talend Identity and Access Management OIDC client password. iam.uri Make sure that Talend Identity and Access Management port is correct. iam.api.uri Make sure that Talend Identity and Access Management port is correct. app.products[0].id=TDS app.products[0].name=Data Stewardship
app.products[0].url=<place_your_tds_url_here>
Enter the URL to your Talend Data Stewardship instance. All the passwords entered in the properties file are encrypted when you start your Talend Data Preparation instance.
-
Update the following fields with your MongoDB settings:
Field Description spring.data.mongodb.host Host name of your MongoDB instance spring.data.mongodb.port Port number of your MongoDB instance spring.data.mongodb.database Name of the database on which Talend Data Preparation is connected, dataprep by default. The database is created when you first launch Talend Data Preparation. spring.data.mongodb.username Username used to connect to the database spring.data.mongodb.password Password used to connect to the database -
To enable the interaction between Talend Data Preparation and the Components Catalog
service, edit the following line with your Components Catalog
server host and port:
tcomp.server.url=http://<tcomp_host>:<tcomp_port>/tcomp
-
To enable the app switcher after installing Talend Data Preparation
and Talend Data Stewardship,
uncomment the following lines and add the URL to your Talend Data Stewardship
instance:
app.products[0].id=TDS app.products[0].name=Data Stewardship app.products[0].url=<place_your_tds_url_here>
You must also add the URL to your Talend Data Preparation instance to the configuration file for Talend Data Stewardship. For more information, see the section about configuring Talend Data Stewardship after installation.
- By default, audit logs are enabled. You must specify the correct appender.http.url parameter in the audit.properties file, or disable audit logs. For more information, see Enabling and configuring audit capabilities in Talend Data Preparation.
-
To configure the access to Talend Dictionary Service, edit the following fields:
- Available in:
- Big Data Platform
- Data Fabric
- Data Management Platform
- Data Services Platform
- MDM Platform
- Qlik Talend Cloud Enterprise Edition
- Qlik Talend Cloud Premium Edition
- Real-Time Big Data Platform
Field Description dataquality.semantic.list.enable Set the value of this parameter to true in order to display the semantic type management interface in Talend Data Preparation. dataquality.server.url Enter the URL to your Talend Dictionary Service instance, http://<local machine ip>:8187/ for example. tsd.enabled Set the value of this parameter to true in order to enable the interaction between Talend Data Preparation and Talend Dictionary Service tsd.maven.connector.s3Repository.bucket-url Enter the URL of your MinIO or S3 repository bucket. For example: s3://talend-app-shared.
tsd.maven.connector.s3Repository.base-path Enter the base path of your MinIO or S3 repository. This property is optional and can be left empty. For example: semantic-types-repository.
tsd.maven.connector.s3Repository.username Enter the username of your MinIO or S3 repository. For example: username123.
tsd.maven.connector.s3Repository.password Enter the password of your MinIO or S3 repository. For example: password123.
tsd.maven.connector.s3Repository.s3.region Enter the region of your MinIO or S3 repository. For example: us-east-1.
tsd.maven.connector.s3Repository.s3.endpoint Enter the URL of your MinIO or S3 repository server. For example: https://minio-company.com.
tsd.dictionary-provider-facade.producer-url Enter the URL to your Talend Dictionary Service instance. spring.cloud.stream.kafka.binder.brokers Enter the host corresponding to your Kafka broker. - To enable the semantic types, edit the following lines: dataquality.semantic.list.enable=true and dataquality.server.url=http://<local machine ip>:8187/.
-
Before starting Talend Data Preparation,
launch, in this order:
- Apache Kafka
- MongoDB
- MinIO
- Execute the start.sh file to start your Talend Data Preparation instance.
Configuring logs for Talend Data Preparation
About this task
Talend Data Preparation logs allows you to analyze and debug the activity of Talend Data Preparation.
Talend Data Preparation logs are located in <Data_Preparation_Path>/data/logs/app.log.
To configure the settings of your log files, edit the <Data_Preparation_Path>/config/log4j2.xml file:
Procedure
-
For more information on how to set the Log4j information level, see the Apache Log4j documentation about information levels.
-
For more information on how to set the log rotation, see the Apache Log4j documentation about log rotation.
Did this page help you?
If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!