Skip to main content Skip to complementary content

Configuring Talend Data Preparation

Configuring Talend Data Preparation after installation

Procedure

  1. Open the <Data_Preparation_Path>/config/application.properties file and edit the following Talend Data Preparation properties:
    Field Action
    public.ip Enter the hostname you want to use to access Talend Data Preparation.
    server.port Enter the port you want to use for Talend Data Preparation user interface.
    iam.ip Enter the URL to your Talend Identity and Access Management instance.
    spring.security.oauth2.client.registration.oidc.clientId Enter the Talend Identity and Access Management OIDC client identifier.
    spring.security.oauth2.resourceserver.iam.opaque-token.clientId Enter the Talend Identity and Access Management OIDC client identifier.
    spring.security.oauth2.client.registration.oidc.clientSecret Enter the Talend Identity and Access Management OIDC client password.
    spring.security.oauth2.resourceserver.iam.opaque-token.clientSecret Enter the Talend Identity and Access Management OIDC client password.
    iam.uri Make sure that Talend Identity and Access Management port is correct.
    iam.api.uri Make sure that Talend Identity and Access Management port is correct.
    app.products[0].id=TDS

    app.products[0].name=Data Stewardship

    app.products[0].url=<place_your_tds_url_here>

    Enter the URL to your Talend Data Stewardship instance.

    All the passwords entered in the properties file are encrypted when you start your Talend Data Preparation instance.

  2. Update the following fields with your MongoDB settings:
    Field Description
    spring.data.mongodb.host Host name of your MongoDB instance
    spring.data.mongodb.port Port number of your MongoDB instance
    spring.data.mongodb.database Name of the database on which Talend Data Preparation is connected, dataprep by default. The database is created when you first launch Talend Data Preparation.
    spring.data.mongodb.username Username used to connect to the database
    spring.data.mongodb.password Password used to connect to the database
  3. To enable the interaction between Talend Data Preparation and the Components Catalog service, edit the following line with your Components Catalog server host and port:
    tcomp.server.url=http://<tcomp_host>:<tcomp_port>/tcomp
  4. To enable the app switcher after installing Talend Data Preparation and Talend Data Stewardship, uncomment the following lines and add the URL to your Talend Data Stewardship instance:
    app.products[0].id=TDS
    app.products[0].name=Data Stewardship
    app.products[0].url=<place_your_tds_url_here>

    You must also add the URL to your Talend Data Preparation instance to the configuration file for Talend Data Stewardship. For more information, see the section about configuring Talend Data Stewardship after installation.

  5. By default, audit logs are enabled. You must specify the correct appender.http.url parameter in the audit.properties file, or disable audit logs. For more information, see Enabling and configuring audit capabilities in Talend Data Preparation.
  6. To configure the access to Talend Dictionary Service, edit the following fields:
    Field Description
    dataquality.semantic.list.enable Set the value of this parameter to true in order to display the semantic type management interface in Talend Data Preparation.
    dataquality.server.url Enter the URL to your Talend Dictionary Service instance, http://<local machine ip>:8187/ for example.
    tsd.enabled Set the value of this parameter to true in order to enable the interaction between Talend Data Preparation and Talend Dictionary Service
    tsd.maven.connector.s3Repository.bucket-url Enter the URL of your MinIO or S3 repository bucket.

    For example: s3://talend-app-shared.

    tsd.maven.connector.s3Repository.base-path Enter the base path of your MinIO or S3 repository. This property is optional and can be left empty.

    For example: semantic-types-repository.

    tsd.maven.connector.s3Repository.username Enter the username of your MinIO or S3 repository.

    For example: username123.

    tsd.maven.connector.s3Repository.password Enter the password of your MinIO or S3 repository.

    For example: password123.

    tsd.maven.connector.s3Repository.s3.region Enter the region of your MinIO or S3 repository.

    For example: us-east-1.

    tsd.maven.connector.s3Repository.s3.endpoint Enter the URL of your MinIO or S3 repository server.

    For example: https://minio-company.com.

    tsd.dictionary-provider-facade.producer-url Enter the URL to your Talend Dictionary Service instance.
    spring.cloud.stream.kafka.binder.brokers Enter the host corresponding to your Kafka broker.
  7. To enable the semantic types, edit the following lines: dataquality.semantic.list.enable=true and dataquality.server.url=http://<local machine ip>:8187/.
  8. Before starting Talend Data Preparation, launch, in this order:
    1. Apache Kafka
    2. MongoDB
    3. MinIO
  9. Execute the start.sh file to start your Talend Data Preparation instance.

Configuring logs for Talend Data Preparation

About this task

Talend Data Preparation logs allows you to analyze and debug the activity of Talend Data Preparation.

Talend Data Preparation logs are located in <Data_Preparation_Path>/data/logs/app.log.

To configure the settings of your log files, edit the <Data_Preparation_Path>/config/log4j2.xml file:

Procedure

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!