跳到主要内容 跳到补充内容

迁移 Talend Data Preparation 到 8.0.1 R2025-02 或更高版本

从 8.0.1 R2023-10 或之前版本(带有嵌入式 MongoDB)迁移到 8.0.1 R2025-02 或更高版本

开始之前

步骤

  1. 备份数据文件夹和 MongoDB 数据库。
  2. 备份 dataprep/config/application.properties 文件。
  3. 按如下方式更新 application.properties 文件:
    1. 删除以下属性:
      # Proxy for search purpose
               help.search.url=https://www.talendforge.org/find/api/THC.php
    2. 删除以下属性:
      # Support url
               support.url=https://www.talend.com/services/technical-support/
               # Community link
               community.url=https://community.talend.com/s/group/0F93p0000000VNyCAM/data-quality-preparation-stewardship
      将其替换为:
      # Support url
               support.url=https://community.qlik.com/t5/Support/ct-p/qlikSupport
               # Community link
               community.url=https://community.qlik.com/t5/Data-Quality-Preparation-Stewardship/bd-p/qlik-t-data-quality-prep-stewardship
    3. 添加以下属性:
      # To activate redis cache, use the following configuration
               #spring.cache.type=redis
               #spring.redis.auth.enable=false
               #spring.cache.cache-names=mongo:cache:configuration,oauthTokenInfoCache,account,configClientProperties,dataprepUsers,dataprepGroups,sharing
               #spring.cache.redis.time-to-live=10m
               #spring.data.redis.database=2
               #spring.data.redis.host=localhost
               #spring.data.redis.port=6379

    除非您想配置 Redis 缓存,否则不要启用这些属性。

结果

您已将数据迁移到 Talend Data Preparation 8.0.1 R2025-02。

使用外部 MongoDB 从 8.0.1 R2024-05 迁移到 8.0.1 R2025-02 或更高版本

开始之前

步骤

  1. 备份数据文件夹和 MongoDB 数据库。
  2. 备份 dataprep/config/application.properties 文件。
  3. 按如下方式更新 application.properties 文件:
    1. 删除以下属性:
      # Service documentation
               service.documentation=true
               service.documentation.name=Talend Data Preparation - API
               service.documentation.description=This service exposes high level services that may involve services orchestration.
               service.paths=api
               springfox.documentation.swagger.v2.host=${public.ip}:${server.port}${gateway-api.service.path}
               springfox.resources.prefix.url=${gateway-api.service.path}
               # see https://github.com/springfox/springfox/issues/2265
               logging.level.io.swagger.models.parameters.AbstractSerializableParameter=error
      
               security.basic.enabled=false
               security.oidc.client.expectedIssuer=${iam.uri}/oidc
               iam.license.url=${iam.uri}/oidc/api
               security.oidc.client.keyUri=${iam.uri}/oidc/jwk/keys
               security.oauth2.client.clientId=<security client id>
               security.oauth2.client.clientSecret=<security client secret>
               security.oidc.client.claimIssueAtTolerance=120
               # security.oauth2.resource.serviceId=${PREFIX:}resource
               security.oauth2.resource.tokenInfoUri=${iam.uri}/oidc/oauth2/introspect
               security.oauth2.resource.uri=/v2/api-docs,/api/**,/folders/**,/datasets/**,/dataset/**,/preparations/**,/transform/**,/version/**,/acl/**,/apply/**,/export,/export/**,/aggregate,/sampling/**,/receivers/**,/error,/datastores/**,/preparation/**,/actions/**,/suggest/**,/dictionary/**,/transformation/preparations/**,/transformation/v2/**,/sharing/**
               security.oauth2.resource.filter-order=3
               security.scim.enabled=true
      
               security.oauth2.client.access-token-uri=${iam.uri}/oidc/oauth2/token
               security.oauth2.client.scope=openid refreshToken
               security.oauth2.client.user-authorization-uri=${iam.uri}/oidc/idp/authorize
               security.oauth2.sso.login-use-forward=false
      
               security.oauth2.resource.tokenInfoUriCache.enabled=true
      
               # FIXME: temporary fix related to dataquality-semantic-consumer version = 11.2.0
               # FIXME: that will need to be removed as soon as we bump to spring boot 2.7 and bump dq library at the same time
               spring.cloud.stream.binders.kafka-binder-consumer.environment.spring.cloud.stream.kafka.binder.brokers=${spring.cloud.stream.kafka.binder.brokers}
      
               # Zuul properties
               gateway-api.service.url=http://${public.ip}:${server.port}
               zuul.servletPath=/gateway/upload
      
               zuul.routes.dq.path=/gateway/dq/semanticservice/**
               zuul.routes.dq.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.dq.url=${dataquality.server.url}/
               proxy.auth.routes.dq=oauth2
      
               zuul.routes.me.path=/gateway/api/v1/scim/me/**
               zuul.routes.me.url=${iam.scim.url}/Me
               proxy.auth.routes.me=oauth2
      
               zuul.routes.pendo.path=/gateway/api/iam-server/pendo/**
               zuul.routes.pendo.url=${iam.scim.url}/pendo
               proxy.auth.routes.pendo=oauth2
      
               zuul.routes.sharingset.path=/gateway/api/v1/sharingset/**
               zuul.routes.sharingset.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.sharingset.url=http://${public.ip}:${server.port}/sharing/v1/sharingset
               proxy.auth.routes.sharingset=oauth2
      
               zuul.routes.sharing.path=/gateway/api/v1/sharing/**
               zuul.routes.sharing.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.sharing.url=http://${public.ip}:${server.port}/sharing/v1/sharing
               proxy.auth.routes.sharing=oauth2
      
               zuul.routes.sharings.path=/gateway/api/v1/sharings/**
               zuul.routes.sharings.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.sharings.url=http://${public.ip}:${server.port}/sharing/v1/sharings
               proxy.auth.routes.sharings=oauth2
      
               zuul.routes.api.path=/gateway/api/**
               zuul.routes.api.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.api.url=http://${public.ip}:${server.port}/api
               proxy.auth.routes.api=oauth2
      
               spring.cloud.gateway.mvc.routes[0].id=api
               spring.cloud.gateway.mvc.routes[0].uri=http://${public.ip}:${server.port}
               spring.cloud.gateway.mvc.routes[0].predicates[0]=Path=/gateway/api/**
               spring.cloud.gateway.mvc.routes[0].filters[0]=RewritePath=/gateway/api/(?<segment>.*), /api/$\{segment}
      
               zuul.routes.upload.path=/api/upload/**
               zuul.routes.upload.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.upload.url=http://${public.ip}:${server.port}/api
               proxy.auth.routes.upload=oauth2
      
               zuul.routes.swagger1.path=/gateway/v3/api-docs/**
               zuul.routes.swagger1.sensitiveHeaders=${zuul.sensitiveHeaders}
               zuul.routes.swagger1.url=http://${public.ip}:${server.port}/v3/api-docs
               proxy.auth.routes.swagger1=oauth2
      
               zuul.ignoredPatterns=/login,/logout,/signOut,/signIn
               zuul.sensitiveHeaders=Cookie,Set-Cookie
               zuul.host.socket-timeout-millis=300000
               zuul.host.connect-timeout-millis=5000
    2. 添加以下属性:
      # Service documentation
                springdoc.server.url=${gateway-api.service.path}
                springdoc.swagger-ui.path=/swagger-ui/
                springdoc.swagger-ui.disable-swagger-default-url=true
                springdoc.swagger-ui.docExpansion=none
                springdoc.swagger-ui.operationsSorter=alpha
                springdoc.swagger-ui.tagsSorter=alpha
      
                springdoc.swagger-ui.urls[0].name=semanticservice
                springdoc.swagger-ui.urls[0].display-name=Talend Data Preparation - Semantic Service
                springdoc.swagger-ui.urls[0].url=${gateway-api.service.path}/dq/semanticservice/api-docs
      
                # Auth0 issuer uri  - Used only for daikon configuration
                spring.security.oauth2.resourceserver.auth0.jwt.issuer-uri=https://talend.auth0.com/
                # IAM authentication validation
                spring.security.oauth2.resourceserver.iam.jwt.jwk-set-uri=${iam.uri}/oidc/jwk/keys
                spring.security.oauth2.resourceserver.iam.opaque-token.introspection-uri=${iam.uri}/oidc/oauth2/introspect
                spring.security.oauth2.resourceserver.iam.opaque-token.query-entitlements=true
      
                # IAM authorization code flow
                spring.security.oauth2.client.registration.oidc.clientId=<security client id>
                spring.security.oauth2.client.registration.oidc.clientSecret=<security client secret>
                spring.security.oauth2.client.registration.oidc.authorization-grant-type=authorization_code
                spring.security.oauth2.client.registration.oidc.scope=openid,refreshToken
                spring.security.oauth2.client.registration.oidc.redirectUri=http://${public.ip}:${server.port}/signIn
                spring.security.oauth2.client.registration.oidc.provider=oidc
      
                spring.security.oauth2.client.provider.oidc.authorization-uri=${iam.uri}/oidc/idp/authorize
                spring.security.oauth2.client.provider.oidc.token-uri=${iam.uri}/oidc/oauth2/token
                spring.security.oauth2.client.provider.oidc.jwk-set-uri=${iam.uri}/oidc/jwk/keys
      
                # Kafka configuration
                spring.cloud.function.definition=internalMessage;internalMessageDatasetModule;tsdEventConsumer;tsdSemanticCacheUpdate
      
                spring.cloud.gateway.mvc.http-client.connect-timeout=5000
    3. 替换新属性中的客户端 ID 和客户端机密。您可以从备份文件中获取它们。
    4. 删除以下属性:
      ## Enable JWT needed in hybrid mode:
              security.oauth2.resource.jwt.key-uri=${iam.uri}/oidc/jwk/keys
              ## Redefine security scope by adding entitlements for hybrid
              security.oauth2.client.scope=openid refreshToken entitlements
    5. 将范围“权限”添加到以下属性中:spring.security.oauth2.client.registration.oidc.scope

      该属性如下所示:spring.security.oauth2.client.registration.oidc.scope=openid,refreshToken,entitlements

结果

您已将数据迁移到 Talend Data Preparation 8.0.1 R2025-02。

本页面有帮助吗?

如果您发现此页面或其内容有任何问题 – 打字错误、遗漏步骤或技术错误 – 请告诉我们!