Migrer Talend Data Preparation implique d'effectuer une sauvegarde des données et de la base de données, d'effectuer la mise à niveau, puis de mettre à jour le fichier des propriétés de l'application.
Procédure
-
Effectuez une sauvegarde du dossier data et de la base de données MongoDB.
-
Effectuez une sauvegarde du fichier dataprep/config/application.properties.
-
Mettez à jour le fichier application.properties comme suit :
-
Supprimez les propriétés suivantes :
# Service documentation
service.documentation=true
service.documentation.name=Talend Data Preparation - API
service.documentation.description=This service exposes high level services that may involve services orchestration.
service.paths=api
springfox.documentation.swagger.v2.host=${public.ip}:${server.port}${gateway-api.service.path}
springfox.resources.prefix.url=${gateway-api.service.path}
# see https://github.com/springfox/springfox/issues/2265
logging.level.io.swagger.models.parameters.AbstractSerializableParameter=error
security.basic.enabled=false
security.oidc.client.expectedIssuer=${iam.uri}/oidc
iam.license.url=${iam.uri}/oidc/api
security.oidc.client.keyUri=${iam.uri}/oidc/jwk/keys
security.oauth2.client.clientId=<security client id>
security.oauth2.client.clientSecret=<security client secret>
security.oidc.client.claimIssueAtTolerance=120
# security.oauth2.resource.serviceId=${PREFIX:}resource
security.oauth2.resource.tokenInfoUri=${iam.uri}/oidc/oauth2/introspect
security.oauth2.resource.uri=/v2/api-docs,/api/**,/folders/**,/datasets/**,/dataset/**,/preparations/**,/transform/**,/version/**,/acl/**,/apply/**,/export,/export/**,/aggregate,/sampling/**,/receivers/**,/error,/datastores/**,/preparation/**,/actions/**,/suggest/**,/dictionary/**,/transformation/preparations/**,/transformation/v2/**,/sharing/**
security.oauth2.resource.filter-order=3
security.scim.enabled=true
security.oauth2.client.access-token-uri=${iam.uri}/oidc/oauth2/token
security.oauth2.client.scope=openid refreshToken
security.oauth2.client.user-authorization-uri=${iam.uri}/oidc/idp/authorize
security.oauth2.sso.login-use-forward=false
security.oauth2.resource.tokenInfoUriCache.enabled=true
# FIXME: temporary fix related to dataquality-semantic-consumer version = 11.2.0
# FIXME: that will need to be removed as soon as we bump to spring boot 2.7 and bump dq library at the same time
spring.cloud.stream.binders.kafka-binder-consumer.environment.spring.cloud.stream.kafka.binder.brokers=${spring.cloud.stream.kafka.binder.brokers}
# Zuul properties
gateway-api.service.url=http://${public.ip}:${server.port}
zuul.servletPath=/gateway/upload
zuul.routes.dq.path=/gateway/dq/semanticservice/**
zuul.routes.dq.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.dq.url=${dataquality.server.url}/
proxy.auth.routes.dq=oauth2
zuul.routes.me.path=/gateway/api/v1/scim/me/**
zuul.routes.me.url=${iam.scim.url}/Me
proxy.auth.routes.me=oauth2
zuul.routes.pendo.path=/gateway/api/iam-server/pendo/**
zuul.routes.pendo.url=${iam.scim.url}/pendo
proxy.auth.routes.pendo=oauth2
zuul.routes.sharingset.path=/gateway/api/v1/sharingset/**
zuul.routes.sharingset.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.sharingset.url=http://${public.ip}:${server.port}/sharing/v1/sharingset
proxy.auth.routes.sharingset=oauth2
zuul.routes.sharing.path=/gateway/api/v1/sharing/**
zuul.routes.sharing.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.sharing.url=http://${public.ip}:${server.port}/sharing/v1/sharing
proxy.auth.routes.sharing=oauth2
zuul.routes.sharings.path=/gateway/api/v1/sharings/**
zuul.routes.sharings.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.sharings.url=http://${public.ip}:${server.port}/sharing/v1/sharings
proxy.auth.routes.sharings=oauth2
zuul.routes.api.path=/gateway/api/**
zuul.routes.api.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.api.url=http://${public.ip}:${server.port}/api
proxy.auth.routes.api=oauth2
spring.cloud.gateway.mvc.routes[0].id=api
spring.cloud.gateway.mvc.routes[0].uri=http://${public.ip}:${server.port}
spring.cloud.gateway.mvc.routes[0].predicates[0]=Path=/gateway/api/**
spring.cloud.gateway.mvc.routes[0].filters[0]=RewritePath=/gateway/api/(?<segment>.*), /api/$\{segment}
zuul.routes.upload.path=/api/upload/**
zuul.routes.upload.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.upload.url=http://${public.ip}:${server.port}/api
proxy.auth.routes.upload=oauth2
zuul.routes.swagger1.path=/gateway/v3/api-docs/**
zuul.routes.swagger1.sensitiveHeaders=${zuul.sensitiveHeaders}
zuul.routes.swagger1.url=http://${public.ip}:${server.port}/v3/api-docs
proxy.auth.routes.swagger1=oauth2
zuul.ignoredPatterns=/login,/logout,/signOut,/signIn
zuul.sensitiveHeaders=Cookie,Set-Cookie
zuul.host.socket-timeout-millis=300000
zuul.host.connect-timeout-millis=5000
-
Ajoutez les propriétés suivantes :
# Service documentation
springdoc.server.url=${gateway-api.service.path}
springdoc.swagger-ui.path=/swagger-ui/
springdoc.swagger-ui.disable-swagger-default-url=true
springdoc.swagger-ui.docExpansion=none
springdoc.swagger-ui.operationsSorter=alpha
springdoc.swagger-ui.tagsSorter=alpha
springdoc.swagger-ui.urls[0].name=semanticservice
springdoc.swagger-ui.urls[0].display-name=Talend Data Preparation - Semantic Service
springdoc.swagger-ui.urls[0].url=${gateway-api.service.path}/dq/semanticservice/api-docs
# Auth0 issuer uri - Used only for daikon configuration
spring.security.oauth2.resourceserver.auth0.jwt.issuer-uri=https://talend.auth0.com/
# IAM authentication validation
spring.security.oauth2.resourceserver.iam.jwt.jwk-set-uri=${iam.uri}/oidc/jwk/keys
spring.security.oauth2.resourceserver.iam.opaque-token.introspection-uri=${iam.uri}/oidc/oauth2/introspect
spring.security.oauth2.resourceserver.iam.opaque-token.query-entitlements=true
# IAM authorization code flow
spring.security.oauth2.client.registration.oidc.clientId=<security client id>
spring.security.oauth2.client.registration.oidc.clientSecret=<security client secret>
spring.security.oauth2.client.registration.oidc.authorization-grant-type=authorization_code
spring.security.oauth2.client.registration.oidc.scope=openid,refreshToken
spring.security.oauth2.client.registration.oidc.redirectUri=http://${public.ip}:${server.port}/signIn
spring.security.oauth2.client.registration.oidc.provider=oidc
spring.security.oauth2.client.provider.oidc.authorization-uri=${iam.uri}/oidc/idp/authorize
spring.security.oauth2.client.provider.oidc.token-uri=${iam.uri}/oidc/oauth2/token
spring.security.oauth2.client.provider.oidc.jwk-set-uri=${iam.uri}/oidc/jwk/keys
# Kafka configuration
spring.cloud.function.definition=internalMessage;internalMessageDatasetModule;tsdEventConsumer;tsdSemanticCacheUpdate
spring.cloud.gateway.mvc.http-client.connect-timeout=5000
-
Remplacez l'ID client et le Secret du client dans les nouvelles propriétés. Vous pouvez les trouver dans le fichier de sauvegarde.
-
Supprimez les propriétés suivantes :
## Enable JWT needed in hybrid mode:
security.oauth2.resource.jwt.key-uri=${iam.uri}/oidc/jwk/keys
## Redefine security scope by adding entitlements for hybrid
security.oauth2.client.scope=openid refreshToken entitlements
-
Ajoutez le périmètre "entitlements" à la propriété suivante : spring.security.oauth2.client.registration.oidc.scope.
La propriété ressemble à ceci : spring.security.oauth2.client.registration.oidc.scope=openid,refreshToken,entitlements.
Résultats
Vous avez migré vos données vers Talend Data Preparation 8.0.xR2025-02 ou une version supérieure. Pour configurer Talend Data Preparation, suivez les instructions de la procédure Configurer Talend Data Preparation.
