R2024-12 (monthly release cumulative patch)
Info | Value |
---|---|
Patch name | Patch_20241220_R2024-12_v1-8.0.1 |
Release date | 2024-12-20 |
Target version | 20211109_1610-8.0.1 |
Product affected | Talend Studio |
Introduction
This monthly release includes all previous generally available patches for Talend Studio 8.0.1.
For more information about the new features and bug fixes included in this monthly release, see Talend Release Notes.
Prerequisites
Consider the following requirements for your system:
- Talend Studio 8.0.1 must be installed.
- Java 17 is mandatory to run Studio 2024-05 and onwards. (How to setup Java 17)
- Talend Remote Engine has to be upgraded to 2.12.7 or above which is available to be downloaded now. (This requirement ONLY affects APPINT-35117 customers.)
- Talend Runtime users must use 8.0.1-R2023-08 or above to deploy features built with this release
- The Talend Studio default docker image was updated to eclipse-temurin:11. Therefore, the docker engine now needs to be updated to 20.10.21 or more recent.
Installation
Before applying an update to Talend Studio, check:
- Updating Talend Studio (for on-premises users)
- Updating Talend Studio (for Cloud users)
Installing the patch via setting up the Update URL in Talend Studio (recommended)
If your Talend Studio supports installing features using the Feature Manager wizard, it can detect and notify you about available patches and install the patches automatically when the Update URL is correctly set up in Talend Studio.
For more information about the Feature Manager wizard, see Managing features in Talend Studio.
For more information about setting up the Update URL, see Configuring update repositories.
Installing the patch using Software update in Talend Administration Center (for on-premises users)
- Log in to Talend Administration Center and go to Settings->Configuration->Software Update. Enter the correct values and save them referring to the documentation Configuring the Software Update repository in Talend Administration Center.
- Download the patch from the Settings->Software Update page into the nexus repository.
- Log in to Talend Studio in the remote mode.
- If your Studio supports installing features using the Feature Manager wizard, go to the wizard to proceed with the patch installation. Otherwise, click the Update button displayed on the login window to install the patch.
Installing the patch using Continuous Integration
To install the patch using Talend CI builder, use the -Dtalend.studio.p2.update
option at build time.
Note:
- Use Talend CI Builder version 8.0.20 in your CI commands or pipeline scripts for this Studio monthly update.
- Use Maven version 3.6.3 or above from this monthly update onwards.
- From version 8.0.4 onwards, Talend CI Builder is available in the official Talend repository.
For more information, see Building and Deploying.
Installing the patch manually using Talend Studio
- Download the patch from the repository for Talend updates manually.
- Create a folder named "patches" in your Studio installation directory and copy the patch .zip file to this folder.
- Restart your Studio.
- If your Studio supports installing features using the Feature Manager wizard, log in to your project and go to the wizard to proceed with the patch installation. Otherwise, click OK when prompted to install the patch.
R2024-12
New features in R2024-12
- QTDI-633 - [Dataprep][TCK] Dynamic preparation selection
- QTDI-821 - [Dataprep] Add technical preparation name in the end of the list
- QTDI-629 - [Dataprep][TCK] Change trigger dependencies mechanism
- QTDI-628 - [Dataprep][TCK] Support dataprep types other then String
- QTDI-540 - Remove deprecated version of Microsoft CRM
- QTDI-775 - Remove old Neo4j components (not the v4)
- QTDI-796 - [Dataprep] Make preparation fields ReadOnly
- QTDI-774 - Deprecate Mysql 5
- QTDI-630 - tDataprepRun/tck : Remove Beta overlay
- QTDI-541 - Remove TCOMPv0 : tCouchbaseDCP*
- QTDI-539 - Remove Google Analytics (not the v4)
- QTDI-703 - Make new @Hidden annotation work in Studio
- QTDI-696 - Support Oracle 23ai in studio
- QTDI-726 - New Connector for Qlik Cloud data-files
- QTDI-772 - Remove older Oracle version 12-7/11
- QTDI-776 - Remove Sybase 12/15
- QTDI-777 - tAzureADLSGen2: Add support for Delta format in output + partition in Input/Output
- QTDI-787 - HTTPClient - Supports chunked binary body type
- QTUP-311 - Remove Google Analytics (not the v4)
- QTUP-534 - Remove Sybase 12/15 (direct removal/no deprecation)
- QTUP-535 - Deprecate Mysql 5
- QTUP-701 - Improve error check for deleted database versions on wizard and components
- QTUP-330 - Remove deprecated version for oracle metadata/CDC/Stats&logs ui and so on in studio : 12-7 and 11 (no migration)
- QTUP-329 - Support Oracle 23ai in studio for CDC/Metadata/Stats&Logs and so on
- QTUP-496 - Remove old Neo4j components (not the v4)
- QTUP-261 - [Dataprep][TCK] "open prep" button
- QTUP-269 - Improve update wizard
- QTUP-258 - Add Hive3 support in metadata/Database/Hive
- QTUP-236 - Cleanup feature manager UI
- QTUP-528 - Remove TCOMPv0 : tCouchbaseDCP*
- QTDM-253 - [DSQL Map Editor] Display element properties
- QTDQ-210 - New component tChunking in Standard Jobs (Beta)
- QTDQ-238 - Support for Oracle 23ai for profiling data and as a datamart
- QTDQ-315 - Deprecation of MySQL 5 for profiling data and as a datamart
- QTDQ-316 - Removal of Oracle versions 11 and 12
- QTDQ-333 - Data Collector added to track Talend Profiler features
- QAPPINT-271 - cAWSConnection: support context parameters for AWS region
- QAPPINT-803 - Provide new cAWSKinesis component
- QTBD-1011 - Support 'Workspace' location for Databricks init scripts
- QTBD-1060 - Azure HDInsight 5.1 and 5.0: Shared Access Signatures authentication
- QTBD-1066 - Update default library location for Databricks with Unity catalog enabled
- QTBD-1157 - Add Universal(Spark submit) support to tMaprDB* components in batch
CVEs fixed in R2024-12
CVE-2024-47554 (Commons-Io:commons-Io [2.0 ~ 2.13.0]) impacted:
Studio
DQ components
APPINT components
CVE-2023-34610 (com.cedarsoftware:json-io:4.14.0-TALEND) impacted:
Studio
CVE-2020-13956 (org.apache.httpcomponents:httpclient 4.5.6) impacted:
APPINT components
CVE-2024-47072 (com.thoughtworks.xstream:xstream 1.4.20) impacted:
APPINT components
CVE-2024-29025 (io.netty:netty-codec-http:4.1.100.Final) impacted:
BD components
CVE-2024-47561 (org.apache.avro:avro 1.11.3) impacted:
BD components
CVE-2024-49761 (Rexml 3.2.5) impacted:
DI components
CVE-2024-7254 (com.google.protobuf:protobuf-java [2.4.1,3.19.6,3.24.4]) impacted:
DI components
CVE-2023-2976 (com.google.guava:guava 30.1.1-jre) impacted:
DI components
CVE-2024-47554 (Commons-Io:commons-Io [2.0 ~ 2.13.0]) impacted:
DI components
Other issues fixed in R2024-12
- QTDI-812 - [Dataprep][TCK] Guess schema doesn't see nullable fields
- QTDI-617 - Leftover for tDB2SP after allowing DB Type in the Parameters Form
- QTDI-789 - tREST remove warnings
- QTDI-868 - tWebService update jaxb jars to avoid jars conflict with Snowflake
- QTDI-720 - When using Dynamic Schema, tDBOutput failed to insert NULL values into DB2 LOB fields
- QTDI-795 - [Dataprep] Fail preparation if one of transformations failed
- QTDI-376 - HTTPClient - Json arrays are returned as list of records
- QTDI-717 - tAmazonDocumentDBOuput / Data Action = Delete / Cannot delete using _id when _id type is ObjectId (works when _id type is String)
- QTDI-834 - In tAS400Output, optimize the code to lookup Table Name if table action = drop if exists and create
- QTDI-839 - Miss ERROR_MESSAGE in tAzureStorageXXX standalone components(the component which not allow data input&data output) when uncheck die on error
- QTDI-893 - [tAzureAdlsGen2Input]: delta format can't read from the lastest azure databrick spark sql export delta table
- QTDI-899 - [tOracleRow]: "Additional JDBC Parameters" not works
- QTDI-931 - tOracleConnection ui not match the studio oracle metadata for "Disable CBC protection" field
- QTUP-526 - Improve resizing behavior of Note component
- QTUP-344 - Component is missing in Component List of tDBClose after import old items
- QTUP-635 - tIcebergInput should not be showed when drag&drop iceberg metadata from DB Connection to Standard job
- QTUP-688 - when run publish job using token with script mode in commandline, job can publish successfully, but there is an error in log
- QTUP-737 - [tELTOracleInput UI]: when use teltoracleinput link to teltoraclemap, can't link and an exception appear in background
- QTUP-546 - After import in Studio 8.0.1 jobs with tDBOutput components shows 2 extra columns: errorCode and errorMessage
- QTUP-573 - NPE "Cannot invoke "String.equals(Object)" because the return value of "org.talend.core.model.metadata.builder.connection.FTPConnection.getLogonType()" is null" when open/run the attached job
- QTUP-502 - Orange "Install dependency" panel isn't shown
- QTUP-310 - Integrate @ReadOnly annotation in Studio UI for tck components
- QTUP-810 - Some localization messages to be corrected
- QTUP-458 - Schema is lost in repository when rename salesforce connection
- QTUP-931 - "User not authorized to operate on JobServer." when running the job with remote jobserver meanwhile TAC was used for authorization in jobserver conf.
- QTDM-146 - [DSQL Maps] Add new example of DSQL map with GROUP BY feature
- QTDM-303 - [DSQL Map Editor] Add dsql map example based on showcase presentation
- QTDM-275 - [DSQL Maps] Add new example of DSQL map with JOIN feature
- QTDM-301 - [Standard Map]Test Run with Flat/IDocs Input zero date has issues
- QTDM-309 - [Standard Map]Error occurs when using a Constant of type Date, Time or DateTime
- QTDM-305 - [DSQL Map]Unable to detect a wrapper structure with a single element as the payload
- QTDM-311 - [Standard Map]An error occurs when using the 'z' pattern with FormatDateTime
- QTDM-302 - No output when wrap primitive structure
- QTDM-291 - Remove joda-time dependency from xstream used for JavaBean Representation
- QTDM-283 - [DSQL Map Editor] Generate GROUP AS when dnd in target group by context
- QTDM-277 - [DSQL Map Editor] Incorrect path generated by drag and drop for a sub group by
- QTDM-265 - [Standard Map]Show Document for IDocs, EDI, Flat rep fixes the Date input
- QTDM-270 - get 2024-01-01 instead of 1970-01-01 for pattern HHMM of parseDateTime function
- QTDM-271 - can't always get fraction-of-seconds value with a length of 3 (SSS)
- QTDM-269 - get "0000-00-00" when show document for "CCYYMMDD" element from structure
- QTDM-267 - YYWWee/YYWWD doesn't work for parseDateTime function
- QTDM-260 - DateTime CCYYMMDDHHMMZHHMM cannot accommodate all offsets
- QTDM-268 - [Standard Map]ParseDateTime with YY pattern always uses the current century
- QTDM-266 - [Standard Map][TUJ]ParseDateTime pattern 'Z' is incompatible with java.time
- QTDM-265 - [Standard Map]Show Document for IDocs, EDI, Flat rep fixes the Date input
- QTDM-258 - [Standard Map]Update RuntimeSupport to use java.time
- QTDM-205 - [DSQL Map][SAP IDocs]Unable to handle Date 0000-00-00
- QTDQ-318 - tJSONValidator: Fixed the issue preventing from using custom-encoded JSON schema file
- QTDQ-331 - tJSONValidator: Removed the Guess Schema button
- QTDQ-337 - tJSONValidator: Fixed the issue causing many exception errors when JSON schema is wrong and 'Die on error' is not checked
- QTDQ-136 - Fixed a NPE error when deleting a report from Generate documents
- QTDQ-195 - Table analysis: Fixed the issue when using SQL rules
- QAPPINT-804 - Issue with sftp in route
- QAPPINT-889 - Duplicate local variable cMQConnectionFactoryHost when multiple cMQConnectionFactory
- QAPPINT-893 - Failed to download jar when add sql component on cMessagingEndpoint
- QTBD-971 - DI job hbase components can't work with spark universal EMR529
- QTBD-1020 - Compile error for tFileStreamInputPatquet components with emr 6.2 in streaming jobs
- QTBD-1148 - Spark job with HBase components using EMR clusters with Spark 3.2 and 3.3 provides empty output from tHBaseInput component
- QTBD-1212 - Synapse launcher library has wrong imports
- QTBD-1219 - Metadata for Synapse 3.2/3.3 distribution cannot be created/saved
- QTBD-1153 - org.apache.spark.SparkException: Failed to register classes with Kryo
R2024-11
New features in R2024-11
- QTDI-372 - HTTPClient - Let user change 'Authorization' header's name
- QTDI-668 - [CSV] Ability to have multiple types
- QTDI-673 - [CSV]Pipeline cannot run successfully when field contains "/n"
- QTDI-670 - [CSV][Excel] Discrepancy in the number of row returned by excel and csv parsers for same data
- QTDI-672 - [Excel]The value does not show correct in the generated data file
- QTDI-669 - [Excel] Remove non significant 0 in numeric type
- QTDI-634 - [Dataprep][TCK] Dictionary configuration seems too complex
- QTDI-728 - New EmbeddingAI component [Beta] for studio
- QTDI-697 - MongoDB as a VectorDB
- QTDI-620 - Add db mapping selection for dynamic schema db type conversion
- QTDI-178 - tAS400 support V7R3 and later with driver Version 20.0.7 and deprecate old version
- QTUP-104 - tAS400 upgrade JDBC to jtopen Version 20.x
- QTUP-276 - Support jfrog bearer token auth
- QTUP-318 - Mass Distribution update For Big Data
- QTDM-201 - [DSQL map editor] Add support of multiple GROUP BY keys in the DSQL map editor
- QTDM-202 - [DSQL map editor] Add support Block in WITH in DSQL map editor
- QTDM-215 - [DSQL Map] Add databaseLookupAndUpdate and databaseUpdateAndLookup functions
- QTDQ-211 - New Standard component: tJSONValidator to validate JSON columns
- QTDQ-227 - Profiling AS400: Support for V7R3 and later, deprecation of previous versions
- QTBD-1015 - Iceberg - Advanced capabilities: Low Code Component for Time-travel (Hive Engine) in DI
- QTBD-909 - GA - Universal Spark 3.5 for AWS EMR clusters
- QTBD-904 - Iceberg - Advanced capabilities: Low Code Component for Time-travel (Spark Engine) in batch
- QTBD-1129 - tMaprDB* components in DI
CVEs fixed in R2024-11
- QTDM-231 - CVE-2024-47554 Commons-Io:commons-Io [2.0 ~ 2.13.0]
QTDM-317 - Need to update Avro to 1.11.4 (CVE-2024-47561)
CVE-2024-47561 (org.apache.avro:avro <= 1.11.3) impacted:
Studio
DI components
APPINT components
CVE-2023-4218 (org.eclipse.jdt:org.eclipse.jdt.core:3.34.0) impacted:
Studio
CVE-2024-36124 (org.iq80.snappy:snappy 0.4) impacted:
Studio
DI components
APPINT components
CVE-2024-29131 (org.apache.commons:commons-configuration2 2.8.0) impacted:
Studio
BD components
CVE-2024-23444 (org.elasticsearch:elasticsearch 7.17.19) impacted:
Studio
CVE-2023-2976 (com.google.guava:guava 30.1.1-jre) impacted:
BD components
CVE-2024-35255 (com.azure:azure-identity 1.11.2) impacted:
DI components
CVE-2023-40167 (org.eclipse.jetty:jetty-http [9.4.51.v20230217,9.4.52.v20230823]) impacted:
DI components
CVE-2023-0833 (com.squareup.okhttp3:okhttp 3.10.0) impacted:
DI components
CVE-2024-29857 (org.bouncycastle:bcpkix-jdk15to18 1.76) impacted:
DI components
CVE-2024-29025 (io.netty:netty-codec-http [4.1.94.Final,4.1.101.Final]) impacted:
DI components
CVE-2023-34462 (io.netty:netty-handler 4.1.78.Final) impacted:
DI components
CVE-2023-36617 (Uri 0.12.1) impacted:
DI components
CVE-2024-22259 (org.springframework:spring-web 5.3.24) impacted:
DI components
CVE-2024-38808 (org.springframework:spring-expression 5.3.34) impacted:
APPINT components
CVE-2024-23114 (org.apache.camel:camel-cassandraql 3.20.6) impacted:
APPINT components
Other issues fixed in R2024-11
- QTDI-682 - Unable to run OpenAI job in the RE Gen1
- QTDI-709 - tMicrosoftCrmInput reports error java.lang.NoSuchMethodError: 'void com.microsoft.aad.msal4j.RequestContext.<init>
- QTDI-683 - [8.0.1] tODATAInput fails with The value type class java.util.Date is not supported
- QTDI-708 - tApacheKuduOutput throw error when write BigDecimal to KUDU
- QTDI-671 - [CSV] "Index 4 out of bounds for length 4" error when there are more than 4 fields
- QTDI-631 - [Dataprep] Dictionary is closed too early
- QTDI-756 - Jira component fails with NPE when parse error
- QTDI-718 - Local file cannot be deleted when downloading files(more than one file) from tAzureStorageGet
- QTDI-694 - tBigQueryOutput - Not supporting folders in GCS bucket for file upload
- QTDI-685 - tAzureStorageGet is incorrectly treating parent folders as files during recursive download from an Azure container
- QTDI-665 - [Excel] Cannot get a STRING value from a NUMERIC formula cell
- QTUP-319 - [8.0.1]Failed to execute mojo org.talend.ci:builder-maven-plugin:8.0.18:generate
- QTUP-280 - Subjob grids overlapping in Studio's new theme (UI/UX issue)
- QTUP-295 - Talend studio appearance/theme - Connection issues
- QTUP-134 - Improve mass update message
- QTUP-298 - URL suffix editable when drag metadata to job for snowflake
- QTUP-299 - Switching Git branch in Studio will pop up messages, stating Git Commit Manual mode is either disabled or enabled
- QTUP-305 - job using google analytics dataset pop up update detection every time open the job
- QTUP-290 - Content assist doesn't work for routines in tJava
- QTUP-292 - Improve routine dependency detection for job process
- QTUP-301 - The Download failed for the following jars x when Select a module / Artifact repository(mlocal m2/nexus) / Search Remote from snapshot
- QTUP-297 - " Failed to collect dependencies at org.apache.cxf:cxf-core:jar:3.5.9" error shows while building job which contains webservice component on master build
- QTUP-303 - Salesforce Objects Metadata Refresh Issue
- QTUP-322 - Issue running some Jobs in Debug Mode
- QTUP-333 - Talend Cibuilder not setting the statistic flag of an artifact correctly
- QTUP-343 - as400: Revert Context set wrong DataBase value
- QTUP-442 - Talend 8 - reference project display doesn't reset during branch switch
- QTUP-477 - Sometimes, Git Staging "Add all files" button does not stage all changes
- QTUP-277 - Generate DOC as HTML : tMap "Map Editor" screenshot (externalpreviewtMap_x.png) not always generated
- QTUP-307 - Get incorrect result for multi Trigger Input(OnSubjobXXX)
- QTUP-327 - Problem with pushing changes after new branch creation in Studio 8.0.1. Unable to commit
- QTUP-205 - Schema order is messy when import schema from xml file in tELTMap editor
- QTUP-275 - Joblet Group Color settings doesn't work
- QTDM-126 - Update TDM maplang libraries to new version 1.13.0
- QTDM-199 - [Structure]Dependencies are not updated after a sample data is deleted
- QTDM-200 - [DSQL Map] throw warning in design time when comparing incompatible type items
- QTDM-204 - [DSQL Map Editor]Map get error when structure update from primitive to structural
- QTDM-207 - [DSQL map examples] Cannot change the output representation
- QTDM-209 - [DSQL Map Editor]get error when map input to output which only have one primitive element
- QTDM-211 - Unexpected error while referencing a variable in DSQL script
- QTDM-213 - [DSQL Map Editor] Wrong error "invalid path" in a DSQL map with GROUP BY / GROUP AS
- QTDM-214 - [DSQL Map Editor]expression can't generate automatically when map primitive input to output
- QTDM-218 - [Standard Map Editor]Shouldn't generate expression for group when drag one group element to another in output structure
- QTDM-219 - [DSQL Map Editor] Incorrect decimal value at output
- QTDM-220 - [Standard Map] DatabaseLookupAndUpdate generates SQL with incomplete parameter set
- QTDM-221 - Studio database importer fails to import database connection having Underscore
- QTDM-222 - [DSQL Map Editor]Switch to map get error after undo remove structure and update structure
- QTDM-223 - [DSQL Map Editor]Switch to map error pop after clear structure map used
- QTDM-224 - No warning when delete structure used by DSQL map
- QTDM-225 - [DSQL Map Editor]Error pop when update subquery of 'WITH'
- QTDM-227 - Remove support for Database Representation (Phase 1)
- QTDM-228 - Deprecate the Eclipse-based runtime
- QTDM-229 - [8.0.1] cMap failing with Cannot invoke "String.length()" because "spec" is null
- QTDM-230 - Behavior of Quote Mode changed between R2023-04 and R2024-04 so the new run fails with Null values
- QTDQ-142 - ThresholdViolationAlert Job: Fixed the issue preventing from using Oracle as the data mart
- QTDQ-232 - tRuleSurvivorship: Fixed the issue preventing from using Job Server on Java 8
- QTDQ-121 - [security] Handled code-scanning high severity findings of Data Quality
- QTDQ-122 - [DQ Libraries] Checked and fixed security issues from Dependabot
- QTBD-908 - Runtime exception on Spark job with S3 component with EMR 7.2 Kerberized cluster
- QTBD-1064 - Drag and drop of yarn universal metadata does not set properly hadoop conf
- QTBD-1072 - ClassNotFoundException when I use dynamic schema for tFileInputParquet
- QTBD-1073 - [R2024-10] tImpalaConnection raises error java.lang.NoSuchMethodError: org.apache.thrift.transport.TSocket.<init>
- QTBD-1074 - Can't download hadoop-mapreduce-client-core-3.3.6 for tFileInputParquet
- QTBD-1119 - Check Services button is disabled for all Yarn Cluster Metadatas
- QTBD-1131 - hive-shims-scheduler-2.3.10.jar can not be downloaded
- QTBD-1147 - Missing jar (wrong URI ?) on Test connection HBase connection with Universal distribution - HBase 2 version
- TBD-16815 - AbstractMethodError when I check connection for Impala using Hve2 dirver
- TBD-16821 - When a job contains both a Salesforce and a Hive component, execution fails with java.lang.NullPointerException: Cannot invoke "org.apache.commons.lang3.JavaVersion.atLeast
- TBD-16831 - [R2024-10] tImpalaConnection raises error java.lang.NoSuchMethodError: org.apache.thrift.transport.TSocket.<init>
- QAPPINT-753 - Getting a thread safe issue when running a load test on route rest service
- QAPPINT-834 - Compile error if adding JAXRS properties into cREST when it acts as a Client
- QAPPINT-744 - Use of context parameter in File Path for cJSLT does not work
- QAPPINT-511 - File path on cJsonValidator cannot work when Schema URI starts with "file://"
- QAPPINT-500 - "Parse to Maps" can be disable when "No header line" or "Skip header line" is checked on cCsvParser component
- QAPPINT-423 - Cloud published Data Service as microservice fails to start when prometheus is selected
- QAPPINT-453 - Minor improvements/fixes for cJSLT component
- QAPPINT-452 - Update label for cCsvWriter
- QAPPINT-482 - CI CD Pipeline build failing when the subjob has similar naming pattern as the route
- QAPPINT-312 - CI+REST service+Standalone Microservice docker+Prometheus fails with LoggingException
- QAPPINT-317 - Execution Failing for CI published dataservice as microservice with prometheus enabled
- QAPPINT-514 - Microservice is not working with custom log4j file to generate logs with json format
- QAPPINT-816 - Error in runtime when deploying cKafka using avro schema + cprocessor
- QAPPINT-506 - Should be cLog3 instead of cLog2 for XMLValidationDemo/JSONValidationDemo in Demo project
R2024-10
New features in R2024-10
- TUP-44194 - Add support of snowflake to mass db update
- APPINT-36576 - Direct Repository Resources integration for JSON and XML schema validation
- APPINT-36638 - Facilitate Auto/Manual commit usage with cKafka (cKafkaCommit)
- APPINT-36708 - Move Schema Registry dependencies and code from Beans to cKafka component level
- APPINT-36024 - New CSVReader, CSVWriter components
- APPINT-36940 - Providing aggregation strategy examples as opened list for easy selection
- TBD-16310 - tFileIOParquet supports local datetime
- TDI-51361 - Extend the error handling for Talend component tELTSAPMap/tSAPTableInput
- TDI-51384 - IBM DB2 Z/OS V13 Support
- TDI-51414 - Snowflake enabling China Region
CVEs fixed in R2024-10
CVE-2015-7501 (commons-collections:commons-collections 3.2.1) impacted:
Studio
CVE-2020-1945 (ant:ant:1.6.5) impacted:
Studio
CVE-2023-3635 (com.squareup.okio:okio 1.6.0) impacted:
Studio
CVE-2024-7254 (com.google.protobuf:protobuf-java 3.19.6) impacted:
Studio
DQ components
CVE-2023-2976 (com.google.guava:guava 30.0-jre) impacted:
DQ components
CVE-2024-29857 (org.bouncycastle:bcprov-jdk18on 1.74) impacted:
Studio
APPINT components
DI components
CVE-2020-13949 CVE-2019-0205 CVE-2018-1320(libthrift-0.9.3.jar), impacted:
BD components
CVE-2021-28168 (org.glassfish.jersey.core:jersey-common:2.33) impacted:
BD components
CVE-2024-23944 (org.apache.zookeeper:zookeeper 3.9.1) impacted:
DI components
CVE-2020-29582 (org.jetbrains.kotlin:kotlin-stdlib 1.4.10) impacted:
DI components
CVE-2023-34610 (com.cedarsoftware:json-io 4.13.1-TALEND) impacted:
DI components
CVE-2024-25638 (Dnsjava:dnsjava [2.1.7,3.5.2]) impacted:
DI components
CVE-2023-52428 (Dcom.nimbusds:nimbus-jose-jwt 9.30.2 impacted:
DI components
Other issues fixed in R2024-10
- TDI-51593 - tMessaging* component issue with missing libs
- TDI-51625 - Compiler issue when tLoop with loop type "While" and tFileInputDelimited
- TDI-51426 - CDC component is incorrect for 'Sybase 16 (SQL Anywhere) and above' when running job
- TDI-51140 - Snowflake TIMESTAMP_TZ not mapping to date datatype
- TDI-51554 - JDBC connection to connect to Amazon Athena failed
- TUP-44224 - Studio popup re-login dialog if the session is timeout when use cloud login (The access token is still valid))
- TUP-44167 - Copy&paste a subjob, the anchor points of connection changed to wrong location
- TUP-44139 - Improve the highlight display if the parameter use dynamic settings
- TUP-44223 - some of the dynamic settings are lost after migration
- TUP-44061 - Performance issues with plexus-io:3.4.0 with Shared Studio instances
- TUP-44297 - "Migrate Db connection to ..." should be removed from schema's context menu
- TUP-42772 - Review the critical SAST findings in github
- TUP-44187 - googleAnylytics4: NPE when click next after select Dimensions and metrics creating dataset
- TUP-44111 - tHbasexxx component icons are blurred
- TUP-44470 - Studio throw "nodeType" is null error when try to select a repository node.
- TUP-44184 - "Value taken from the repository" show incorrect for some parameters
- TUP-41509 - tck: no update detection popup when export / revert context if job use dataset
- TUP-44214 - Talend Studio 8 R2024-08: Edit an existing dynamic configuration freezes UI
- TUP-44081 - Difficult to read when rename a link
- TUP-44085 - Dark theme issue in tELTMap Property Settings
- TUP-44342 - Variable name displayed issue for tHBaseXXX
- TUP-44437 - Behavior of Generic Schema propagating changes is different between local project vs referenced project
- TDM-10906 - Adding additional namespace in xml root
- TDM-10985 - Saxon dependencies causing deployment error for Runtime Route
- TDM-10741 - Job contains 3 thmap refactor 2 thmap to joblet get npe
- TDM-10765 - Null pointer exception when right click on Input/output values in Test Cases
- TDM-10886 - Some functions in map properties can't work
- TDM-10905 - Remove ISREPAIRINGNAMESPACES mode from XML Writer
- TDM-10937 - Can't consume data from mock server when tSAPIDocReceiver linked to tHMap
- TDM-10999 - test run map with java routines and get error "can't load java class"
- TDM-11059 - [tHMap]Regenerating a structure has a conflict with DependencyManager setting the structure to null
- TDQ-22148 - Enhanced performance of the DataMasking.encryptAESGCM(...) routine
- TDQ-22160 - Column set analysis: Fixed the issue preventing from changing the analyzed columns when another analysis or item is open
- APPINT-36986 - Migration task wrongly rename org.json packages to routines.system
- APPINT-35663 - Regression: Wrong comment of Path and Query schema in tRESTRequest
- APPINT-18422 - blockWhenFull needs to be a producer feature (not consumer)
- APPINT-36481 - MemoryOutOfBound exceptions with Springboot microservice
- TBD-16635 - Compile error on tFileStreamInputJSON component
- TBD-16749 - tHiveCreateTable - Row Format not displaying for TEXTFILE
- TBD-16679 - remove Spark 2.4 tuj from 8.8.8 runs
- TBD-16718 - Studio 8 R2024-08 doesn't generate code in Big Data Batch job with tFileinputDelimited component
- TBD-16772 - Unable to generate code when using tFileOutputParquet with more than one column partitions
- TBD-16617 - [UI] "property type" and "Connection" shouldn't co-exist in tIceberg* components
R2024-09
New features in R2024-09
- TUP-43471 - Mass updates in DB components
- TUP-40724 - TCK Component dynamic settings support
- TUP-41636 - Reform Studio preference pages
- TDI-40738 - Solr: implement in tacokit
- TDI-51242 - Support Pinecone in Studio GA
- TDI-51396 - [Dataprep][TCK] Support PAT auth
- TDM-9995 - Need the feature to export the mapping relationship in CSV or Excel file
- TDQ-21748 - Moved hadoop-cluster from TCOMPv0 to TCK
- TDQ-22161 - Data mart: Checked that MS SQL Server 2019 is supported
- TBD-16636 - BETA - Universal Spark 3.5 for AWS EMR clusters
- TBD-16544 - Support for all spark 3 minor versions with kubernetes mode
CVEs fixed in R2024-09
CVE-2024-28752 (org.apache.cxf:cxf-core 3.5.5) impacted:
MDM components
DI components
Studio
APPINT components
CVE-2024-29131 (commons-configuration2:2.9.0) impacted:
DI components
Studio
CVE-2024-21742 (apache-mime4j-core:0.8.9) impacted:
DI components
Studio
CVE-2023-52428 (com.nimbusds:nimbus-jose-jwt 9.30.2) impacted:
DI components
Studio
CVE-2024-34750 (org.apache.tomcat:tomcat-coyote 9.0.87) impacted:
DI components
APPINT components
CVE-2024-29736 (org.apache.cxf:cxf-rt-rs-service-description 3.5.5) impacted:
APPINT components
CVE-2024-32007 (org.apache.cxf:cxf-rt-rs-security-jose 3.5.5) impacted:
APPINT components
Other issues fixed in R2024-09
- TUP-43858 - Driver jar change to "newLine" in stats&logs when revert context for jdbc connection in Repository
- TUP-43916 - TMC Artifact Components Are Displayed with Gray Text
- TUP-44028 - Hive connection without hadoop cluster first time check failed
- TUP-41627 - Wrong confirm message when try to update status for job
- TUP-43863 - wrong spelling on Edit parameter when update project settings in job
- TUP-42858 - The link to target component goes to somewhere else
- TUP-43598 - SSLTrustStorePwd without encryption displayed in the error message details when check connection failed
- TUP-43881 - Update CSS Parser to latest version
- TUP-43936 - Two Route connection link colors with same name are in Preference settings
- TUP-43957 - Improve load transitive dependencies as routine libraries
- TUP-44060 - Maven Pom Editor disappeared from studio R2024-05
- TUP-43987 - Fail to publish job to docker nexus if there is no eclipse-temurin image in docker.
- TUP-43889 - CI fails when assigning maven local repository individually
- TUP-43885 - "SLF4J: Class path contains multiple SLF4J bindings" occurs when executing the job
- TUP-42186 - incorrect tooltip for custom routines
- TUP-42184 - a local project created by commandline has no project type
- TUP-30787 - Studio takes long time to delete one custom routine jar with many inner routines
- TUP-44088 - Additional window dialogs like secret keys/passwords cannot be opened from component properties / Spark Configuration tab etc.
- TUP-43920 - job change to unsaved when focus from one tJava to another
- TUP-43902 - "Support logs" silently fails to generate file
- TUP-42285 - Error occurred while selecting a driver class for jdbc h2 metadata connection
- TUP-44007 - Dark theme issue in tMap Property Settings
- TUP-43880 - Impala should not be visible among databases if BD features are not installed
- TUP-43589 - Component error when drag Hive metadata as componentType tCreateTable to a job
- TUP-43115 - [BigQuery] Guess Schema not possible when Resource is used
- TUP-43106 - icon is wrong for imported spark batch and streaming job
- TUP-42235 - Comparing jobs - does not return any differences when comparing two similar jobs across two branches or tags
- TUP-42939 - [BigQuery] Context variable is used as String
- TUP-42723 - Property settings not show completely
- TUP-44029 - tDataPrepRun missing from big data jobs
- TUP-44219 - CICD taking longer time per buildItemSources after migrating from 731 to 801-R202407
- TDI-51393 - tMOM component replace 'javax.jms:javax.jms-api:jar:2.0.1' to 'jakarta.jms:jakarta.jms-api:jar:2.0.3'
- TDI-51293 - tAdvancedFileOutputXML will generate an empty file when check "Split output in several files" and choose "Fast with low memory consumption" Generation mode.
- TDI-51604 - Unable to run AD authentication on tMSSqlRow/tMSSqlInput/tMSSqlOutput/tMSSqlConnection
- TDI-51557 - Issue with the format of the date with tFileInputExcel component.
- TDI-51568 - DataStage Sequencer jobs from DSX file is not imported through Talend Metadata bridge
- TDI-51551 - tMysqlOutput mysql8 useBatch option missing and remove mysql4 code.
- TDI-51508 - tXMLMap : order in output file not as defined in output schema even when "Keep order for document" is checked
- TDI-51526 - tMysqlOutput batchmode to be updated
- TDM-9679 - tHmapConfiguration structure doesnt check recycle bin
- TDM-10666 - [Flattening] Change output names
- TDM-10797 - [DSQL Generator for standard Map] curly brackets are missing for nested IF in emit
- TDM-10843 - [DSQL Map Function]error dialog raise when add function to toMap
- TDM-10844 - [DSQL Map Editor]Mapping line always show in some condition
- TDM-10847 - copy and help is not always available in function view of STD map
- TDM-10860 - [DSQL generator]generated concat code is not correct for example map AcmePOToMaAndPa_1stDelivery
- TDM-10864 - Make CSV export for Structures and Maps Excel compatible
- TDM-10875 - Redo can't work good in standard map
- TDM-10876 - Can't rename folder to 'Jobs' while it is allowed when create folder
- TDM-10877 - Map path of multiple tHMap can't update properly when used in same job
- TDM-10885 - Error dialog raise when finish apply template
- TDM-10891 - show document is failed on structure with inherited expression in util tab
- TDM-10893 - [Standard Map]Output for Distinct with [Emit Loop Instance if Empty] option is not as expected
- TDM-10899 - Get error when show document for csv primitive structure
- TDQ-21950 - Fixed the issue preventing from locking the DQ items when the lock mode of TAC is set to manual
- TDQ-22113 - Column analysis: Fixed the issue preventing from changing the analyzed columns when another analysis or item is open
- TDQ-21489 - tDataQualityRules: Fixed the issue causing the crash of the microservice when deployed in a remote engine
- TDQ-22143 - tMatchGroup/tDataQualityRules: Fixed the issue preventing from using the Spark Batch components with a license without the Spark Streaming feature
- TDQ-22105 - Database connection: Fixed the UI issue showing the HDInsight and Dataproc modes in the Profiling perspective
- TDQ-22146 - Removed the JDOM dependency from org.talend.designer.brms
- TDQ-22182 - Spark tDataQualityRules: Fixed the issue causing the download of the data quality jar
- TBD-16671 - create bash script that build 8.8.8 tuj docker image
- TBD-16680 - Run job failed with Kerberos Impala context mode
- TBD-16714 - compile error when spark batch job using hiveoutput component and run it with CDP7 buildin
- TBD-16696 - Query with column function will produce null result in hive input component
- TBD-16716 - Unable to generate code when using tFileOutputParquet with partitions
- TBD-16674 - Improve cleaned part for the automation_runner.sh on colibri
- TBD-16589 - Migrate tHiveOutput in batch from javajet to java
- TBD-16645 - thive,warehouse configuration show distribution part
R2024-08
New features in R2024-08
- TDI-48021 - Allow Azure Key vault for tMssqlXXXX components column encryption and decryptions
- TDI-42104 - tFTPConnection: support logon type "Account"
- TDI-50777 - Add job metrics about data volume consumption (read)
- TUP-43792 - tFTPConnection: new logon type add to wizard metadata
- TUP-41678 - Prepare for Capacity Based Pricing for Data Integration Jobs
- TUP-43750 - Load transitive dependencies as routine libraries
- APPINT-36575 - New cJSLT component
- TDQ-22074 - New tMatchGroup component in spark batch framework
- TBD-16461 - Support Hive 3 in standard jobs
- TBD-16467 - GA for Universal Spark 3.3 with CDP Public Cloud Data Hub 7.2.x (v18)
- TBD-16592 - Deprecate tRunJob in Spark Batch and Spark Streaming
- TBD-16600 - Deprecate tSqoop family in studio
- TBD-16601 - Deprecate HCatalog family
CVEs fixed in R2024-08
CVE-2023-44483 (org.apache.santuario:xmlsec:2.3.0) impacted:
DI components
CVE-2021-33813 (org.jdom:jdom 1.1) impacted:
Studio
CVE-2024-22262 (org.springframework:spring-web:5.3.33) impacted:
APPINT components
CVE-2024-29131 (commons-configuration2:2.8.0) impacted:
BD components
CVE-2024-36114(aircompressor-0.27.jar), impacted:
BD components
CVE-2021-38153 (org.apache.kafka:kafka_2.11:2.4.0), impacted:
BD components
CVE-2023-44981,CVE-2024-23944 (org.apache.zookeeper:zookeeper:3.6.4) impacted:
BD components
CVE-2024-25710 (commons-compress:1.21,1.25.0), impacted:
BD components
Studio
DI components
CVE-2021-22569 (com.google.protobuf:protobuf-java:3.7.1) impacted:
DI components
Other issues fixed in R2024-08
- TDI-51440 - [8.0.1][Studio]tSystem component in Talend Studio when run at log level INFO, it displays actual value for the context variable defined as password type.
- TDI-51381 - [security] Tableau. Arbitrary file access during archive extraction ("Zip Slip")
- TDI-51230 - Workday components run fail when in parallel mode and jobs more than 3
- TDI-51497 - DynamoDBOutput RCU & WCU support context variables
- TDI-50011 - HTTPClient - Wrong NB_LINE value
- TDI-51456 - Unable to connect Redshift Serverless Instance with Driver V2 running in the SSO connection mode
- TDI-51442 - Filemask for tFTPxxx component does not work as glob expression
- TDI-51345 - JOB using tDBConnect (JDBC) broken after patch R2023-11 : no more possible to use java for JDBC URL / Driver Class / Userid
- TDI-51268 - tCosmosDBSQLAPIInput JSON Error
- TUP-43567 - UI Issues with the Hadoop Cluster Jar Configuration
- TUP-43624 - Studio update fails with org.eclipse.equinox.p2.core.ProvisionException: HTTP Proxy Authentication Required
- TUP-43613 - tSqoopImport - Repository settings missing 'context taken from the repository' - should be Read-only
- TUP-43745 - Cannot invoke "org.talend.core.model.metadata.IMetadataTable.getColumn(String)" because "repositoryTable" is null
- TUP-43596 - JDBC(Informix): Got error when clicking dataviewer for schema
- TUP-43587 - DetectCVE: there is a wrong index which from new version to old version in cveindex.csv
- TUP-43563 - Missing requirements of BigQuery
- TUP-43209 - MAC: Installer JRE not change to the system if first use jdk11 then change to jdk17
- TUP-42849 - [BigQuery] Connection Failure when opening SQL editor
- TUP-43901 - the appearance of the job designer settings does not work
- TUP-43839 - missing modules in parent pom.xml after generateAllPoms
- TUP-43930 - Failed to build docker image with adduser command error
- TUP-43294 - Bug when setting context variable as Run if condition
- TUP-43380 - Error while running MDM Demo jobs including tRunJob
- TUP-43600 - There is no response when using Data viewer for iceberg tables
- TUP-43609 - Import Iceberg component jobs can't pop up the dialog to install BD features
- TUP-43705 - open a job make the first level job folder unfold when Link with Editor activated
- TUP-43688 - switch studio to French, failed to start it
- TUP-43581 - [Dataprep][TCK] Naming in the palette
- TUP-41589 - Login dialog which need git credentials in TMC project shows many times if clicking the project many times
- TUP-43503 - Old icons for edit bigdata spark/stream job properties
- TUP-42996 - Duplicate some metadatas but not duplicate subnode
- TUP-43438 - Hard to read the icons in the list when typing something in designer
- TUP-43537 - Can't upgrade commandline from R2023-10 to Nightly patch
- TUP-43673 - Studio install all features, then install patch will pop up error
- TUP-43666 - Hive2 driver impala connection with kerberos mode first time check failed
- TUP-43654 - Move context menu "Data viewer" from tImpalaCreateTable
- TUP-43653 - Impala check connection issue
- TUP-43620 - Error while guess schema
- TUP-43604 - Error while clicking button "show the table list for the current connection" for tImpalaCreateTable
- TUP-43463 - The "Guess Schema" for tHiveInput feature is not working after applying Studio 8 R2024-05v2/06
- TUP-43851 - Studio proxy issue - java.lang.NoClassDefFoundError: org/apache/commons/codec/binary/Base64
- TDM-10826 - Form in structure editor is not updated after undo/redo
- TDM-10845 - support fuzzy matching in function view of DSQL map
- TDM-10846 - Redo&Undo can't work good in structure
- TDM-10851 - avro exporter fails for special avro structure
- TDM-10852 - inherited elements are lost after CSV export
- TDM-10853 - Code can't generate when route/job only have cmap/thmap which haven't config
- TDM-10857 - Double click not work after close and reopen Data Mapper tab
- TDM-10874 - New created wrapper structure open with dirty sign
- TDM-10879 - get error when import the exported avro schema
- APPINT-36504 - ActiveMQ support for the new JMS 2.0 drivers
- APPINT-36764 - [JWT] Context of JWKS URL not work for tRESTRequest component
- TDQ-22110 - Updated daikon to 7.1.20, crypto-utils to 7.1.20 and studio-utils to 1.0.17
- TDQ-22065 - Removed some useless poms from dq-rule-runtime.jar to reduce CVE in scan
- TDQ-21944 - Fixed minor issues caused by the new UI of the Studio
- TDQ-22073 - tPattern(Un)Masking, tData(Un)Masking: Fixed the issues caused by a null data
- TBD-16457 - [HDInsight and Dataproc modes] Compile error on tHiveInput component when it doesn't use tHiveConnection
- TBD-16513 - tHiveOutput error on CDP with univ 3.3
- TBD-16515 - add a classloader for hive group
- TBD-16587 - Ugraded CDP BD Job with Custom Hadoop Jar file failing
- TBD-16602 - TDI job use hive component meet compile error if studio do not install - TBD feature.
- TBD-16611 - Check hive/impala connection failed with MDM license
- TBD-16619 - [HDI via Universal 3.1/3.3] AAD Authentication shouldn't be present for Azure storage-type cluster in Metadata
- TBD-16620 - Code generation error on a job with tAvroInput - tAvroOutput pipeline
- TBD-16622 - Drag component and save job has NPE error
- TBD-16626 - tHiveRow DI component is missing Propagate QUERY's recordset option
- TBD-16639 - [DI Hive tHiveInput in Dataproc mode] "Authentication" section must be hidden when Authentication type is "Use Access key and Secret"
- TBD-16640 - "Use Knox" is shown on distributions where it shouldn't be shown
R2024-07
New features in R2024-07
- TDI-50963 - tDenormalize converts null-values to string "null"
- TDI-51359 - Run job CreateUsers throw error "java.lang.NoClassDefFoundError: javax/inject/Singleton"
- TDI-51236 - HTTPClient - Retry on 'Connection refused' error
- TUP-43314 - Canvas: Improve node border
- TUP-43431 - Iceberg Metadata Connection and Wizzard
- TUP-43261 - Pre-download the update before installing it
- TUP-42695 - Cleanup hive wizard
- TUP-43330 - Add missing connection modes in hive wizard
- APPINT-35873 - JWT signature validation support for REST services
- TBD-16466 - GA - Universal Spark3.3 for HDInsight 5.1
- TBD-16405 - Iceberg (Spark) Feature Parity
CVEs fixed in R2024-07
CVE-2024-32888 (com.amazon.redshift:redshift-jdbc42:2.1.0.10) impacted:
DI components
BD components
CVE-2023-24057 (ca.uhn.hapi.fhir:org.hl7.fhir.r5:4.2.0) impacted:
APPINT components
CVE-2022-26612 (org.apache.hadoop:hadoop-common:2.10.2) impacted:
APPINT components
CVE-2018-17190, CVE-2023-22946 (org.apache.spark:spark-core2.11:2.4.8, spark-core2.12:3.2.2) impacted:
APPINT components
CVE-2019-20444 (io.netty:netty:3.9.9.Final, 3.10.6.Final) impacted:
APPINT components
CVE-2018-11798 CVE-2020-13949 CVE-2019-0205 CVE-2018-1320(libthrift-0.14.0.jar), impacted:
BD components
CVE-2023-3635 (com.squareup.okio:okio [1.6.0 1.14.0]), impacted:
DI components
Studio
CVE-2024-36114(aircompressor-0.27.jar), impacted:
BD components
CVE-2022-41404 (org.ini4j:ini4j 0.5.1) impacted:
DI components
Other issues fixed in R2024-07
- TDI-51321 - The I18N of tODataInput and tODataOutput are missing
- TDI-51237 - [Leftover] OpenAI. Add check connection action
- TDI-51263 - no any log for tftpclose component, compare with tmysqlclose/toracleclose and so on
- TDI-51406 - [Dataprep][TCK] Shared folders aren't supported
- TDI-51407 - [Dataprep][TCK] Preparation list isn't sorted
- TDI-51192 - Double escaped quote character in string config values
- TDI-50881 - tDataStewardshipTaskOutput renews token when Basic auth is used
- TDI-51428 - [Dataprep][TCK] Add APAC region
- TDI-51425 - "ORA-01843: not a valid month" error when using tOracleOutputBulkExec with 'update' action
- TDI-51226 - tMongoDBBulkLoad/tCosmosDBBulkLoad should have checkbox to disable retryable writes
- TDI-51310 - CosmosDBSQLAPI—Empty message dialog for metadata when server connection is not available
- TDI-51363 - Job migrated to patch R2024-05_8.0.1 fails to build
- TUP-42469 - View environment select box is editable
- TUP-43196 - Variable in the Component label for tdbrow stopped working on JDBC database
- TUP-43195 - Use local updatesettings throw errors in log
- TUP-43276 - Subjob colors and sizes lost in the 2024-05 update of studio
- TUP-42409 - Duplicate pop up notification for update new patches
- TUP-41498 - Component index issue
- TUP-41910 - Param -Dtalend.disable.internet=true to forbid internet access is not working
- TUP-43532 - Error in error log when publish demo route to cloud
- TUP-43304 - 8.0.16 plugin and R2024-05v2 P2 ignore set local repository
- TUP-43107 - difficult to see the new version in Project settings->Build->Maven->Deployment Versioning when use dark theme
- TUP-43087 - Cannot locate to the previous import items location
- TUP-43513 - Parent Artifact calls wrong child job when executing
- TUP-40840 - Duplicate menu items "Delete/Copy/Export items" show when select more than one jdbc connection and do right click
- TUP-43571 - Buttons for the driver table are lost when import the attached job
- TUP-43560 - Digital signature for Talend-Studio-win-x86_64.exe has expired
- TUP-43426 - Beta label in Icon is not fully displayed
- TUP-43060 - Application features install when import "Talend Cloud Demos" at launch studio page
- TUP-42947 - Dark mode: when focus on the Feature Manager, the background is too light, can not get the text show
- TUP-41828 - Cleanup org.talend.libraries, zookeeper
- TUP-41601 - Cleaning org.talend.libraries, jxl-wizard
- TUP-43033 - TCK Form - Big grey filler
- TUP-42926 - Link with Editor feature
- TUP-43078 - The query input box size is small in 8.0.1
- TUP-43582 - Studio cannot connect to CodeCommit after upgraded to R2024-06
- TUP-43498 - Three dot button looks not aligned with Password field
- TUP-43480 - Download failed for the following jars : [mysql-connector-java-8.0.33.jar when install optional third-party libraries
- TUP-43388 - Improve context value editable status(the button)
- TUP-41605 - Add CDC pop up error when use 'Sybase 16 (SQL Anywhere) and above'
- TUP-42800 - Error message is not clear if logon TMC project and update url in TMC isn't available
- TUP-42902 - AMC: Threshold Chart display incomplete
- TUP-43301 - Prompt editor is editable when use repository property type for OpenAI
- TUP-41839 - Cleanup Impala wizard
- TDM-10732 - [DSQL Map] Length of the EDI Interchange Control Number is not as expected
- TDM-10761 - [DSQL Map] Cobol input trimming does not remove special characters
- TDM-10806 - Structure can't open after switch to ns which URI is blank
- TDM-10811 - [Standard Map Editor] get npe when drag input to output blank in MapValues properties wizard
- TDM-10825 - Undo/redo buttons are not updated when a command is undo/redo
- TDM-10831 - [DSQL Test Run] get error when drag xml sample data to map which input representation is json
- TDM-10832 - Oracle database create fail with duplicate class name
- TDM-10833 - Map path of tHMap won't update after rename folder name
- TDM-10839 - Fix message referering to View Menu icon as triangle
- TDM-10858 - No need auto-start in bundle themes.common for use of SVG icons
- TDQ-21952 - tDataMasking: 'Should null input return null' leads to fail (invalid flow)
- TDQ-21960 - Job with tMatchModel, tMatchPairing, and TDS fails with error 401
- TDQ-21959 - tDataMasking: Email Masking sets wrong flow for empty values
- APPINT-36567 - Cannot instantiate class: org.apache.activemq.jndi.ActiveMQInitialContextFactory
- APPINT-36626 - Failed to deploy standalone Microservice route in TMC when Remoteengine using default Environment
- APPINT-35788 - tRESTRequest causes flows with 0 row to execute (fix not yet applicable to DB components)
- APPINT-36343 - Spring configuration not stored in the studio. 8.0
- APPINT-36624 - com.microsoft.sqlserver.jdbc.SQLServerDriver cannot be found in runtime
- APPINT-36533 - camel-core-xml dependency added twice in same pom file (microservice)
- TBD-15585 - failed to create Hive connection with Universal+spark 3.3 based on emr 6.10
- TBD-16296 - Behaviour difference between tFileOutputDelimited and tLogRow when tFileInputDelimited output data.
- TBD-16307 - Compile error when using universal spark 3.1 batch + dataproc
- TBD-16339 - tAvroInput component can not read byte_array type normal
- TBD-16397 - CVE Fixes for R2024-07
- TBD-16415 - Runtime exception Spark jobs with Hive components using Spark Universal 3.0 and 3.3
- TBD-16447 - NoClassDefFoundError: com/github/luben/zstd/RecyclingBufferPool when run batch job with iceberg components with spark 3.0, and 3.1
- TBD-16455 - SPARK - Yarn Client : Exception java.lang.NoClassDefFoundError: org/json4s/JsonAST$JValue
- TBD-16487 - add a classloader for Impala group
- TBD-16510 - tFileInputDelimited can't output the data correctly using RDD
- TBD-16550 - universal33 HDI use wrong jar
R2024-06
New features in R2024-06
- TDI-51043 - tHTTPClient - support downloading binary files
- TDI-51022 - Dataprep Javajet mark as On-Premises
- TDI-51247 - Configurable Timeout in Talend Studio for tELTSAPMAP
- TDI-50032 - Enable dynamic authentication settings for S3 Connection
- TUP-42880 - Update Studio Tutorial videos
- TUP-43075 - Add migration token UI before logon
- TUP-41805 - Support manual commit mode when connect to TAC
- TUP-34428 - [Runtime convergence] Load tck/dataprep join/lookups dependencies
- TUP-42091 - Having an popup editor for tck/textarea fields
- TUP-36962 - Studio AWS CLI support
- TDQ-21940 - DQ Batch components: Support for Spark Universal 3.5 in local mode
- TDQ-21939 - DQ Streaming components: Support for Spark Universal 3.5 in local mode
- TBD-15041 - Beta - Universal Spark3.3 for HDInsight 5.1
- TBD-15232 - Support for HDInsight connection mode with Hive components in Standard Jobs
- TBD-15677 - Support HPE Ezmeral Runtime Enterprise 5.6.4 (Spark, Livy, Kubernetes)
- TBD-15754 - Iceberg (Hive) Output & configuration components: Branching & Tagging
- TBD-16173 - Spark perf: Parallelize the write of outputs generated from the Output components - Implement output parallelization
CVEs fixed in R2024-06
CVE-2021-28168 (org.glassfish.jersey.core:jersey-common:2.33) impacted:
DI components
CVE-2017-3523 (Mysql:mysql-Connector-Java [3.1.14,5.1.30,8.0.12]) impacted:
Studio
CVE-2017-15095 (com.fasterxml.jackson.core:jackson-databind:2.4.0) impacted:
DI components
CVE-2024-2630 (commons-compress:1.21) impacted:
DQ Libraries
CVE-2024-29131 (commons-configuration2:2.8.0) impacted:
DQ Libraries
CVE-2024-23944 (zookeeper:3.9.1) impacted:
BD components
CVE-2024-34447 (org.bouncycastle:bcprov-jdk18on:1.77) impacted:
BD components
CVE-2024-29131,CVE-2024-29133 (commons-configuration2:2.8.0) impacted:
BD components
CVE-2019-20444 (io.netty:netty:3.10.6.Final) impacted:
DI components
CVE-2020-13956 (org.apache.httpcomponents:httpclient:4.1.2) impacted:
DI components
CVE-2023-50570 (com.github.seancfoley:ipaddress:5.3.3) impacted:
DI components
CVE-2023-44487 (io.netty:netty-handler:4.1.101.Final) impacted:
DI components
CVE-2024-22369 (org.apache.camel:camel-sql:3.20.6) impacted:
APPINT components
CVE-2024-29131 (commons-configuration2:2.9.0) impacted:
APPINT components
Other issues fixed in R2024-06
- TDI-51207 - WorkdayInput error msg unclear and lacks intuitiveness for grasping the errors.
- TDI-51348 - Beta category and label for Dataprep TCK
- TDI-51213 - Remove Cyberark output row
- TDI-51292 - [TCK] Guess schema fails if job contains a row with name 'out'
- TDI-51266 - tCosmosDBBulkLoad fix duplicated "if" condition in code
- TDI-51240 - MongoDB Authentication mechanism issue in Talend Studio Patch R2024-04
- TDI-51228 - mapping_oracle.xml not found in microservice
- TDI-51220 - tGSGet cannot process empty Google Store objects
- TDI-51175 - Unable to load data to snowflake from ADLSGen2
- TDI-51171 - XML file produced by tAdvancedFileOutputXML has an empty line
- TUP-40547 - Unable to open project in empty repo after decline initialisation
- TUP-42990 - 'Edit parameter using repository' dialog not pop up when click parameters in component
- TUP-42951 - JETL about studio dialog shows unreadable strings
- TUP-43002 - Can't open manage connections for build R05
- TUP-43018 - classpath.jar in MDM Job built using "Deploy to ..." contains absolute / "hard coded" full path name to jar
- TUP-43034 - Update Joblet icon from view of joblet
- TUP-43085 - MongoDB Authentication mechanism issue metdata wizard
- TUP-43086 - tAzureAdlsGen2Input fails to retrieve data with 'Data viewer'
- TUP-42773 - Context variable name change of type password is not cascaded to connection metadata and therefore to jobs
- TUP-43128 - Wrong warn message on Db connection wizard when create informix db
- TUP-42640 - Incorrect message when login TMC without token
- TUP-38050 - tELTPostgresqlMap issue when DB column with special char
- TUP-37952 - The SQL query for Teradata in metadata misses reserved word
- TUP-43070 - reconnect failure because of SSO idle timeout or kicked from tmc
- TUP-42929 - Optimize the layout/display of connection manage dialog for Mac
- TUP-43011 - Textbox isn't cleared in job editor when click other locations
- TUP-43089 - When Studio has lost connection and reconnects, not being able to stage files for Git
- TUP-43038 - Unable to see Merge Conflicts Resolution in case of conflicts
- TUP-42934 - Change login_h.png to new icon
- TUP-43203 - Support multi-language when clicking the help link of java 17 support
- TUP-41442 - Last used workspace not saved after install features in feature manager
- TUP-43220 - Studio log on tac/tmc project always disconnected by administrator.
- TUP-43105 - Session timeout and exit studio popup if access token and refresh token change to invalid
- TUP-42931 - Fix some wrong icons and issues
- TUP-42903 - Reference name and type value sync always for tWorkdayInput WWS mode
- TUP-42992 - Ubuntu dark: the edit schema button can not see clearly
- TUP-43144 - Failed to run job after upgrading to 8.0.1-R2024-05
- TUP-43093 - CI: cmdline is stuck when shutting down
- TUP-42981 - CI: output m2e execution log in cmdline
- TUP-42804 - Documentation tooltip not displayed on DI Demo job
- TUP-41145 - Thread issue of icons for TCK
- TUP-43035 - Dark: component configuration dialog cannot show the fullname of tab
- TUP-42834 - The leftover is generated in the Studio Home after importing a job
- TUP-42169 - Studio will be no responding if select a jdbc oracle database in "sql builder" page
- TUP-41468 - Jobscript error in the job with HttpClient TCK
- TUP-42691 - Extra Rectangular pattern when place the mouse over Feature Manager for Dark mode on Mac
- TDQ-21811 - Report/tDqReportRun: Fixed the issue preventing from running a report of overview analysis with Informix DB
- TDQ-21873 - Column set analysis: Fixed the issue preventing from running the analysis when indicators threshold is set for a pattern
- TDQ-21913 - DQ components: Fixed the issue preventing from using some components as the first one of a subJob
- TDQ-21911 - Analysis: Fixed the issue preventing from creating a new connection from analysis editor
- TDQ-21909 - Frequency table in the Preferences wizard: Fixed the issue preventing from setting the "Number of result shown" option
- TDQ-21887 - tDataQualityRules: Fixed the issue preventing from using the component with Lucene-based components
- TDM-10878 - When the "major" and "minor" attributes are added in tHMap the default namespace is not set in the generated XML
- TDM-10856 - NullPointerException using Flat Representation when log level is DEBUG
- TDM-10809 - getFirstNonInfo() method is not working as of R2024-03 patch
- TDM-10763 - The error when read copybooks in TDM
- TDM-10840 - Missing segment info in Retrieve SAP iDoc metadata in sap connection metadata
- TDM-10805 - [Structure editor] After undoing deletion of an inheriting element some children are not displayed
- TDM-10836 - get npe when right click on folders on function view and click "Properties "/"Paste as sibling"
- TDM-10680 - Copy/Paste of inherited element breaks expression
- TDM-9924 - [Flattening] Generated Column is too long to be handled by SQL Database
- TBD-15880 - smoke test for Job java and component java setting when they are set with java 17
- TBD-16328 - Exception with hive components using Spark Universal 3.5 Local
- TBD-16335 - Runtime error on Spark job with Redshift components using Spark Universal 3.0-3.4
- TBD-16341 - Missing add-opens
- TBD-16416 - Runtime exception on Spark Hive job with ORC format using Universal 3.4
- TBD-16421 - Runtime exception on DI job with Hive components using Hive3 docker image
- TBD-16446 - Can't check service for CDP connection in metadata
- APPINT-36483 - Route going to grace period when another route is being deployed
- APPINT-36539 - Loader constraint violation when resolving interface method 'void org.dom4j.XPath.setNamespaceContext(org.jaxen.NamespaceContext)'
- APPINT-36578 - MSAL4j lib not found when Azure AD deployed in Runtime
- APPINT-36459 - Standalone MS : adding extra parameter via commandline is not working
- APPINT-36495 - REST Service as Docker microservice with Promethues doesn't work
- APPINT-36023 - JSON Marshal error for custom beans
- APPINT-36560 - Issue while overriding microservice context param with commandline when contains the charater '='
- APPINT-36555 - Prometheus url failed to access when build route as standalone microservice at second time
- APPINT-36521 - Update microservices --help result
- APPINT-36503 - Microservice build fails:The value for annotation attribute EndpointInject.value must be a constant expression
R2024-05v2
CVEs fixed in R2024-05v2
None
Other issues fixed in R2024-05v2
- TUP-43173 - Improve Java 17 message
R2024-05
New features in R2024-05
- TDI-51137 - [Beta] Native OpenAI connector for Studio
- TDI-51124 - Apply new dark/light icons to TCK components
- TDI-49299 - httpclient - Retry with exponential backoff
- TDI-51059 - tBufferOutput issue with byte[]
- TUP-41596 - Handle tcompv0 components with different icons in dark and light theme
- TUP-41836 - Remove customize Joblet icon from joblet wizard
- TUP-42076 - Remove useless actions from Studio top bar
- TUP-42098 - Move "Install external software" from help menu to somewhere else
- TUP-42271 - Move AMC preference in the Talend node
- TUP-42299 - Handle joblet icons when d&d to jobs
- TUP-42548 - Handle joblet INPUT/OUTPUT/TRIGGER_INPUT/OUTPUT icons
- TUP-42848 - Integrate Native OpenAI connector in Studio
- TUP-42767 - Remove the "About License" menu
- TUP-42096 - Update website URLs for Help menus
- TUP-41512 - Studio update managed by TAC
- TBD-15407 - GA Universal Spark 3.1 for HDInsight 5.0
- TBD-15664 - Spark 3.5 - Local mode in Universal
- TBD-16172 - Spark perf: Parallelize the write of outputs generated from the Output components - tAvroOutput Migration
- TBD-16289 - GA for Universal Spark 3.3 with CDP Public Cloud Data Hub 7.2.x (v17)
- APPINT-35415 - Support use of "resources" context parameters for routes
- TUP-37236 - Modern Studio UI
- TUP-38527 - Eclipse update
CVEs fixed in R2024-05
CVE-2023-51775 (jose4j:0.9.3) impacted:
DI components
CVE-2017-9096 (com.lowagie:itext 2.0.8) impacted:
Studio
CVE-2020-15250 (junit:4.12) impacted:
Studio
CVE-2021-29425 (commons-io:[2.5,2.6]) impacted:
Studio
CVE-2022-29599 (org.apache.maven.shared:maven-shared-utils 0.9) impacted:
Studio
CVE-2024-26308 (org.apache.commons:commons-compress 1.21,org.apache.commons:commons-compress 1.25.0) impacted:
Studio
BD components
DQ components
CVE-2024-22243 (spring-core:5.3.29) impacted:
Studio
DQ components
APPINT components
CVE-2024-21634 (software.amazon.ion:ion-java 1.0.2) impacted:
Studio
DQ components
(netty-handler:4.1.104.Final) impacted:
Studio
CVE-2024-23450 (elasticsearch:7.17.14) impacted:
Studio
CVE-2024-23672 (tomcat-websocket:9.0.84) impacted:
APPINT components
CVE-2024-23944 (zookeeper:3.7.2) impacted:
APPINT components
BD components
CVE-2023-52428 (com.nimbusds:nimbus-jose-jwt 9.30.2) impacted:
APPINT components
CVE-2024-29131 (org.apache.commons:commons-configuration2:2.8.0), impacted:
BD components
CVE-2024-25710 (commons-compress:[1.21,1.23.0], impacted:
BD components
CVE-2024-28752 (org.apache.zookeeper:zookeeper 3.7.2), impacted:
BD components
CVE-2023-5072 (org.json:json 20230227), impacted:
Studio
Other issues fixed in R2024-05
- TDI-51076 - tFileInputPositional/tFileInputMSPositional cannot correctly separate rows by \r\n (CRLF)
- TDI-50871 - tJDBCRow as process component can't work with iterate line
- TDI-51178 - [TCK][studio-integration] Not all table values are migrated correctly
- TDI-51163 - Update action overwrites context variables
- TDI-51036 - tCosmosDBBulkLoad can't work with insert
- TDI-51187 - The value in TCK table will miss } at the end.
- TDI-51200 - Memory leak in kafka producer in Talend R2024-03
- TDI-50973 - tFileProperties not picking up the latest update to file in network share
- TDI-51136 - Export Dynamic dependencies in job build integration in Studio
- TDI-49670 - HTTPClient input raises a NPE when Output Key Value pair target an invalid Input Query parameter
- TDI-51141 - Regression compile error when a component field include + outside the double quote
- TUP-41413 - studio will hang up if I click refresh button on the dynamic distribution set up sub window
- TUP-41628 - 802: Studio stays on "Confirm changes" dialog after resolving conflict
- TUP-42356 - UI interaction with text fields in the context window does not return entered value
- TUP-42864 - Error when building job "No enum constant org.talend.core.database.ERedshiftDriver.ORACLE_11"
- TUP-42842 - Socket timeout because of new System property defaultReadTimeout
- TUP-42201 - Job design will be reverted when changing a joblet name
- TUP-41947 - Unable to checkout on previous job version
- TUP-41396 - can't add database for AMC on master
- TUP-42459 - Jobs modified / corrupted after patch 7.3.1 / R2024-03
- TUP-41338 - http p2 repository is not supported by new eclipse
- TUP-42081 - [Master] error log/warning log when run ci mvn command.
- TUP-42194 - Delete unused routines provider plugins
- TUP-42413 - Can't login project after install features
- TUP-42601 - enable set read timeout to 0 directly works for nexus connection
- TUP-42605 - Remove dependency jboss.jar from localprovider
- TUP-42642 - CI: failed to run mvn package
- TUP-42665 - Mvn regenerateAllPoms throw error "Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.2.5" when install 802 base on 801R03.
- TUP-42686 - “-Dosgi.requiredJavaVersion” is still 11 after 8.0.1-R2024-05 is installed
- TUP-42797 - Rename Custom Routine Fail
- TUP-42905 - CI: cmdline use settings file for from Maven
- TUP-42907 - Improve message for the java 17 requirement
- TUP-43026 - Wrong compiler JVM was setup when starting Studio in Linux
- TUP-41770 - On Ubuntu 20.04 Tooltip is displayed as a black box when Talend light theme is selected
- TUP-43063 - 'Image name' default value is null/nullnull when Publish Docker Image
- TUP-41769 - crash with tadvancedfileoutputxml on linux
- TUP-42604 - Update Detection issue - crashed Studio 8 in RHEL OS when trying to propogated at once the change in metadata connection
- TUP-43174 - File <epoch>.log (For ex 1717400090178.log) created in Studio folder configuration at each start even when no error
- TDM-10410 - Second version of the DSQL support to TDM
- TDM-10566 - Support light mode/dark mode set of icons
- TDM-10587 - importing database tables having same name (case sensitive not used) throw org.hibernate.cfg.JDBCBinderException
- TDM-10614 - Upgrade eclipse to 2023-12
- TDM-10686 - [tHMapFile]get npe when choose DSQL map which input/output is wrap Map
- TDM-10706 - Standard map using db tables can't open after close
- TDM-10736 - [Standard Map]Offset Time with output format HHMMSSDD loses the offset
- TDM-10753 - [Standard Map] XQuery formatting for error reporting takes too much memory
- TDM-10784 - [Standard Map] Examples EDI PRICATto832 has an Error converting EDI Date/Time to Date
- TDM-10800 - Configuration dialog for tHConvertFile can't open after configure it
- TDM-10801 - 'HL7V2' shouldn't in output representation list of tHConvertFile for some conditions
- TDM-10808 - [tHMap]Redeclared variable error occurs with a connection name
- TDM-10810 - Get 'ConcurrentModificationException' when call 2 services use same map in ESB runtime
- TDQ-21888 - tDqReportRun: Updated org.apache.ant from 1.10.11 to 1.10.14
- TDQ-20540 - tDqReportRun: Improved the performance when using a Java engine(no need to store drill down data)
- TDQ-21647 - Data Quality data mart has been deprecated in Talend Installer
- TDQ-21812 - Remove 5 deprecated DQ components
- TDQ-21881 - Ingress database: Added a none-support icon on this database connection
- TDQ-21910 - UDI: Enhanced an error message when defining Java expressions
- TDQ-21893 - Handled the dependabot alerts of data-quality-ee lib
- TBD-14914 - [Universal 3.2-3.3] tDynamoDBInput component on Spark Batch jobs provides empty output
- TBD-15567 - A HBase batch job with Universal 32-34 has failed
- TBD-16135 - Runtime exception on tSqlRow component in Spark Universal Local mode RDD
- TBD-16158 - Performance differences between Talend 7.3 and 8.0.1 of Big Data Batch Jobs
- TBD-16247 - Bump talendfileenhanced for tbd-studio-ee components
- TBD-16255 - Wrong Maven URI for parquet-hadoop-bundle jar in EMR 6.2
- TBD-16258 - tFileInputDelimited uses partitions even if it's disabled in UI - dataset only
- TBD-16259 - Clean duplicate deletion code when overwriting tFileOutputParquet
- TBD-16290 - Issue with Java 17 and tIcebergOutput
- TBD-16294 - Compile error on Spark job with tKafkaInputAvro with activated "Use Schema Registry" in tKafkaConfiguration
- TBD-16298 - [UI/hive] Some connection parameters are redundant in tHiveRow and tHiveCreateTable in DI jobs
- TBD-16299 - Fix unit test related to RenameHBaseDeleteRowMigrationTask
- TBD-16301 - Compile error for DBR which uses init scripts
- TBD-16302 - 'Use SSL encryption' option should not be visible for 'Dataproc' and 'HDInsight' connection modes in Hive di
- TBD-16303 - UI overlap for Hive components in di if use 'HDInsight' connection mode
- TBD-16313 - After applying R2024-04, "tHive Components Date Type format changed to "yyyy-MM-dd HH:MM:ss after migration from v7.2 to V8"
- TBD-16320 - [Studio 7.3] Compile error on Spark job with tFileInputDelimited component
- TBD-16326 - Missing add-opens when using Java 17 compatibility
- TBD-16331 - Missing backport of category.xml for org.talend.lite.bd.universal34x.feature on maintenance/8.0.2 and master
- TBD-16340 - Batch jobs with Hbase components fail (SPARK 30- SPARK 34)
- TBD-16346 - HBase IO components on DI jobs fail on 8.0.2 patches with Java 17
- TBD-16269 - Reduce code duplication and basic unit test on launcher with no coverage
- TBD-16343 - Error when using tHiveCreateTable - Cannot find class 'parquet.hive.DeprecatedParquetInputFormat
- APPINT-36445 - New microservices don't overwrite contexts
- APPINT-36467 - Exception raised in studio when the imported API includes components
- APPINT-36444 - Conflict between javax.mail-1.6.2.jar and Jakarta.mail-1.6.7.jar
- APPINT-36516 - Context parameter of type PASSWORD is always NULL when microservice is deployed in a RE
- APPINT-36528 - Context Parameters set in TMC aren't taken into account to the Microservice
- APPINT-36493 - Issues with new microservices: noSuchMethod error for commons.lang3.Range.of
R2024-04
New features in R2024-04
- TUP-39550 - Customization for Dockerfile parameter
- TUP-38902 - Add tag : Allow the creation of annotated tag / tag with message
- TUP-41685 - Ability to checkout new branch from Tag
- TUP-42095 - Update supported lower versions to R2024-05
- TBD-15120 - Iceberg on Spark engine - tIcebergOutput & tIcebergCatalog
- TBD-15332 - tIcebergInput Spark component
- TBD-14581 - Beta for Universal Spark 3.3 with CDP Public Cloud Data Hub 7.2.x (v17)
- TDI-49024 - CosmosDB add support for Dynamic schema like MongoDB
- TDI-51055 - Remove tBonita* components everywhere
- APPINT-36344 - Dataservices: Adding support for prometheus endpoint
CVEs fixed in R2024-04
CVE-2022-45868 (com.h2database:h2 2.1.214), impacted:
Studio
CVE-2023-35116 (jackson-core:2.14.3), impacted:
Studio
DQ components
APPINT components
CVE-2023-4759 (org.eclipse.jgit:org.eclipse.jgit 5.12.0.202106070339-r), impacted:
Studio
CVE-2023-42503,CVE-2024-26308,CVE-2024-25710 (commons-compress:[1.21,1.23.0], impacted:
Studio
CVE-2023-51079 (mvel2:2.2.8.Final), impacted:
Studio
DQ components
CVE-2021-22569 (com.google.protobuf:protobuf-java 3.15.6), impacted:
DI components
CVE-2019-20444 (io.netty:netty:3.9.9.Final), impacted:
BD components
CVE-2023-34610 (json-io:4.9.9) impacted:
BD components
CVE-2021-20218 (io.fabric8:kubernetes-client:4.12.0), impacted:
BD components
CVE-2023-1370 (json-smart:2.4.7), impacted:
BD components
CVE-2022-1471 (snakeyaml:1.33) impacted:
BD components
CVE-2023-51074 (json-path:2.1.0) impacted:
DI components
CVE-2022-42003 (jackson-databind-2.13.2.2.jar), impacted:
DI components
CVE-2023-42503 (commons-compress:1.23.0) impacted:
DI components
CVE-2023-3635 (okio-jvm:3.2.0) impacted:
Studio
CVE-2020-13959 (velocity-tools:2.0) impacted:
Studio
PRISMA-2023-0067, CVE-2023-35116 (jackson-core : 2.14.3) impacted:
DI components
CVE-2024-29025 (netty-codec-http, netty-handler:4.1.101.Final) impacted:
APPINT components
CVE-2024-22201 (org.eclipse.jetty.http2:http2-common:9.4.53.v20231009) impacted:
APPINT components
CVE-2024-26308 (org.apache.commons:commons-compress:[1.21,1.22]) impacted:
APPINT components
Other issues fixed in R2024-04
- TDI-50373 - tNetsuiteInput Component unable to add the search condition for the column "Field"
- TDI-50945 - "Action with name VALIDATION_ENCODING wasn't found" background error for tSambaInput and tSambaOutput
- TDI-50930 - Guess schema button not work for tWorkdayOutput
- TDI-50996 - Netsuite SOAP failed when running with APPINT Microservice mode because of WSDL file
- TDI-51010 - OdataInput single entity request doesn't work when GUID is a key
- TDI-51065 - CosmosSQLAPI connection mode is DIRECT when using Gateway in advance setting
- TDI-50546 - [TCK JDBC]: Snowflake guess schema button is slow tjdbcoutput, but fast in tjdbcinput
- TDI-51025 - NBLINEINSERTED cause NPE after upgarde studio
- TDI-50969 - Display SubJobs name available via MDC Logging in Remote Engine
- TDI-50994 - [TMC]Job not failing with Fatal when using parallel execution
- TDI-50876 - tPostgresqlOutputBulkExec insert/update weird character rather the Chinese character
- TUP-42160 - SQL Builder: Query editor is missing after openning one saved query for JDBC connection
- TUP-41948 - Incorrect links to token generation page
- TUP-42103 - can't see custom routine jars under node "Custom Routine Jars" after import
- TUP-42218 - system routines show in file relationship.index under project .settings after import old job
- TUP-42300 - Error: Could not resolve dependencies for project org.example.test2.code:routines:jar:8.0.1: The following artifacts could not be resolved: org.antlr:antlr-runtime:jar:3.5.2
- TUP-42389 - Code Generation and Building take longer in R2024-03
- TUP-42442 - MSSQL: Cannot GuessSchema and Open Query in Job>tDBInput>BasicSettings if schema name contains "\";
- TUP-42439 - [bug]Ubuntu22: there is one error after update to 8.0.1-R2024-05 and restart
- TUP-37859 - List of tables in SAP Connections are unsorted
- TUP-42136 - DataprepTCK. The content of content that is populated by action can't be saved
- TUP-42411 - Migrating to v8 showing duplicated Ids for job design/metadata object and endless importing process
- TUP-42598 - [TCK]The drop down list can't be refreshed
- TDM-9950 - Dsql Maps in Studio's "Import items" list have the wrong icon
- TDM-10722 - Add Cobol Reader option to replace Windows 0x0D0A newlines with Linux 0x0A
- TDM-10591 - Add a rounding function
- TDM-10714 - [8.0.1] tHmap memory leak in runtime when invalid values passed
- TDM-10628 - Get error when map input to output in MapValues function
- TDM-10667 - Upgrade swagger-parser from 2.1.12 to 2.1.20
- TDM-10628 - Get error when map input to output in MapValues function
- TDM-10657 - Move Mapping Preferences under Studio
- TDM-10617 - [Standard Map]If-Then outputs for XML and JSON representations are different
- TDM-10590 - Allow global variable to determine dynamic map at runtime
- TDM-10586 - Get npe when tHMapRecord choose blank map(dsql & standard)
- TDM-10671 - [8.0.1] Upgrade jackson-core from 2.14.3 to 2.16.0
- TDM-10733 - Null pointer exception raised when trying to open "select map path" dialog
- TBD-15266 - synchronize tHbaseDeleteRows DI and Spark components
- TBD-15922 - Spark perf: Parallelize the write of outputs generated from the Output components -TFileOuputDelimited Migration
- TBD-16079 - Remove link to distribution in DI for Hive Components
- TBD-16086 - [DI] tHbaseOutput can write data without specified "Family name"
- TBD-16090 - tHbaseDeleteRows component generates java.io.NotSerializableException error
- TBD-16141 - Runtime exception on Hive components with Hive3 DB in Spark job when table format is Parquet
- TBD-16151 - Null values while reading data in Talend job from HIVE external tables
- TBD-16171 - Spark perf: Parallelize the write of outputs generated from the Output components -TFileOuputParquet Migration
- TBD-16175 - Talend job CICD build failure
- TBD-16179 - [TFileOutputDelimited] implement BigDecimal precision for dataset implementation
- TBD-16238 - Migrated 7.3.1 job design give "IndexOutOfBoundsException" after checked "use Dataset API in migrated components"
- TDQ-21851 - Update some fucntions name in tDataUnmaksing UI
- TDQ-21875 - Upgrade 'antlr-runtime' to 3.5.2 in 'org.drools.eclipse'
- APPINT-36279 - Data Service fails to build/publish from Shared-Mode enabled Studio
- APPINT-36200 - Failed to run Test Case for route component
- APPINT-36205 - tHttpclient Component failed to deploy in ESB R2023-11
- APPINT-36371 - No metrics in TMC UI for data service as new MS
- APPINT-36380 - Build wizard for Data Services is missing Prometheus checkbox when Docker is selected
- APPINT-36402 - Build types list contains Microservices even if APPINT feature is not installed
- APPINT-36412 - Microservice with cSOAP consumer + https fails with org.apache.cxf.interceptor.Fault
- APPINT-36413 - Unexpected docker options when build some routes as OSGI without opening route
- APPINT-36297 - Build wizards: keep file extension in sync with "Export as ZIP" checkbox
- APPINT-36363 - When requested the soap server with username token and password in standalone microservice, there will be error
- APPINT-36299 - Confirmation message to overwrite microservice file in build wizards
- APPINT-36478 - No endpoint found in Service Locator when request tRESTRequest job as standalone microservice
R2024-03
New features in R2024-03
- TDI-48875 - CyberArk WCS (Web-based Credential Services)support in Talend
- TDI-50471 - Support Managed Identity (MSI) in tAzureSynapseBulkExec
- TDI-50356 - Support fetch all records at once for tSAPTableInput CDS-View standard extraction
- TDI-50732 - Remove old version of Postgres "prior to v9" in components
- TDI-50475 - Upgrade CosmosDB client SDK to V4
- TDI-50731 - Remove support of MongoDB 3.5.X in components
- TDI-50733 - Deprecate TCOMPv0 : tCouchbaseDCP*
- TUP-41682 - Remove support of MongoDB 3.5.X in Metadata
- TUP-41736 - Remove old version of Postgres "prior to v9" in metadata
- TUP-41655 - Upgrade metadata bridge to version 11.1
- TUP-42073 - Studio feature for the new TCK component added tCyberarkCCP
- TUP-31404 - Be able to use System routines in Custom library Jar
- TDQ-21856 - Removed the Postgres versions prior to v9 in datamart and DQ components
- APPINT-36162 - Optionaly deactivating microservice security for short list of management endpoints
CVEs fixed in R2024-03
CVE-2018-1000613,CVE-2018-1000180,CVE-2017-13098,CVE-2023-33201,CVE-2023-33202 (bcprov-jdk15on:1.57), impacted:
DI components
CVE-2022-4244, (org.codehaus.plexus:plexus-utils:3.0.8), impacted:
Studio
CVE-2022-29599 (maven-shared-utils:0.9,3.0.1,3.1.0), impacted:
Studio
CVE-2023-33201 (bcprov-jdk15on:1.70), impacted:
Studio
CVE-2021-26291 (maven-core:[2.0.6,3.0]), impacted:
Studio
CVE-2022-40146 (batik-bridge:1.13) impacted:
DI components
CVE-2023-2976 (guava:30.1.1-jre) impacted:
DI components
CVE-2021-43859 (xstream:1.4.17) impacted:
DI components
CVE-2009-1523 (jetty:6.1.26) impacted:
DI components
CVE-2023-1428,CVE-2023-32731,CVE-2023-32732 (grpc-xds:1.50.1) impacted:
DI components
CVE-2023-51074 (json-path:2.8.0, json-path:2.1.0) impacted:
APPINT components
BD components
CVE-2020-11050 (Java-WebSocket:1.3.8) impacted:
APPINT components
CVE-2022-23913, CVE-2021-4040 (artemis-core-client:2.19.1) impacted:
APPINT components
CVE-2022-41704 (batik-bridge, batik-script:1.14) impacted:
APPINT components
CVE-2023-48795 (jsch:0.2.1) impacted:
APPINT components
CVE-2021-37533 (commons-net:3.6) impacted:
APPINT components
CVE-2022-1415 (drools-compiler:7.64.0.Final) impacted:
APPINT components
CVE-2014-0193 (flink-runtime2.11, flink-clients2.11:1.6.2) impacted:
APPINT components
CVE-2017-3162 (hadoop-hdfs, hadoop-yarn-common:2.6.5) impacted:
APPINT components
CVE-2017-3166 (hadoop-mapreduce-client-core:2.6.5) impacted:
APPINT components
CVE-2020-10693 (hibernate-validator:6.0.18) impacted:
APPINT components
CVE-2021-34538 (hive-metastore:2.3.9) impacted:
APPINT components
CVE-2023-33008 (johnzon-mapper:1.2.20) impacted:
APPINT components
CVE-2022-0839 (liquibase-core:3.6.3) impacted:
APPINT components
CVE-2022-24614, CVE-2022-24613 (metadata-extractor:2.16.0) impacted:
APPINT components
CVE-2022-21449 (nimbus-jose-jwt:7.9, 9.8.1) impacted:
APPINT components
CVE-2022-3509 (protobuf-java:3.21.5, 3.15.2) impacted:
APPINT components
CVE-2021-20293, CVE-2021-20289, CVE-2020-25633 (resteasy-core, resteasy-core-spi, resteasy-client:4.5.6.Final) impacted:
APPINT components
CVE-2020-1729 (smallrye-config:1.6.1) impacted:
APPINT components
CVE-2023-32007 (spark-core_2.11:2.2.1) impacted:
APPINT components
CVE-2020-9480 (spark-network-common_2.11:2.2.1) impacted:
APPINT components
CVE-2023-3223 (undertow-servlet:2.2.24.Final) impacted:
APPINT components
CVE-2024-1597 (org.postgresql:postgresql:42.6.0) impacted:
Studio
DQ components
DI components
CVE-2022-30187 (azure-storage-blob:12.17.0) impacted:
DI components
CVE-2019-20444 (netty:3.10.6.Final) impacted:
DI components
CVE-2019-16335 (jackson-databind:2.4.0) impacted:
DI components
Other issues fixed in R2024-03
- TDI-50941 - Unable to append feed to an existing file with tRSSOutput
- TDI-50953 - SalesforceMarketing create datastore and dataset name
- TDI-50893 - tMysqlOutputBulkExec does not include "use an existing connection"
- TDI-50887 - Bug in tDBSCD standard component
- TDI-50442 - Remove 'POSTGRESPLUS' from the mapping file list of tJDBCInput
- TDI-50932 - tELTMSSqlMap : Error in code after migration from 7.3.1 to 8.0.1
- TDI-50885 - Rewrite I18n approach in Messaging connector
- TDI-50746 - Google Analytics Cloud connection credential field is not displayed following TDI-49775
- TDI-50837 - tSnowflakeRow (as output/processor) set the shared connection autocommit to true despite the initial value
- TDI-50902 - tMySqlOutputBulkExec component does not have some labels that tMySqlBulkExec has
- TDI-50864 - Kafka connection is closed while some threads are still publishing message
- TDI-50640 - Unable to upload attachments to Jira using tHTTPClient multipart+upload files
- TDI-50838 - Can't upload file with tHTTPClient on qlik clould
- TDI-50937 - 8.0.1 Monthly patch plugin org.talend.designer.components.tisbdprovider didn't update since 20230330
- TDI-50843 - tjdbcinput can't detect schema under some circumstances
- TDI-50490 - Jira JQL expression problem after TComp to TCK migration
- TDI-50852 - "HTTP/1.1 400 Bad Request" happened when using tFileFetch to upload a file
- TUP-41794 - Unicode escape character is handled differently from Metadata DB viewer and generated Java code in job
- TUP-41653 - Upgrade apk-signer version
- TUP-41196 - JDBC Guess schema hangs when the connection password is wrong
- TUP-41121 - CI builder fails to generate pom if non-existant CI builder version polluted .m2
- TUP-42045 - Jobs are migrating when switching branches
- TUP-40816 - Studio hang on when try to do retrieve schema for jdbc informix connection
- TUP-41723 - Auto conversion type is not saved in the project settings
- TUP-41894 - Remove / disable the parameter component.kit.skip
- TUP-42011 - Choose Context dialog popup many times on a click of tNetsuitexxx TCK components
- TUP-41141 - Reject row schema "errorCode"/"errorMessage" will always disappear when do reopen job and update the schema
- TUP-41330 - Error : The distribution AMAZON_EMR doesn't exist after applying R2023-12 Studio patch
- TUP-41773 - Give tip to button to wrap context value and button to modify dialog
- TUP-41965 - Wrong value for context parameter type=resource when published using a CI/CD pipeline
- TUP-42084 - guess schema pop up error for jdbc component
- TUP-42131 - Password textbox is "*********************", but it should be "((String) globalMap.get("myPasswd"))
- TUP-39512 - [TCK][Studio] Unable to retrieve schema for tGoogleAnalytics if the dataset is created from Metadata
- TDM-9885 - Importing mysql with two databases having tables with same name throw mapping error
- TDM-10519 - [Database from studio]connections under folder can't display
- TDM-10520 - [Database from studio]Database type always 'MySQL' when import from jdbc connection
- TDM-10526 - jdbc connection with special caracters url can broke database importer from studio
- TDM-10600 - Remove tdm-eclipse from components required dependencies
- TDM-10627 - [Database]Test connection fail while tables can get without problems
- TDM-10632 - [Database]get npe click 'Restore Defaults' button in 'Edit Classpath' dialog
- TDM-10638 - get error when test run map with agcount and choice
- TDM-10641 - [Standard map]no error when use standard map which miss csv input in tHMapFile
- TDM-10645 - [tHMap]Invalid error shown when tHMap has a "Lookup" output connection
- TDM-10661 - Source file won't be released after finish create structure
- TDM-10668 - Exception occurs during "Show Document" of a CSV structure with the root and loop having the same name
- TDM-10683 - Studio has double "feature manage" button when switch to new project
- TDQ-21816 - File Delimited connection: Fixed the issue preventing from switching context
- TDQ-21719 - Snowflake data mart: Fixed the issue causing different RUNTIME depending on the analysis type
- TDQ-20747 - MySQL connection: Fixed the issue on analysis caused by renaming the connection
- TDQ-19026 - Business rule analysis: Fixed the issue causing wrong analyzed elements when there are two or more tables/views
- TBD-13174 - [BUG] Can't find SaveMode "Ignore"
- TBD-15940 - Cleanup Impala components
- TBD-16107 - tFileInputDelimited read "0" as "null"
- TBD-16130 - tDeltalakeOutput failes due to a lot of exceptions in logs
- TBD-16142 - [BUG]NPE error when I run DI job with tImpalaCreateTable
- APPINT-36325 - cWireTap to expression (simple, groovy,...) : generated code not compilable
- APPINT-36160 - Error raised because amqp is selected by default when a cMessagingEndpoint is added to a route
- APPINT-36318 - New Microservices: Unexpected warning message at startup
- APPINT-36321 - New Microservices: Default values in image name/image tag are missing when building docker image
- APPINT-36382 - New Microservices: overriding whole context in microservice is not working
- APPINT-36322 - New Microservices: Error occurs when requesting a rest server with service locator
- APPINT-36323 - New Microservices: Unexpected confirmation message when finishing wizard to build route as docker image
- APPINT-36331 - New Microservices: The archive file should be non-editable when building as docker image
- APPINT-36350 - New Microservices: Route including a cMessagingEndpoint with jetty does not work
- APPINT-36351 - New Microservices: Conflict with the registered path / when executing a route with cSoap using relative path
- APPINT-36358 - New Microservices: Publish wizard for Docker Microservice should disable the page with 'Export as ZIP'
- APPINT-36375 - New Microservices: Use of context variable in endpoint does not work when deploying from TMC
- APPINT-36330 - New Microservices: Unexpected zip file created When building a docker image
- APPINT-36372 - New Microservices: When building as zip file for the second time, the structure in zip is incorrect
- APPINT-36335 - New Microservices: Simple UI improvements in publish wizards
R2024-02
New features in R2024-02
- TDI-39118 - Need a component to support the SalesForce Marketing connectors
- TDI-50739 - Support for a fixed drop down list with dynamic values
- TDI-50713 - Support Google Analytics 4 API
- TDI-49526 - Support for most popular data types for tsapadsooutput component on BW on HANA
- TDI-48978 - Remove Kafka v0.x / v1.x / v2.2 / v2.4 version
- TDI-50127 - HTTPClient - Support additional parameters for OAuth Client Credentials
- TDI-50900 - OData - CommonExceptionHandler - Action with name ACTIONSUGGESTABLELOADOAUTH2FORM_PARAMS wasn't found
- TUP-41687 - Integrate Salesforce Marketing Connector
- TUP-41804 - Support Nexus version 3.64
- TUP-36908 - tRunJob: Add filter to select subjobs
- TUP-41400 - New TCK component studio feature (Google analytics 4)
- TDQ-21331 - DQ Batch/streaming components: Support of Universal Spark 3.4 with Databricks of aws
- TDQ-21332 - DQ Batch/streaming components: Support of Universal Spark 3.4 with Databricks of azure
- TBD-15958 - GA - Universal Spark 3.4 - Databricks support
- TBD-15770 - INSERT(OVERWRITE) capacity in tIcebergOutput in DI palette
- TBD-15755 - Specify catalog for tIceberg[*] components
- TBD-14909 - Configuring ADLS Gen2 Storage to use service principal when connecting to HD Insight
- TBD-15660 - TALEND 8.0 to support the latest CDP version(7.1.9)
- APPINT-35876 - New Microservice build type to replace deprecated Spring Boot 2 Microservices
CVEs fixed in R2024-02
CVE-2023-6378 (logback-core:1.2.10), impacted:
DI components
APPINT components
CVE-2023-34062 (reactor-netty-http-1.0.25.jar), impacted:
DI components
CVE-2023-39410 (org.apache.avro:avro 1.10.2), impacted:
DQ components
BD components
Studio
(netty-handler:4.1.100.Final), impacted:
Studio
CVE-2019-1010206 (http-request:6.0), impacted:
DQ components
CVE-2023-32697 (sqlite-jdbc:3.40.0.0), impacted:
DI components
Studio
CVE-2023-42809 (redisson : 3.16.7), impacted:
APPINT components
CVE-2023-46120 (amqp-client : 5.14.0, 5.13.1), impacted:
APPINT components
CVE-2023-31582 (jose4j : 0.7.9), impacted:
APPINT components
CVE-2023-34055 (spring-boot:2.7.15), impacted:
APPINT components
CVE-2023-24815 (vertx-web : 4.3.6), impacted:
APPINT components
CVE-2023-22899 (zip4j : 2.11.2), impacted:
APPINT components
CVE-2023-35887 (sshd-common : 2.9.2), impacted:
APPINT components
CVE-2023-46589 (tomcat-embed-core:9.0.82), impacted:
APPINT components
CVE-2023-5072 (Json:20230227), impacted:
BD components
CVE-2023-43642 (org.xerial.snappy:snappy-java,1.1.10.1), impacted:
BD components
CVE-2023-44487 (netty-codec-http2:4.1.94.Final), impacted:
BD components
CVE-2017-3523 (mysql:mysql-connector-java:5.1.30), impacted:
BD components
CVE-2023-44981 (org.apache.zookeeper:zookeeper:3.6.2) impacted:
BD components
Other issues fixed in R2024-02
- TDI-50400 - Netsuite cannot write Date with dynamic when dynamic date from a file
- TDI-50586 - Align jaxen in javajet components. Some components miss jaxen-1.1.6.jar on master
- TDI-50610 - tAmazonOracleOutput job can't generate code
- TDI-50677 - Remote Engine Failing tHTTPClient job - DSSL is not supported in the SE
- TDI-50699 - xom-1.2.7 causes cannot access class SAXParser errors with JDK 17
- TDI-50701 - Job using tXMLMap : Duration multiplied by 4 after migration from 7.1.1 to 8.0.1
- TDI-50703 - / character not allowed for Xpath loop query in tFileInputXML
- TDI-50719 - tRunjob : usage of "subjob" instead of "child job" in parameters
- TDI-50720 - tRunjob : option "load context parameters from file" does not support parallelization.
- TDI-50737 - tRSSInput cleanup org.talend.libraries
- TDI-50769 - Cleaning org.talend.libraries, tBigQueryBulkExec
- TDI-50771 - Cleaning org.talend.libraries, tJMS
- TDI-50796 - Cleaning org.talend.libraries, tFileInputJSON
- TDI-50767 - Cleaning org.talend.libraries, tMicrosoftCrm
- TDI-50766 - Cleanup org.talend.libraries, tWebService / tWebService
- TDI-50768 - Cleaning org.talend.libraries, tMom components
- TDI-50620 - [TCK COMMON JAVAJET]: reconsider the ITERATE output line support for tck input connectors only
- TDI-50829 - After Patch R2023-12v3 the jobs are failing with 65535 size limit issue
- TDI-50480 - Fix typo in tBigQueryBulkExec and tBigQueryOutput components
- TDI-50817 - Error in tVerticaSCDBeginJava.java : syntax error on token(s), misplaced construct(s)
- TUP-41640 - Incorrect message when login TMC project
- TUP-41516 - Data Lineage issue
- TUP-41570 - at certain operations git push to wrong branch.
- TUP-41397 - Issue when set a reference project
- TUP-41344 - Compile errors when calling a custom routine in referenced project from child job
- TUP-41122 - Talend Studio 8 fails to download jar libs from talend-update web site (customer uses proxy.pac script)
- TUP-41099 - Author path not updated for all items when moved as group
- TUP-41128 - Test case can't be imported correctly
- TUP-41729 - [Nightly] nightly-patch missing lib folder for plugin org.talend.mdm.ws.enterprise8.0.1.202310110839.jar
- TUP-41606 - Compile error when using tJDBCInput with comment has line break
- TUP-41623 - SharedMode: Git repository tree is still old mode after logging into one new git project
- TUP-41534 - Remove dependency on pendo related API during logon process
- TUP-41316 - tELTOracleMap generates incorrect column names when spaces present
- TUP-41180 - the generated code is different which caused the job execution to fail
- TUP-41080 - Active/Deactive features will cause commit window after restart
- TUP-41673 - Update bcprov-jdk15on:1.70 to bcprov-jdk18on:1.74 for nosql wizard
- TUP-40846 - Error shows after import items if workspace path contains Special char
- TUP-41688 - Talend Studio 8.0.1 / Java 17 / Memory Run : Searching the active JVM of current job / there is no job running
- TUP-41447 - TCK migration issues
- TUP-41459 - Edit tacokit table parameters on repository metadata, can't propagate the modification to job
- TDQ-21743 - ThresholdViolationAlert job failed when the datamart is snowflake context mode
- TDQ-21744 - Column analysis: some issues for datatime type with java engine analysis and report
- TDQ-21715 - tAddCRCRow: cleanup org.talend.libraries
- TDQ-21723 - Update the DQEEDEMOS project
- TDQ-21724 - tDqReportRun: cleanup correct GAV
- TDQ-21745 - Refresh only if needed when initializing DQ
- TDQ-21646 - Match analysis: store on disk get different result for first time run and second time run
- TDQ-20568 - Performance: Reduction of the time re-run Basic Column analysis with Java engine
- TDM-9177 - Remove support for JavaBean Representation (Phase 1)
- TDM-9392 - Remove XSLT Support in TDM
- TDM-10538 - Primitive element won't update when change group which group type not sequence to Map
- TDM-10551 - Cleanup LICENSE related files still bundled in com.oaklandsw.transform
- TDM-10557 - Streaming on child loop instead of parent loop produces wrong result
- TDM-10575 - Input Streaming fails: Expected replayed element outsideOfLoop does not match outerA
- TDM-10576 - EDIFACT, X12 and SAP_IDOC Representations are not recognized by the Configuration wizard
- TDM-10577 - Remove database XA Transaction support
- TDM-10629 - Wrong error when add input component to thmap which map input is payload wrapper
- APPINT-36280 - Deployment fails with cMQConnectionFactory and tMOMConnection in same artifact
- TBD-15400 - [BUG]Runtime mode will be changed to local if I uncheck use dataset API in migrated components
- TBD-15647 - [Studio 7.3/8.0] Credentials for tAzureFSConfiguration are printed as Plain Text in 'Debug' log mode
- TBD-15959 - tImpalaInput - java.net.SocketException: Connection reset error - when tImpalaConnection component is not used with CDP kerberos enabled cluster
- TBD-15978 - Job failed when adding multiple lines in "Column mapping" table in "Change column" in tIcebergTable
- TBD-15980 - NoClassDefFoundError in HDI 5.0: org/apache/logging/log4j/spi/LoggerContext
- TBD-16015 - Input component have a migration task about date pattern that should not be applied
- TBD-16034 - tDeltaLakeOutput - Code error when selecting "Merge"
- TBD-16046 - Spark job with HDI 5.0 with ADLS Gen2 storage fails due to runtime exception
- TBD-16067 - Job fails to compile if there are 2 tHBaseOutput components
- TBD-16068 - ticebergOutput is not work in TUJ iceberg environment
- TBD-16092 - Spark local 32 jobs fail with NoClassDefFoundError exception
R2024-01
New features in R2024-01
- TDI-45647 - Facilitate OData service consumption
- TDI-45919 - Connect to Salesforce via JWT with Mutual auth
- TDI-45778 - Update MongoDB and DocumentDB components.
- TDI-40295 - Enable S3 object tagging
- TBD-15555 - Implement "UserAgent" tags for Databricks Runtime
- TBD-15753 - Schema and partition evolution in tIcerbergTable
- TBD-15756 - tIcebergMerge DI component
- TUP-41010 - Remove deprecated version 3 of Cassandra
- TUP-38986 - Deprecate the import connections from CSV
- TUP-36992 - Set max-width for Context column in Studio
- TUP-41390 - New TCK component studio feature (odata)
- TUP-32134 - Minor improvements on the Component/Subjob copy and paste capabilities of Studio
- TUP-41073 - Block the update if studio is not compatible
CVEs fixed in R2024-01
CVE-2023-34453,CVE-2023-34454,CVE-2023-34455,CVE-2023-43642 (org.xerial.snappy:snappy-java,1.0.5,1.1.8.2,1.1.10.1), impacted:
BD components
Studio
DQ Libraries
DQ components
DI components
CVE-2023-44981 (org.apache.zookeeper:zookeeper:3.6.2) impacted:
DQ Libraries
CVE-2023-2976,CVE-2020-8908 (com.google.guava:guava:30.1.*,27.0-jre), impacted:
BD components
CVE-2019-7614 (org.elasticsearch:elasticsearch:5.6.3), impacted:
BD components
CVE-2021-42550 (logback-classic-1.2.3.jar), impacted:
BD components
(None) (netty-handler:4.1.100.Final), impacted:
APPINT components
CVE-2023-33201 (bcprov-jdk15on:1.70), impacted:
APPINT components
Studio
DI components
CVE-2023-35887 (sshd-sftp:2.9.2), impacted:
DI components
CVE-2023-46120 (amqp-client:5.16.0), impacted:
DI components
CCVE-2013-2160 (woodstox-core-asl:4.0.8), impacted:
DI components
CVE-2023-44487 (netty-codec-http2:4.1.86.Final,4.1.97.Final), impacted:
Studio
DI components
Other issues fixed in R2024-01
- TDI-50570 - [TCK][GoogleAnlytics]The UI problems related with Google Analytics Metadata after adding a read timeout in the advanced setting
- TDI-50604 - varbinary is inserted as incorrect value when using data type "byte[]" in parallel execution
- TDI-50634 - Connectors configuration can't contain null values
- TDI-50665 - Align com.ibm.mq.allclient in tMomXX components with tck connector
- TDI-50691 - tMom components has a typo in Notice
- TDI-50700 - HttpClient PATCH method doesn't work with java17
- TDI-50595 - [TCK JDBC STUDIO]: memory&thread leak if create jdbc connection&close action in loop quickly by tjdbc components
- TDI-50563 - tHTTPClient - failing reading payload as Text because of 'null': <empty payload>
- TUP-41020 - LDAP Metadata : Check Authentication fails when Encryption method = LDAPS(SSL) even with correct credentials.
- TUP-41250 - detectCVE: cve record for "tHDFSOutput org.bouncycastle:bcprov-jdk15on" cannot be detected if workspace contains many projects
- TUP-41133 - Display row number displayed as 0 after click some buttons in schema of tDBOutput
- TUP-41055 - Row number displayed not well on the Edit schema popup on windows
- TUP-41062 - TCK server is unavailable after doing some actions of TCK metadata
- TUP-41183 - "Can't find the jdbc driver class" pop up when check jdbc connection with context mode migrated from 73
- TUP-41243 - workday: value for "X509 certificate" is editable after export to context
- TUP-40887 - Mac Sonoma issue with image flipped
- TUP-41391 - Always pop up workspace has been changed when start studio
- TUP-40364 - TCK Drag&Drop dataset keep only last element of List property
- TUP-40985 - The table column in tFixflowInput is editable but can't save the changes
- TUP-41081 - Pendo: Track usage of Share mode in Talend 8
- TUP-41082 - Pendo: Track projects with Java 17 enabled
- TUP-41106 - Track shared mode with data collector
- TUP-40092 - Uncommitted changes available on all branches
- TUP-41323 - can't create Box/Boxlist from the folder node
- TUP-41299 - Cannot connect to Oracle with patch R2023-11
- TUP-41235 - context parameter not popup when click Guess schema for tJDBCInput
- TUP-41008 - Fix potential problem that create TCK virtual component may use wrong component id.
- TUP-41009 - Job miss mapping file value for tjdbcoutput component after do migrate by import existing project.
- TUP-40457 - Errors in CommandLine log file
- TUP-38087 - tELTPostgresqlMap generate sql fail when input table with expression and the expression include globalMap
- TUP-40871 - Import dependencies will not calculate the context dependent for db connection
- TUP-41256 - Update jars linked to EDI component
- TUP-41242 - Clean up the call of studio registration service
- TUP-41155 - Multiple(Repeating) record about the same CVE fix in detect CVE report
- TUP-41511 - TMC: Token expired warning shows if connection timed out
- TUP-40916 - Studio issues if Java version is > Java 17
- TBD-15703 - Spark parameters aren't applied in Spark Configuration after dragging HDFS Metadata to the job as tHDFSConfiguration
- TBD-15719 - Runtime exception on Spark job with Delimited/tMap components
- TBD-15879 - NoSuchFieldError: when spark streaming job use tSQLRow with CDP7 buildin
- TBD-15888 - Customer is not able to connect/pull from Hive due to possible Metastore Issue
- TBD-15889 - Error using tDataMasking
- TBD-15935 - remove ElasticSearch 5.6 from Streaming jobs (8.0.1 Studio)
- TBD-15941 - tWriteJson component not grouping correctly in Bigdata jobs
- TBD-15943 - Compile error "log cannot be resolved" when set "Partition by table regions" in tHBaseInput and disable log4j
- TBD-15955 - Cleanup CDH Dynamic distribution with org.talend.libraries
- TBD-15957 - tHiveInput tHiveOutput Date Type format changed to "yyyy-MM-dd HH:MM:ss" " "yyyy-MM-dd" falsely after migration from v7.2 to V8
- TDM-10132 - REST API should be selected when double click
- TDM-10487 - improve warning message for thmap (IDocs)
- TDM-10492 - Remove XML DTD Importer
- TDM-10525 - NPE when importing xml file
- TDM-10529 - Reduce size of certain TDM Studio plugins
- APPINT-36163 - Header fhir+json not returning response header in tRestClient and tHTTPClient
- APPINT-36075 - Pop up error window in route list when build as microservice
- APPINT-35967 - Fix small issues for cKafka parameters tooltips
- APPINT-36211 - Missing java options with JDK 17 (tRESTClient and tWriteJSONField)
- TDQ-21673 - PDF report: Fixed the issue causing wrong content in the PDF report after modifying the columns
- TDQ-21546 - Fixed the issue when profiling using a Java engine
- TDQ-21628 - tDataQualityRules: Fixed the issue preventing from running a Job when connecting to Hybrid Talend Data Stewardship
- TDQ-21669 - 'Alert to threshold violation' Job: Fixed the error when the data mart is a context
- TDQ-21713 - Remote project in Git with Data Quality: Fixed the issue causing errors in the log
- TDQ-21717 - Fixed the issue causing .Work_MapDB/jobApplication to be uploaded to the Git server
- TDQ-20838 - tQASAddressIncomplete, tQASAddressUnknown, and tQASAddressVerified are removed from 8.0 R2024-01 onwards
- TDQ-21652 - Replaced hibernate-3.2-patched-1.8 JAR file by an official JAR file
- TDQ-21668 - 'Alert to threshold violation' Job: Fixed the generated job from using Snowflake as a data mart with Java 17
- TDQ-21672 - Time Correlation Analysis: Fixed the issue causing errors in logs when using DATETIME column on MySQL
- TDQ-21674 - tAddressRowCloud: Fixed the issue of downloading JAR files and different MVN paths
- TDQ-21542 - tMatchModel with Java 17: Fixed the issue causing the Job to fail when Generate feature importance report is checked
- TDQ-21671 - Evolution report from Talend Cloud Management Console: Fixed the issue causing wrong evolution report
R2023-12v3
CVEs fixed in R2023-12v3
None
Other issues fixed in R2023-12v3
- TUP-41341 - Can't use other login mode in Studio 8.0.1 with R2023-12v2 patch applied
R2023-12v2
CVEs fixed in R2023-12v2
None
Other issues fixed in R2023-12v2
- TUP-41291 - Studio broken after R2023-12
R2023-12
New features in R2023-12
- TUP-39181 - Force PAT rotation on Studio login
- TUP-25445 - Tacokit: support context in repository metadata
- TUP-38614 - Feature Request - Drag and Drop from Outline section to more components with table parameters
- TUP-40250 - Cleaning of libraries - Batch 1
- TUP-40560 - Only export simple fields with text controller to context mode on TCK metadata
- TBD-14994 - tHBaseTable : split by regions
- TBD-14995 - tHBaseTable : family parameters
- TBD-15118 - Beta - Universal Spark 3.4 - Databricks support
- TBD-15718 - GA: Universal Spark 3.4 - standalone mode
- TDI-50567 - Remove deprecated version 3 of Cassandra
CVEs fixed in R2023-12
CVE-2023-46604 (activemq-client 5.17.2), impacted:
DI components
CVE-2023-5072 (Json:20230227), impacted:
APPINT components
DQ components
Studio
DI components
CVE-2015-7501 (net.sourceforge.collections:collections-generic 4.01), impacted:
Studio
CVE-2023-36478, CVE-2023-40167, CVE-2023-36479 (http2-hpack, jetty-http, jetty-servlets:9.4.51.v20230217), impacted:
APPINT components
CVE-2023-39410 (avro:1.8.1, 1.10.2, 1.11.1, 1.11.2), impacted:
APPINT components
Studio
DQ components
BD components
DI components
CVE-2023-34610 (com.cedarsoftware:json-io 4.13.1-TALEND), impacted:
DQ components
CVE-2023-44483 (xmlsec:2.2.3), impacted:
APPINT components
CVE-2022-46751 (ivy-2.5.2.jar), impacted:
BD components
DI components
CVE-2023-34462 (netty-all-4.1.94.Final.jar) impacted:
BD components
CVE-2019-14887 (org.wildfly.openssl:wildfly-openssl-java:1.0.10.Final), impacted:
BD components
CVE-2023-33201 (bcprov-jdk18on-1.77.jar), impacted:
BD components
CVE-2023-33546 (janino-3.1.10.jar), impacted:
BD components
CVE-2023-44981 (zookeeper:3.6.3), impacted:
DI components
Other issues fixed in R2023-12
- TDI-50386 - validation for "Path to box folder" not check default empty value for Box metadata and component
- TDI-50416 - tDataPrepRun consumes some FATALs
- TDI-50539 - Wrong MVN URI setup for jar: advancedPersistentLookupLib
- TDI-49793 - tMap doesn't close temp files input streams when lookup model reload at each row
- TDI-50584 - Support merge line output for TCK connectors
- TDI-49615 - HTTPClient - Bump to Data Shaping Language v1.10.0
- TDI-50494 - Revert CDC deprecation
- TDI-50381 - Update jars linked to EDI component
- TDI-50421 - tSambaList not showing files but says successful
- TDI-49983 - HTTPClient - Variable $i1 already used
- TDI-50544 - tfilefetch timeout not respected
- TDI-50557 - [Vertica]JDBC Not all parameters have been populated.
- TUP-40419 - Default branch name displayed for empty repository incorrect
- TUP-40584 - [bug] data viewer on tjdbcoutput component failed.
- TUP-29006 - The attached db connection file can be imported as new each time
- TUP-40546 - cmdline mavenusersettings.xml modified when maven (mvn) called without -Dtalend.studio.p2.base
- TUP-40770 - hide tck tjdbcoutputbulkexec/tjdbcoutputbulk/tjdbcbulkexec as they only for tsinglestorexxx
- TUP-40701 - [bug] the directory structure display incorrect after delete to recycle bin
- TUP-40462 - [8.0.1] GIT project : can't switch between branches
- TUP-41003 - Cannot logon Project if label in TAC is different with label in talend.project
- TUP-40659 - [BD/Spark] Wrong jar list when send jars to the cluster
- TUP-40987 - [TCK][GoogleAnlytics]The UI problems related with Google Analytics Metadata after adding a read timeout in the advanced setting
- TUP-40531 - Studio cannot be upgraded from R2023-09 to R2023-10 if upgrade to R2023-09 with parameter "-Dtalend.studio.p2.profileOS.check=false" in Ubuntu
- TUP-40721 - SAP Context issue - Additional Properties
- TUP-40479 - [bug] proxy not working when guess schema and not fill http
- TUP-40723 - "Specify a data source alias" and "Use or register a shared db connection" is disabled after d&d jdbc into job
- TUP-40771 - Remove plugin org.talend.studio.components.tcompv0.jdbc
- TUP-40869 - Import items throw error: id should not be null.
- TUP-40895 - Can't refresh UI when switch proxy type
- TUP-41047 - [TCK] Problems on the Reject line working in the non-flow way
- TUP-40702 - TCK Migration map misses TABLE
- TUP-41134 - MVN url for some JDBC connection add -SNAPSHOT after migration to R2023-11
- TUP-41144 - Unknown dbmsId: 'null' "show when open component tDBInput with jdbc db2 migrated from 73
- TUP-40738 - Implicit tContextLoad do not show Password as context mode
- TUP-40481 - commandline can't connect to the proxy defined on maven jvm.arguments
- TUP-40960 - Talend Studio "switches" automatically to Local Branch after Restart
- TUP-41154 - TcompV0 metadata refresh issue when only parts feature installed
- TUP-41147 - context value for Drivers can't revert back
- TUP-40855 - Revert the deprecate for Studio CDC for metadata
- TUP-41249 - It always give message like "token more than 60 days" if token generated 1 days ago
- TDQ-21558 - Analyzed and updated MVN path
- TDQ-21625 - Fixed issues on TCK JDBC
- TDQ-21632 - tFindRegexlibExpressions: Removed the urlpath of jaxen-1.1.6.jar
- TDQ-21425 - Match analysis: Fixed the issue causing an error when running with a file connection
- TDQ-21453 - Fixed the issue causing wrong graphs in a PDF report
- TDQ-21481 - Overview analysis: Fixed the NPE error when expanding the analyzed element
- TDQ-21496 - Improved the export of items by including setting files
- TDQ-21529 - Fixed the NPE issue when generating ThresholdViolationAlert of all type DB data marts
- TDQ-21633 - tMySQL(In)validRows/tAmazonAurora(In)validRows: Removed Mysql 4
- TDM-10265 - Upgrade Camel from 3.11.1 to 3.20.6
- TDM-10451 - Used by dialog of structure don't include DSQL map
- TDM-10457 - got npe when the input csv file doesnt exist
- TDM-10475 - Issue in reading decimal values from a packed decimal column in EBCDIC file
- TDM-10505 - Upgrade avro to 1.11.3
- TDM-10509 - [DSQL Map Editor] NPE when editing empty array syntax to a loop output element
- TDM-10534 - Editor can't display after generate dsql for map which run with fatal
- TBD-14169 - NoSuchMethodError when run a spark batch job with spark universal 3.1.x Dataproc
- TBD-15368 - Enhance talend-bigdata-core libs management
- TBD-15831 - Runtime exception on Spark job with ElasticSearch components with Spark Universal 3.0
- TBD-15852 - CDP 7.1.7 - tImpalaInput - TTransportException and tImpalaConnection - NullPointerException
- TBD-15854 - IllegalArgumentException for tFileInputDelimited with tAzureFSConfiguration in rdd
- TBD-15861 - IOdelimitedcsv_RowSeparator tuj failiing
- TBD-15871 - Wrong jar list when send jars to the cluster
- TBD-15876 - tHiveLoad with Parquet format generates compile error "libjarstHiveLoad1 cannot be resolved"
- TBD-15877 - Runtime exception on Spark job with Delimited components using tAzureFSConfiguration
- TBD-15882 - URISyntaxException for tFileInputDelimited with tAzureFSConfiguration + AAD in rdd
- TBD-15886 - Unable to set Yarn Resources Allocation to Dynamic in Universal Distribution.
- TBD-15890 - with tImpalaConnection -> Impala Driver dropdown value "Impala" is missing for Universal Spark 3.2
- APPINT-35989 - Focus lost when editing jobs
- APPINT-35991 - Change the GAV of camel-shape libraries to improve CVE detection
- APPINT-35996 - "Setup custom scripts by folder" does not work in Studio for a Route folder
- APPINT-36010 - Issue with tRESTRequest when drag and drop API using components in Studio
- APPINT-36034 - Wrong version of security-common/sam-agent included during CI
R2023-11
New features in R2023-11
- TUP-34934 - Add possibility to sync the activated/installed feature to other branches before switching.
- TUP-36963 - Display Row Number in Schema View
- TUP-40311 - [Refactor] Unify tPostgresPlus component to reuse tPostgres
- TUP-36082 - DetectCVE in Studio
- TUP-35448 - Make JDBC components available in studio with the TCK framework
- TDI-49947 - Add read timeout in Google Analytics
- TDI-50282 - [Refactor] Unify tPostgresPlus component to reuse tPostgres
- TDI-49775 - Allow for authentication via Application Default Credentials and a user-managed service account (Google Cloud Platform)
- TDI-49973 - New option to compute string length in bytes in tSchemaComplianceCheck
- TDI-48421 - JDBC - TCK in studio - GA
- TDM-6501 - Add Option to set Map group type and auto generate entry/key/value
- TDM-10459 - Update TDM maplang libraries to new version 1.11.0
- TBD-15690 - tIcebergTable DI component
- TBD-15593 - tIcebergRow DI component
- TBD-15757 - GA - Universal Spark for CDP Private Cloud Base 7.1.8 on Spark 3
- TDQ-21221 - Support for JDBC TCK connection - Connection
- TDQ-21223 - Support for JDBC TCK connection - Analysis/Repor
CVEs fixed in R2023-11
CVE-2023-43642 (org.xerial.snappy:snappy-java 1.1.10.1), impacted:
APPINT components
CVE-2022-33980 (commons-configuration2:2.7), impacted:
APPINT components
CVE-2023-44487 (tomcat-embed-core:9.0.79, io.netty:netty-codec-http2:4.1.94.Final), impacted:
APPINT components
CVE-2022-45688 (org.json:json:20201115), impacted:
APPINT components
CVE-2023-44981 (org.apache.zookeeper:zookeeper:3.5.9), impacted:
APPINT components
CVE-2023-46604 (activemq-client,activemq-openwire-legacy:5.17.4), impacted:
APPINT components
CVE-2021-46877 (jackson-databind:2.11.3), impacted:
APPINT components
(netty-handler:4.1.94.Final), impacted:
APPINT components
Studio
CVE-2023-34610 (json-io:4.9.9) impacted:
DI components
Studio
CVE-2023-2976 (guava-30.1-jre.jar), impacted:
BD components
CVE-2023-3635 (okio:1.6.0) impacted:
BD components
CVE-2020-25649 (jackson-databind-2.10.2.jar), impacted:
BD components
CVE-2021-29425 (commons-io-2.4.jar), impacted:
BD components
CVE-2023-22946 (spark-core:3.3.1), impacted:
BD components
DQ Libraries
CVE-2023-31418 (elasticsearch:7.17.1) impacted:
Studio
CVE-2023-26048 (jetty-util:9.4.51.v20230217) impacted:
DI components
CVE-2023-34462 (netty-handler:4.1.86.Final) impacted:
DI components
CVE-2023-44487,CVE-2023-45648 (tomcat-coyote:9.0.80) impacted:
DI components
CVE-2014-125087 (java-xmlbuilder:0.4) impacted:
DI components
Other issues fixed in R2023-11
- TDI-50347 - Performance issues with tPOP and Microsoft Exchange
- TDI-50348 - tFileInputExcel NB_LINE returns null instead of 0 for empty sheets
- TDI-50353 - tDataPrepRun component doesn't accept global variables for field "Preparation Version"
- TDI-50358 - File mask for tGSPut cannot handle file name containing parenthesis
- TDI-50385 - "Report to use when checking connection" field should be removed from component advanced settings
- TDI-50379 - BQ job fails with VerifyError (Inconsistent stackmap frames)
- TDI-50417 - tSalesforceOutput Info logging incorrect and excessive logging
- TDI-50296 - [Studio 8.0.1]tFTPPut component file renaming regression : no more renaming upon upload completion
- TDI-50291 - Requirement for tCyberArk component to have output link exposes secret in TRACE debugging
- TDI-50335 - Dynamic column mode to get sybase data not works for tinyint iwith sybase ase Adaptive Server Enterprise/16.0 SP03 PL14
- TDI-50317 - tFileInputPositional don't parse properly when pattern units field is set to Symbols
- TDI-50396 - [8.0.1] Error occurred when request microservice with trestrequest+thttpclient for the first time
- APPINT-35965 - Build route as snapshot failed in Linux/Mac OS
- TUP-39867 - [tOracleInput]Studio 8.0.1 with R2023-05 version in Guess option
- TUP-40432 - Performance issue when commit on GIT project
- TUP-40478 - Studio 8.0.1 R2023-07 ESB can't build job if git mode is set to standard
- TUP-40637 - The Java 17 compatibility notification should not show when studio logon a new project with Java 17 in Mac
- TUP-40730 - Talend-Studio-20231017_1026-V8.0.1-R2023-10 can't connect TAC at load license page
- TUP-40722 - Add module access for Spark 3.4.x and 3.0.x
- TUP-39841 - the changes in the user information on TMC are not reflected in Studio
- TUP-40295 - Testcases with resource contexts fail when building job in Studio
- TUP-40439 - In the ".sysConfig" of "support logs" that gather "nexus.password" value is plain text
- TUP-40232 - tJDBCInput(Delta Lake) doesn't support "Guess Schema", and load Query Item Window
- TUP-40742 - old job with stats&logs/Implicit context can't run with java 17 after migration
- TUP-40765 - detectCVE: componentIndex and dependency jar isn't correct if two component with same name exist in studio
- TUP-40317 - Metadata based Hadoop cluster Repository type is showing inconsistent grey out UI for Runtime mode.
- TUP-40856 - Build Docker image fail
- TUP-40858 - Check connection for cassandra pop up missing some jars netty-*-4.1.86.Final.jar which can't be downloaded
- TDM-10415 - Date cannot be viewed in the Map
- TDM-10389 - Mapping cannot work in Talend 8
- TDM-10454 - [TDM 8.0.1] problem with Time type using thmap in function ExtractfromDateType
- TDM-10501 - performance issue when reading a 2M big file
- TDM-10092 - json pretty format not work as expected when mandatory element is 'null'
- TDM-10188 - Update database importer in order to handle new JDBC importer
- TDM-10440 - Show difference from Inheritence generate np in new added fileds
- TDM-10441 - [Standard Map] Test run with "Failed to write output data error" when output is json
- TDM-10450 - ClassCastException when open mapValues properties
- TDM-10455 - get empty result when show document in a new project after importing a JSON file at first time
- TDM-10467 - JSON Writer not handling invisible arrays of choices correctly
- TDM-10480 - Update Saxon PE license
- TDM-10495 - Batch job with joblet run fail with 'Failed to generate code'
- TDM-10498 - databaselookup with mysql5 throw npe
- TDM-10499 - show view-> DSQL is not shown correctly
- TBD-15230 - NullPointerException when spark batch joblet use tFileInputDelimited
- TBD-15423 - Runtime exception on simple Spark job using CDP 7.X distribution on CDP 7.1.3 cluster in Yarn Client mode
- TBD-15665 - ClassCastException when I run DI job with bigdata components using java11
- TBD-15687 - Simple Spark job with EMR 5.29 (distribution or via Universal) is failing
- TBD-15708 - Compile error on DI job with Hive* components with Spark Universal 3.4
- TBD-15764 - tElasticSearch components don't work on spl24, spl30, spl31
- TBD-15766 - It's not possible to create CDH dynamic distribution for 6.1.1 version
- TBD-15767 - Spark local job unable to pickup the local keystore file
- TBD-15768 - "Define a storage configuration component" is available not only for "Files" Dataset mode in tDeltaLakeOutput component
- TBD-15781 - with tImpalaConnection -> Impala Driver dropdown value "Impala" is missing
- TBD-15790 - EMR Serverless Mode missing China regions (Ningxia Beijing)
- TBD-15791 - Dataproc Spark job using tFileInputDelimited throws UnknownHostException
- TBD-15793 - tElasticsearchOutput write json data in wrong way in batch jobs
- TBD-15808 - Map_spl30x tuj fales with exception
- APPINT-35973 - Allow SQL Transaction Support
- APPINT-35963 - Dependency to pax-jdbc-mssql should not be added to route
- APPINT-35995 - Route with tHttpclient failed to run with docker image when build by CI
- APPINT-36017 - Duplicated local variable isResponseCode202 when using 2 tESBConsumer
- TDQ-21520 - DB connections exported from the DI side cannot be imported into studio from the DQ side
- TDQ-21420 - Remove customer-defined routines from 'ConfigMatchGroupData.java'
- TDQ-21422 - UI: Improve tDataEncrypt/tDataDecrypt UI for '256-bit key'
- TDQ-21509 - Reporting: Fixed the error occurring when the project description is longer than 200
- TDQ-21512 - Change 'org.talend.libraries' to 'org.talend.components.XXX' in some components
- TDQ-21215 - Performance: Reduction of the time it takes to finish JDBC(Informix) creation wizard
R2023-10
New features in R2023-10
- TUP-33474 - Enable SSL support for Oracle 18 - Metadata
- TUP-34865 - Update jar on Mongo components to support latest version (currently 6)
- TUP-40401 - Enable Java 17 support
- TUP-38887 - Upgrade the default JDK setting when build Docker image
- TUP-39889 - tJira and tSplunk migration to TCK
- TUP-38803 - [tELTPostgresMap7.3.1]The fields are not separated by comma when adding a group clause by in component tELTPostgresMap
- TUP-40373 - Update license agreement with the Qlik one
- TUP-39537 - Studio : improvement of studio collected logs
- TUP-38526 - Feature Request - Ubuntu22 compatibility for Studio
- TUP-40269 - Support Nexus version 3.60
- TUP-40267 - Shared studio support on Studio 8.0
- TDI-49079 - tWorkdayInput - WS - Filter by Criteria
- TDI-49606 - Secure the execution of children job as independent
- TDI-49957 - Rewrite tcompv0 jira component with tck/httpclient
- TDI-49883 - Rewrite tSplunk with Tck
- TDI-47851 - Update jar on Mongo components to support latest version (currently 6)
- TDI-46913 - Enable SSL support for Oracle 18 - tOracleConnection
- TDI-50142 - Integrate in Studio tJIRA/tSplunk/TCK component
- TBD-15586 - Create tIceberg family for DI
- TBD-15565 - Universal Spark for CDP Private Cloud Base 7.1.8 on Spark 3
- TBD-15409 - Beta - Universal Spark 3.4 - standalone mode
- TBD-15580 - Cleanup elasticsearch 5.6.x and 6.4.x in batch and streaming jobs
- TDM-10397 - DSQL-based Map Editor and Runtime [BETA]
- TDM-10398 - DSQL Script generator for Standard Maps [BETA]
- TDQ-21329 - DQ Batch components: Support for Spark 3.4 Local mode in Universal
- TDQ-21330 - DQ Streaming components: Support for Spark 3.4 Local mode in Universal
- TDQ-21334 - SSL support enabled for Metadata Oracle 18 Custom
- TDQ-21471 - Context view: UI improvements
- APPINT-35210 - Document Confluent Kafka with schema registry usage with routes
CVEs fixed in R2023-10
CVE-2023-33546 (janino:2.7.6), impacted:
DI components
APPINT components
CVE-2023-2976 (guava:30.0-jre), impacted:
DI components
APPINT components
BD components
CVE-2023-28513 (com.ibm.mq.allclient:9.3.3.0), impacted:
DI components
CVE-2023-34462 (netty-handler:4.1.92.Final), impacted:
APPINT components
(spring-core:5.3.21), impacted:
DQ components
Studio
CVE-2023-25194 (org.apache.kafka:kafka-clients:2.8.2), impacted:
BD components
CVE-2021-29425 (commons-io-2.4.jar), impacted:
BD components
CVE-2022-31159 (aws-java-sdk-s3:1.12.170), impacted:
BD components
CVE-2023-34455 (snappy-java-1.1.10.1), impacted:
BD components
CVE-2022-23305 (commons-configuration2:2.8.0) impacted:
DI components
CVE-2010-1330 (jline:1.0) impacted:
Studio
CVE-2022-1471 (snakeyaml:1.32-1.33) impacted:
Studio
Other issues fixed in R2023-10
- TDI-49822 - Improve the mvn path on 'tAdvancedHash'
- TDI-50200 - Improve speed of suggestion action for WorkdayInput
- TDI-49662 - Two issues when config workday account
- TDI-50205 - Unable to read data from column family names having special character '-'
- TDI-50060 - tfileinputpositional's "use existing dynamic" function does not work if tsetdynamicschema with "id_Date" type
- TDI-50233 - Context is giving compilation error for tMongoDBConnection -> Advanced Setting
- TDI-49427 - ServiceNow connector ignores proxy set globally in the job
- TDI-49492 - Upgrade Avro to 1.11.x
- TUP-40066 - Studio update broke my studio installation
- TUP-40303 - under the snowflake metadata, click the table throw the exception
- TUP-35626 - Cannot retrieve module or table when password include "\"
- TUP-38273 - upgrade avro in studio from 1.8.2 to 1.11.2
- TUP-40042 - Async validation action (TCK) doesn't work properly
- TUP-39890 - tLibrary Load Artifact repository Remote Search reports SNAPSHOT - 8.0.1-R2023-10
- TUP-40464 - failed to install patch under java 17
- TUP-40036 - Context name defined in component didn't update after it has been changed in Joblet
- TUP-40299 - "Validation Failed" dialog is missing if Set string into double type text field for Context Variable
- TUP-40332 - Some jar which packaging is bundle can not download normally
- TUP-40251 - Review from current studio-only jars, if some jars are not used anymore
- TBD-15280 - UI issue with tHBASEConnection
- TBD-15521 - Failed to generate code exception when spark streaming job use tS3configuraiton with spark universal32
- TBD-15564 - [Spark Universal Local 3.4] Runtime exception on Spark job with DeltaLake components
- TBD-15566 - Hbase batch and streaming jobs with Universal have failed
- TBD-15575 - Querying Dynamic Schema fails in BD Job
- TBD-15578 - MongoDBInput Component date format mismatch
- TBD-15582 - Compile error on DI job with tELTHive components using Spark Universal 3.4
- TBD-15583 - Runtime exception on Spark Streaming jobs with tPubSub components with Spark Universal 2.4 - 3.4 Local
- TBD-15619 - [8.0.1] CI/Cmdline 2 versions of talend-dataflow-spark-dataset-lib required by build
- TBD-15636 - MongoDBInput component with tCollectAdnCheck have an error
- TBD-15648 - Compile error on Streaming jobs using Spark Universal 3.2 distribution in Standalone Spark mode
- TBD-15656 - ClassNotFoundException when I run di job with impala components using CDP718 as spark universal 33
- TBD-15661 - Import configuration from local files can not worked after selected Synapse distribution
- TBD-15669 - [Streaming, Migration] Compile error on migrated jobs with ElasticSearch components on all Universal versions
- TBD-15686 - Avro job fails when Universal EMR 6.2 distribution is used
- TBD-15695 - Null value in entry error when using Impala connection before hbase or other connection
- TBD-15702 - Studio fails to generate code due to NPE on Spark job with tFileStreamInputDelimited component
- TBD-15704 - Unable to pass values of context variables using Universal Spark in Standalone mode
- TBD-15752 - Studio 8 tHiveLoad not loading the files from stage to Target table in Dataproc
- TBD-15763 - Avro record VM
- TDM-8821 - Mapping:Improve items sorting
- TDM-9098 - Use shortcut ctrl+x in map node get error
- TDM-9750 - Add new function GetContextVariable for standard maps
- TDM-9783 - Accept ConsumerRecord from tKafkaInput for Avro
- TDM-9799 - tHConvertFile cannot be configured
- TDM-9805 - Update TDM to work with TUP-37227 joblet naming
- TDM-9838 - Expand Recursive Elements on XSD Structure is not working properly
- TDM-9844 - Runtime preferences should be mutable using java system properties
- TDM-9921 - Synchronize Map messages appears for each connection when creating joblet
- TDM-9942 - Upgrade from xmlschema 2.2.5 to 2.3.0
- TDM-9954 - Avro sax reader does not support schema of type MAP
- TDM-9957 - NPE selecting sample while creating a structure manually
- TDM-9999 - Upgrade HikariCP to 4.0.3
- TDM-10008 - [Batch Job]Open code view get error when TDM components miss map/structure
- TDM-10012 - Expression on array alternative is not evaluated by readers
- TDM-10073 - [tHMapInput]Job execution fails (caused by order of output connections)
- TDM-10149 - NullPointer Exception when we close an error dialogue in TDM map
- TDM-10156 - NPE while building standard job for the first time
- TDM-10167 - Improve Studio startup time when loading TDM plugins
- TDM-10168 - Import UBL XSD misses recursive relationship
- TDM-10180 - [THMapFile] thmapFile with reject output has missing part of javajet code
- TDM-10190 - Remove XSLT service from lib-di
- TDM-10271 - tHMap - Does not produce empty json array properly
- TDM-10278 - [Random]show document get error sometimes
- TDM-10320 - Show difference from Inheritence generate NullPointerException
- TDM-10336 - Upgrade 8.0.1 to avro 1.11.2
- TDM-10347 - java.lang.NoClassDefFoundError on bigdata when using sample file on Configure component
- TDM-10354 - java.lang.NoClassDefFoundError when configure Signature Parameters
- TDM-10378 - Show document for empty structure get npe
- TDM-10413 - BufferOverflowException raised when reading a very big CSV file
- TDM-10420 - Streaming fails for primitive elements preceding the Streaming loop
- TDM-10424 - transform.streaming.block.count not a valid context variable
- TDM-10429 - [OpenAPI Specifications]Structure create fail when use special json file
- TDQ-21323 - Upgraded crypto-utils/daikon to 7.1.16 and avro to 1.11.2
- TDQ-21398 - Upgraded jackson to 2.14.3
- APPINT-18113 - Removal of deprecated cKafka parameters
- APPINT-35863 - Clean up of the unused MODULE/libraries defined in the plugin.xml files
- APPINT-35106 - Routlet can't be as snapshot when we try to publish a route as snapshot that uses a routlet it fails in CICD
- APPINT-35418 - Refer to wrong route in blueprint.xml when two routes use same routelet and deploy by CI
- APPINT-35122 - Solve CI Build problems when using child jobs and routelets
- APPINT-35812 - Publishing a service as a release try to create twice the release
- APPINT-35838 - [CI] cloud publisher screenshot file issue
- APPINT-35866 - Wrong display for artifact parameters in "Cloud artifact" view
- APPINT-35870 - Unexpected deployment failure if DB component referencing datasource is de-activated
- APPINT-35925 - R2023-08-RT is missing org/apache/camel/model/errorhandler/DefaultErrorHandlerDefinition dependency for cErrorHandler
R2023-09
New features in R2023-09
- TUP-38042 - Improve context view display
- TUP-39758 - Upgrade jdbc drivers for PostgreSQL components, deprecate Pre V9
- TDI-48193 - Enable local file copy on all PostgreSQL bulk components
- TDI-50100 - Use existing connections should be supported by tPostgresqlOutputBulkExec
- TDI-50102 - Upgrade jdbc drivers for PostgreSQL components, deprecate Pre V9
- TDI-50213 - PostgreSQL cloud/DWH: AWS & Azure
- TDQ-21445 - PostgreSQL components: Upgraded JDBC drivers and deprecated versions earlier than version 9
CVEs fixed in R2023-09
CVE-2023-3635 (okio:1.15.0) impacted:
Studio
CVE-2022-23305 (commons-configuration2:2.8.0) impacted:
Studio
CVE-2023-34454 (snappy-java:1.1.1.3) impacted:
Studio
CVE-2023-1370 (json-smart:2.4.7), impacted:
DI components
CVE-2009-1523, CVE-2011-4461 (jetty-util-6.1.26.jar), impacted:
BD components
CVE-2018-10237 (guava-11.0.2.jar,guava-18.0.jar), impacted:
BD components
CVE-2019-2692 (mysql-connector-java-3.1.14.jar), impacted:
BD components
CVE-2022-30126,CVE-2022-30973 (tika-core-2.1.0.jar), impacted:
BD components
CVE-2022-21449 (nimbus-jose-jwt-8.23.jar), impacted:
BD components
CVE-2020-5403 (reactor-netty-0.9.4.RELEASE.jar), impacted:
BD components
CVE-2023-30535 (snowflake-jdbc-3.13.29.jar), impacted:
BD components
CVE-2018-17244,CVE-2019-7614 (elasticsearch-5.6.3.jar,elasticsearch-6.4.2.jar), impacted:
BD components
CVE-2019-0201 (zookeeper-3.4.12.jar), impacted:
BD components
CVE-2020-1926 (hive-service-2.3.7.jar), impacted:
BD components
CVE-2023-34455,CVE-2023-34453,CVE-2023-34454 (1.1.2.6, 1.0.4.1, 1.0.5,1.1.8.4,1.1.1.3), impacted:
DI components
CVE-2022-44729,CVE-2022-44730 (org.apache.xmlgraphics:batik-xxx.jar), impacted:
DQ components
DQ Libraries
CVE-2023-34462 (netty-handler:4.1.90.Final), impacted:
Studio
CVE-2023-34034 (spring-security-config-5.7.8.jar), impacted:
APPINT components
CVE-2022-42889 (commons-text-1.8.jar, commons-text-1.9.jar), impacted:
APPINT components
CVE-2014-125087 (java-xmlbuilder-1.0.jar), impacted:
APPINT components
CVE-2022-25647 (gson-2.7.0.jar, gson-2.8.6.jar), impacted:
APPINT components
CVE-2023-33265 (hazelcast-5.2.1.jar), impacted:
APPINT components
CVE-2021-35517 (commons-compress-1.19.jar), impacted:
APPINT components
CVE-2021-31684 (json-smart-2.3.jar), impacted:
APPINT components
CVE-2022-45688 (json-20200518.jar, json-20220320.jar), impacted:
APPINT components
Other issues fixed in R2023-09
- TDI-50099 - incorrect/unsuitable system logs level displayed in TMC
- TDI-50094 - security issue PostgreSQLInput commits
- TDI-50240 - Codegeneration issue for standalone tck components
- TDI-50218 - tFileInputExcel NPE for specific Excel file
- TDI-50199 - Compilation error when log4j is deactivated
- TUP-36903 - Ubuntu 22.04 ARM 64: Cannot show agreement page correctly
- TUP-37091 - UI problem that "Support NLS" checkbox not show sometime on metadata connection wizard
- TUP-40028 - Update wording in Error and Warning tooltip
- TUP-40082 - [8.0.1 SAP] Column name containing / in input field schema in tSAPBapi changes to _
- TUP-40217 - Update checkbox linked to allow internal
- TUP-39970 - Update notification doesn't close causing multiple popup exist
- TUP-39163 - Cloud Project Branches not removed even when it is deleted in Git repository
- TUP-40058 - [Studio login with Talend cloud] Studio can't access the resource from server
- TDM-10363 - Restore maintenance/8.0 as single source for Studio and ESB runtime
- TBD-15246 - Runtime exception on "Test connection" for Hive DB Metadata for Universal
- TBD-15323 - Inconsistency between names for HDInsight in different parts of Studio
- TBD-15472 - Correct UI element for tCassandraConfiguration
- TBD-15502 - Talend 8 Big Data: Clean/Deprecate End of Support distributions
- TBD-15520 - unresolved dependency: org.apache.spark#spark-avro_2.12;3.3.0 with spark 3.3
- TBD-15522 - Align S3 encryption parameters with AWS terminology
- TBD-15526 - tExtractDelimitedFields Missing Fields In Spark Local Mode
- TBD-15528 - Compilation error in tHbaseOutput DI component with Spark standalone mode
- TBD-15546 - tImpalaConnection - using context variables for login and password properties causes issue with job execution - for non-Kerberos cluster
- TBD-15547 - Incorrect field name for Livy Host name in Metadata wizard for Microsoft HDInsight distribution
- TBD-15560 - Spark batch job fails with NoSuchMethodError
- TBD-15574 - Connection to CDP Public Cloud and Hive/Knox failed
- TBD-15579 - Runtime exception on ElasticSearch components in Spark Batch using Spark Universal Local 2.4 - 3.4
- APPINT-35837 - tRestClient component showing error as "Unknown value in the list (Authentication type)..." after migrating from 6.4 studio
- TDQ-21236 - Semantic analysis: Fixed the error in the Create semantic analysis wizard
- TDQ-21267 - Basic analysis: Fixed the issue causing an NPE when all advanced indicators are selected
- TDQ-21326 - Data mart: Fixed the issue causing a database to be created before creation was confirmed
- TDQ-21423 - Export parser rule: Renamed the wizard
R2023-08
WARNING - BREAKING CHANGES FOR APPLICATION INTEGRATION FEATURES
- This release upgrades core libraries: Apache Camel, CXF, Karaf, and Spring Boot.
- After installation, Data Services Jobs and Routes will only run on Talend Runtime 8.0.1-R2023-08 and later.
- Microservices are not impacted.
- See the online release notes for more information.
New features in R2023-08
- APPINT-34982 - Modern Authentication support for cMail Component
- APPINT-27995 - Camel cWMQ enhancement requests
- TUP-39520 - Deprecate Studio CDC
- TUP-39961 - Set visible to false for tDBCDC and tDBCDCOutput component
- TUP-39065 - Implement secured credential storage in Studio for Nexus credentials
- TUP-39090 - SCD Documentation Issue
- TUP-38945 - Add support of Oracle 19
- TBD-15117 - Spark 3.4 - Local mode in Universal
- TBD-15406 - GA Universal Spark 3.2 for AWS EMR Serverless custom job
- TBD-15413 - GA Universal Spark 3.3 for Google Dataproc 2.1 and onwards (di)
- TBD-15418 - GA for Universal Spark 3.3 for Dataproc 2.1 and onwards (batch)
- TBD-14984 - POC : Part 1 - HPE Datafabric with universal spark
- TDQ-21198 - Oracle: Upgraded the JDBC driver to version 19
- TDI-42055 - tSetDynamicSchema to be reused in tFileInputDelimited
- TDI-45063 - Request for dedicated metadata configuration wizard for Google BigQuery
- TDI-49788 - Upgrade the Oracle JDBC driver to the latest LTS version(19c)
- TDI-50074 - Deprecate all CDC components
CVEs fixed in R2023-08
CVE-2017-1000487 (plexus-utils-3.0.8) impacted:
Studio
CVE-2023-34610 (json-io:4.9.9) impacted:
Studio
CVE-2012-5783 (commons-httpclient:3.1) impacted:
Studio
CVE-2023-37460 (plexus-archiver:4.2.2,4.2.1,4.2.0,3.6.0) impacted:
Studio
APPINT components
CVE-2020-8908,CVE-2023-2976 (guava:30.0-jre) impacted:
Studio
DQ Libraries
CVE-2022-31777 (spark-core_2.12-3.3.0.jar), impacted:
BD components
CVE-2014-3577 (httpclient-4.0.1.jar), impacted:
BD components
CVE-2020-13956 (org.apache.httpcomponents:httpclient:4.5.12), impacted:
BD components
CVE-2021-29425 (hadoop-core-1.2.1.jar), impacted:
BD components
CVE-2023-34455,CVE-2023-34453,CVE-2023-34454 (snappy-java:1.1.7.3), impacted:
APPINT components
CVE-2023-1370 (json-smart:2.4.7), impacted:
APPINT components
CVE-2023-33201 (bcprov-jdk15on:1.69), impacted:
APPINT components
CVE-2023-25194 (kafka-clients:3.2.3), impacted:
DI components
Other issues fixed in R2023-08
- TUP-39563 - [7.3.1][DI]Issue while using DBBulk components for snowflake in Joblets
- TUP-38732 - httpclient and box features not displayed in feature manager when installed patch with patches folder
- TUP-39276 - deploying a specific .car component in studio 8 brings a lot of StackOverFlowError
- TUP-39281 - Renaming the default branch from master to main
- TUP-39582 - Filter differences in tmap not showing up in the job compare tool
- TUP-39382 - Git Sync issues (java.lang.IllegalArgumentException: Attempted to beginRule: MultiRule[], does not match outer scope rule) still an issue
- TUP-39759 - Perspective getting reset all the time when toggling between old and new projects in the same workspace
- TUP-39726 - Throw ResourceNotFoundException error in erro log when start studio
- TUP-39721 - Studio hangs while sending/running job to remote engine
- TUP-39333 - [8.0.1] random error The project '' is not found
- TDI-50008 - Box async validation throws NPE
- TDI-49975 - tHttpClient component is corrupting the MS excel/word files
- TDI-49933 - Issues extracting date values from TIME(9) and TIMESTAMP_NTZ
- TDI-50071 - tFileInputMail is unable to parse correctly utf8 subject with
- TDI-50086 - Compilation error on tFTPFileProperties
- TDI-50076 - Header doesn't work in tFileInputDelimited with "Use existing dynamic".
- TDI-49874 - [Security]: disable xmlreader feature
- APPINT-35705 - Compile error in cMQConnectionFactory with MQTT and SSL enabled
- APPINT-35729 - java.lang.IllegalStateException: XMLList error when the service is deployed to the Runtime
- APPINT-35747 - tHttpClient called from a route deployed in Runtime doesn't work
- APPINT-35753 - Two versions of guava exist in job's pom file for tRESTRequest
- APPINT-35668 - tRESTClient error of Ljava/lang/Object in R2023-05, zulu11.58.23-ca-jdk11.0.16.1
- APPINT-35473 - Remove the stopOnAggregateException option from cMulticast
- APPINT-34691 - cMessagingEndpoint doesn't support camel-jira anymore
- APPINT-35416 - Add relevant messages in "Project analysis report" to warn about 3.20 removed components
- APPINT-33989 - [Camel 3] camel-kafka - JMX MBean InstanceAlreadyExistsException thrown
- TDQ-21279 - tMatchGroup: Fixed the issue that prevented from processing all records when the Store on Disk option is selected
- TDQ-21276 - tMatchGroup: Fixed the issue that caused the error java.lang.Error: Unresolved Compilation Problems
- TDQ-21320 - Removed the Export for Talend Exchange option from the menu
- TDQ-21325 - Data mart: Fixed the issue that caused unauthorized users to connect to a database
- TBD-15025 - [Azure Synapse Metadata wizard] "Client certificate" field isn't hidden after switching authentication mode from "Azure Active Directory" to "Secret key"
- TBD-15044 - Compile error on DynamoDB components with DBR 6.4 and 5.5
- TBD-15235 - Compile error / runtime exception on Spark job with HWC components
- TBD-15330 - tImpalaConnection - throws error - java.lang.NoClassDefFoundError: org/apache/hive/service/cli/thrift/TCLIService$Client
- TBD-15489 - hadoop-yarn-common-3.1.1.7.1.1.0-565.jar flagged as malware in Reserve Bank of India
- TBD-15503 - wrong jar name for bcprovjdk15on160jar
R2023-07
New features in R2023-07
- TUP-38946 - Add support of Vertica 12 and deprecated Vertica 9.X
- TUP-39162 - Integrate New PGP connector
- TUP-38391 - Help menu revamp - Planning
- TUP-38947 - Upgrade MariaDB driver to latest
- TUP-39291 - Remove Talend Exchange link from Studio
- TUP-39296 - Foreign/External tables are not listed when doing a retrieve schema in metadata connection
- APPINT-35447 - Requesting the PATCH http method to be added in cRest & cHTTP components
- APPINT-35709 - Support PATCH method for cHTTP component
- APPINT-35710 - Support missing methods for cREST component (PATCH and more)
- TBD-14991 - tHBaseTable : delete and create hbase table
- TBD-14992 - tHBaseNamespace : specify namespace
- TBD-14997 - Beta - Universal Spark 3.2 for AWS EMR Serverless for Spark runtime - CUSTOM submission
- TBD-15259 - Beta Universal Spark 3.3 for Google Dataproc 2.1 and onwards (Batch)
- TDQ-21132 - Data mart: Support for MySQL clusters with Group Replication
- TDQ-21251 - Database profiling: Support for PostgreSQL Foreign tables and Amazon Redshift External
- TDQ-21199 - MariaDB driver: Upgraded to 3.1.4
- TDQ-21200 - Database profiling: Support for Vertica 12 and depreciation of Vertica 9.X
- TDI-49743 - SQS Component not accepting Token for an AWS federated user
- TDI-49991 - Deprecate AS400 CDC / RUNCDC
- TDI-42592 - New Studio component: tPGPEncrypt/PGPDecrypt
- TDI-49789 - Add support of Vertica 12 and deprecated Vertica 9.X
- TDI-49790 - Upgrade MariaDB driver to latest for Studio
- TDI-49800 - Leading Spaces are getting trimmed in SAP teltsapinut or teltsapmap components
- TDI-44693 - Support all possible Public Key Algorithms for the SSH Server
CVEs fixed in R2023-07
CVE-2022-29599 (maven-shared-utils:0.9.0) impacted:
Studio
CVE-2023-25194 (org.apache.kafka:kafka-clients:3.1.2,3.2.3), impacted:
APPINT components
CVE-2021-4178 (kubernetes-client-5.4.1.jar), impacted:
BD components
CVE-2009-4611 (jetty-6.1.26.jar), impacted:
BD components
CVE-2023-1370 (json-smart-2.4.7.jar), impacted:
BD components
CVE-2021-29425 (commons-io-2.4.jar), impacted:
BD components
CVE-2023-30535 (snowflake-jdbc:3.13.28), impacted:
DI Components
CVE-2023-20860 (spring-webmvc:5.3.26), impacted:
DI Components
Other issues fixed in R2023-07
- TUP-39262 - Unable to save Talend type setup
- TUP-38643 - The custom mvn URI is not valid
- TUP-39233 - Prompted to re-add unused context variables after deleting from job
- TUP-39057 - schema of txxxCatcher component can not be exported
- TUP-38993 - AmazonDocumentDB dataset can't get some values from connection
- TUP-38296 - [TDM]Input connections order changes when refactored to a joblet multiple times with partial components
- TUP-38235 - Job in a project that references other projects load very slowly in Studio
- TUP-37805 - Studio UI showing the wrong job execution message
- TUP-39223 - Bump version of json-smart:2.4.11
- TUP-39239 - [Studio8.0.1]It is not same ordering of the columns between table schema and synonym schema
- TUP-39298 - Duplicate names appear in both SAP table and SAP CDS View
- TUP-39349 - Unchecked the 'CDS View' checkbox when dragging a CDS view without parameters for tSAPTableInput
- TUP-39353 - Sap related components grouped with MDM components
- TUP-39371 - Error dialog shows while logging into old project if update url patch version > studio version
- TUP-39412 - Got pop up error when try to create a new job if close Cloud Artifact view first
- TUP-39463 - Unable to update Hive Metadata connection with context parameters
- TUP-39645 - tMap does not has Talend Functions when import Informatica workflow file
- TUP-38646 - Environment variables values are lost during the job export
- TUP-39398 - "Argument not valid" Error shows in error log after edit Comment in job>Contexts View and press Enter
- TUP-39387 - Wrong title of SAP CDS View page
- TDI-49890 - Migration issue for JAR files from 2023-03 to 2023-04 and 2023-03 to 2023-05
- TDI-49916 - SAPHanaRow additional JDBC property label example is wrong
- TDI-46592 - tAmazonAuroraConnection needs to be modified in every component in the family
- TDI-49936 - tFileOutputProperties do not respect the order pushed
- TDI-50005 - Unable to retrieve schema for tGoogleAnalytics when reset the same value for "Dimensions" or "Metrics"
- TDI-49870 - tAzureADLSGen2Input ignores the CSV header size
- TDI-49934 - tFTPPut component does not throw error when insufficient disk space left at destination
- TDI-49938 - tFTPPut in FTP and FTPS mode doesn't die on Error when ftp user doesn't have write access
- TDI-49783 - [8.0.1] tFileOutputDelimited write dynamic header NPE
- TDI-49710 - MicrosoftCRMInput - AADSTS7000218: The request body must contain the following parameter: 'clientassertion' or 'clientsecret'.
- TDI-49989 - compile error when using the global value in the tSCPFileExists component
- TDI-49865 - Snowflake Row unable to insert data from one table to another
- TDI-49872 - Jobs using tExtractJSONFields fail with net.minidev.json.parser.ParseException
- TDI-50068 - tSCPConnection with public key authentication does not properly handles private key parse
- APPINT-35663 - Wrong comment of Path and Query schema in tRESTRequest
- TBD-15177 - Metadata for Azure Synapse distributions doesn't have tuning parameters and therefore can't be used
- TBD-15216 - TElasticsearch - password is clearly visible in code generatation
- TBD-15242 - Compile error "row1 cannot be resolved to a variable" when tMap inner join with date or timestamp
- TBD-15244 - 'Check Services' button in metadata should not be visible in Synapse
- TBD-15277 - Big Data Batch job erroring out with Cassandra components
- TBD-15290 - The Spark Job source form CSV result null value for few column
- TBD-15313 - "Check Services" button in Hadoop Metadata disappeared for all distributions
- TBD-15322 - tHiveConnection report "NoClassDefFoundError: org/apache/thrift/transport/TTransport" with universal spark2.4
- TBD-15341 - 'Username' and 'password' should not be visible in Impala components when kerberos is used
- TBD-15348 - [Universal] "Runtime mode / environment" value is always switched to "EMR Serverless"
- TBD-15351 - Cloudera CDP 7.x built-in distribution still reference log4j-web-2.10.0.jar library
- TBD-15352 - [8.0.1] Error when tFixedFlowInput is connected to a tManagePartitions component
- TBD-15360 - [8.0.1] Studio run fails to handle the path with white space for libraries
- TBD-15362 - Migrated BD batch job fails with String out of bounds exception
- TBD-15401 - NoClassDefFoundError:com/fasterxml/jackson/module/scala/experimental/ScalaObjectMapper$class when run tuj deltalake_files
- TDQ-20795 - Reports: Fixed the issue causing a wrong time being displayed in execution time columns
- TDQ-21234 - Talend Exchange: Removed from the DQ Repository tree view
- TDQ-21224 - dq-rule-runtime JAR file: Upgraded to a new version and based on latest 'rule-repository'
R2023-06
New features in R2023-06
- TUP-38589 - Managed updates improvements
- TUP-38088 - Cloud Feature Request for "Publish to Cloud" include option to select environment
- TUP-38140 - SAP CDS Views over Talend
- TUP-38922 - Clear old storage of git project
- TUP-31714 - Target execution on Multiple RE with same Remote engine Name on the studio
- TUP-38935 - Add support to AWS (Mysql) Aurora 3.X
- TBD-14993 - tHBaseNamespace: create namespace if not exist
- TBD-14996 - Beta - Universal Spark 3.2 for AWS EMR Serverless for Spark runtime - Simple submission
- TBD-15036 - Beta - Universal Spark 3.1 for HDInsight 5.0
- TBD-15119 - Icerberg table format on Hive engine
- TDQ-21197 - AWS Aurora 3.X with MySQL is supported
- TDQ-21217 - tDataQualityRules: Rules from Talend Cloud Data Inventory are supported
- TDQ-21008 - Profiling perspective: Dark mode is supported
- TDQ-20621 - Analyses: Enhanced the performance of SQL queries
- TDI-45423 - SAP CDS Views over Talend
- TDI-49753 - improve tsetkeystore
- TDI-49786 - Add support to AWS (Mysql) Aurora 3.X
- TDI-49791 - Support latest endpoint in Salesforce
CVEs fixed in R2023-06
CVE-2023-1436 (jettison-1.5.3.jar), impacted:
DI components
CVE-2022-23437 (xercesImpl:2.12.0), impacted:
Studio
CVE-2020-5421 (org.springframework:spring-framework-bom:5.2.7.RELEASE), impacted:
Studio
CVE-2021-35515 (org.apache.commons:commons-compress:1.12), impacted:
metadata
SourceClear Premium (No CVE) (jose4j-0.9.0.jar), impacted:
DI Components
SourceClear Premium (No CVE) (org.apache.maven:maven-core:3.8.6), impacted:
Stuido
CVE-2021-29425 (commons-io-2.4.jar), impacted:
BD components
CVE-2022-31159 / CVE-2022-31159 (aws-java-sdk-bundle 1.11.375 / 1.11.760), impacted:
BD components
CVE-2020-1926 (hive-service-2.1.1), impacted:
BD components
CVE-2022-46364 (cxf related jars), impacted:
MDM components
CVE-2014-3004 (org.codehaus.castor:castor:1.1), impacted:
Studio
CVE-2022-1471 (org.talend.designer.tdqrule), impacted:
Studio
CVE-2022-40152 (com.fasterxml.woodstox:woodstox-core:6.2.6), impacted:
APPINT components
CVE-2022-36033 (org.jsoup:jsoup:1.14.3), impacted:
APPINT components
Other issues fixed in R2023-06
- TDI-49771 - Cell format is not date
- TDI-49856 - SnowflakeOutput create table with dynamic type fail for the length
- TDI-49752 - tMap performance issue after migration to v8.0
- TDI-49665 - tSalesforceInput component is not retrieving deleted records
- TDI-49694 - HTTPClient Output key/Value pairs returns an AvroRecord when Value is not a simple String
- TDI-49706 - Guess Query issue for JDBC mysql 8
- TDI-49718 - SalesForce Connection in joblet can't be used in a job
- TDI-49499 - [8.0.1] CXF version upgrade to 3.5.5
- TDI-49620 - HTTPClient - Remove 'Beta' label
- TDI-48880 - tHSQLDbInput supports Dynamic retrieving in the supportDynamic.txt, while it does not support from Job UI
- TDI-49448 - Metadata for AzureStorage show issue and no container name after D&D to job
- TDI-49794 - HTTPClient - upload file without form fields make a request with Content-Type /
- TDI-49860 - tMicrosoftCrmOutput should manage empty string as null for guid
- TDI-49878 - tAmazonAuroraOutput should use correct dbVersion using existing connection
- TUP-38371 - mvn build always requires "Default" context while running a test case
- TUP-38847 - connection error popup with every change of the update url from Update settings
- TUP-38590 - CI/CD Pipeline generating different code compared to Studio - missing distribution entry in .item
- TUP-38851 - Console in studio doesn't show all the data
- TUP-38912 - Context Parameters is not visible in when using Publisher
- TUP-38994 - Manage AutoIncrements : Autoincrement values in other Data Container are modified
- TUP-38886 - samba can't be deployed
- TUP-38972 - tELTInput component schema switches to Built-in each time tELTMap editor is opened
- TUP-39214 - Cannot cleanup CVE jar that is fixed after install the patch
- TUP-39092 - Studio frozen at start
- TUP-38802 - The background of label "Clean up libraries" in feature manager is white on dark mode
- TUP-31305 - Improve the code to avoid encrypt the password in job everytime
- TUP-35664 - Tck component settings fields alignment
- TDM-10031 - fix CWE-331 related to Random function
- TDM-10078 - JSON writer produces invalid json for mandatory non-nullable choice
- TDM-10159 - DatabaseLookup failing in 8.0.1 due to TDM-9988
- TBD-15018 - CDP 7.x Atlas
- TBD-15070 - [Job Custers] Runtime exception on Spark job with tS3Configuration with Databricks 7.3 distribution
- TBD-15075 - Code error in tHiveWarehouseOutput when used Stream Job with "Enable Hive Partitions"
- TBD-15154 - Issue with running jobs in Azure Synapse distribution
- TBD-15163 - Runtime exception on Spark Streaming job with Redshift components using Universal 2.4
- TBD-15172 - RDD implementation of IOdelimitedmultiCharacterIncludeHeader with reject fails
- TBD-15218 - Compile error when run batchkafkaIOtCollectAndCheck_json
- TBD-15219 - compile error when spark streaming job use tESoutput
- TBD-15228 - NPE with a contextualized Metadata connection in a spark job
- TBD-15229 - Remove usage of commons-httpclient
- TBD-15237 - [7.3.1] For tSqoopImport the Hadoop property setting "yarn.resourcemanager.principal" is overridden by default value
- TBD-15282 - Correct label for HDI
- TBD-15283 - syntax error in logs
- TDQ-21227 - Help menu: UI enhancements
- TDQ-21241 - Reports: Fixed the issue causing the run to fail when using a PostgreSQL datamart
- TDQ-20849 - Enhanced the org.talend.designer.tdqrule plugin
- APPINT-33758 - CI builder : publish with -pl option : unexpected ".kar*" resource is published to nexus
- APPINT-35605 - Authentication checkbox is not ticked on cSQLConnection when dragging DB Connection with authentication
- APPINT-35612 - JDBC URL and Drivers jar of DB Connection under Metadata failed to propagate modifications to routes
- APPINT-35627 - Fail to update DB connection from Metadata for cSQLConnection when click one DB field
- APPINT-35619 - cMQConnectionFactory's AMQP causing ClassNotFoundException: io.netty.channel.unix.UnixChannel
- APPINT-35629 - tRestRequest query parameters get wrong names when importing an API
- APPINT-35636 - Error occurs when importing an api definition and using it in cREST
- APPINT-35660 - Compile error when two AMQP Connections are in same route
- APPINT-35489 - Exception caused by MicroservicePlugin.stop() method
R2023-05
New features in R2023-05
- APPINT-35161 - cSQLConnection to use DB connections from Metadata - Db Connections
- APPINT-35500 - Add drag'n'drop support for DB connections in route editor
- APPINT-35499 - Add API drag'n'drop support for routes
- APPINT-35401 - cSplitter / timeout and context in Talend
- APPINT-34483 - Cleanup message logging in case it is logging the authorization header
- TBD-15065 - GA: Universal Spark 3.3 and 3.2 for Azure Synapse Spark pools
- TBD-14703 - Support ElasticSearch 7 & 8 in spark batch
- TBD-14704 - Deprecate ElasticSearch 5.6.x and 6.4.x
- TBD-14917 - tMongoDBConfiguration is not support connection string:mongodb+srv
- TBD-14941 - GA - Support MongoDB v4+ - Spark Streaming 3.1+
- TUP-37528 - Support Nexus version 3.42
- TUP-33943 - Allow pushing to remote Git repository while local has uncommitted changes
- TDQ-21191 - DataMasking routine: Added back createMD5 for migration purpose
- TDI-49110 - tSAPTableInput - using dynamic schema throws error for invalid date values
- TDI-49349 - extend tGoogleStorage and tBigQuery Components for Google Private Service Connect
- TDI-45302 - Upgrade Delta Lake connectivity - 0.7.0
- TDI-47942 - httpclient - Upload/download files
- TDI-48358 - httpclient - Pagination support - offset/limit
CVEs fixed in R2023-05
CVE-2023-1370 (json-smart-2.4.7.jar), impacted:
Studio
DI components
DQ Libraries
CVE-2020-11987 (batik-all:1.10.jar), impacted:
DQ Components
CVE-2023-20861,CVE-2023-20863 (spring-expression:5.3.20), impacted:
APPINT components
CVE-2023-1436 (jettison:1.5.3), impacted:
APPINT components
CVE-2021-37533 (commons-net-3.6.0.jar), impacted:
BD components
CVE-2022-45688 (json-20140107.jar, json-20090211.jar), impacted:
BD components
DI components
CVE-2020-7692(google-oauth-client-1.30.1.jar), impacted:
BD components
CVE-2022-46363 (cxf-rt-transports-http-3.4.7.jar), impacted:
BD components
CVE-2020-28491(jackson-dataformat-cbor 2.10.1), impacted:
BD components
CVE-2020-36518 (jackson-databind:2.12.7.1), impacted:
BD components
CVE-2015-2156 (netty-3.6.2.Final), impacted:
BD components
CVE-2019-14893 (jackson-databind-2.6.7), impacted:
BD components
CVE-2022-42003,CVE-2022-42004 (jackson-databind-2.11.4.jar), impacted:
DQ Libraries
DQ components
CVE-2021-36373,CVE-2021-36374 (ant:1.10.9), impacted:
DQ Libraries
CVE-2022-23437 (xercesImpl:2.12.0), impacted:
DQ Libraries
CVE-2023-26048 (jetty-server:11.0.11), impacted:
DQ Libraries
CVE-2023-30535 (snowflake-jdbc:3.13.8), impacted:
Studio
CVE-2020-8908 (guava:10.0.1), impacted:
Studio
CVE-2020-13956 (org.apache.httpcomponents:httpclient:4.5.10), impacted:
Studio
CVE-2023-24998 (commons-fileupload-1.4.jar), impacted:
DI components
CVE-2022-43902 (com.ibm.mq.allclient-1.4.jar), impacted:
DI components
SourceClear Premium (No CVE) (core-io-1.7.23.jar), impacted:
DI Components
Other issues fixed in R2023-05
- TDI-49611 - Bump and align common-csv 1.10.0
- TDI-49538 - Avoid to call routines.TalendString in subprocess header in common javajet, as it's a slow method
- TDI-49305 - Creating tables using the Dynamic Schema does not use the schema details collected by the Dynamic Schema
- TDI-49659 - Some Temporary files created by components (tMap) are not deleted
- TDI-49489 - tFTPConnection code generation wrongly after switch authentication method
- TUP-36527 - Improve Xml file processing security
- TUP-38334 - job showing error when running from studio on remote jobserver
- TUP-38108 - Job changes lost on close+save job with dirty joblet
- TUP-38314 - Guess schema fails with the warning "org.slf4j.impl.Reload4jMDCAdapter.put(Reload4jMDCAdapter.java:60)"
- TUP-38452 - Talend 6.3.1 to Talend 8.0.1 Migration Issues in tELT components
- TUP-38366 - Git History not available after checking out branch
- TUP-38801 - Left uncommitted files intact when logon a project for standard git mode
- TUP-38462 - Review migration tasks added after 8.0.1 release to make sure Studio generate good migration report
- TUP-38911 - Can't resize input/output table in tmap dialog
- TUP-38901 - Studio can not invoke SSO client if no jre on mac os environment variables
- TUP-38181 - Remove old avro libraries
- TUP-38456 - Ordering of "Run If" Triggers changes when joblet included in job
- TUP-38264 - The online help link was not directed the user to the proper content in the "Publish to Cloud" dialog
- TUP-38310 - Import items : Got error when "Run Analysis"
- TUP-38348 - [8.0.1] Retrieve scheme for DB2 database in Talend does not retrieve PK
- TUP-38455 - "Get folder by ID" can't work when create boxv2 dataset from metadata wizard
- APPINT-35554 - First route build after project login can fail
- APPINT-35510 - Fix potential XXE issue in TracerEventMessageParser
- TBD-14916 - Runtime exception on Streaming job with DynamoDB components on Spark Universal 2.4 Local
- TBD-14987 - tHadoopConfManagertHiveConnection1 Hadoop configuration jar not found
- TBD-15006 - [Linux] Fields in Metadata for Universal are displayed as corrupted after reopening the existing one
- TBD-15015 - tFileInputDelimited delimiter cannot be more than one character
- TBD-15053 - [DBR Metadata] Values "Driver node type" and "Node type" can't be set when create a new Metadata
- TBD-15063 - Runtime error "java.lang.RuntimeException: For input string: " "36551""" in tFileInputDelimited
- TBD-15073 - Compile error when Row Separator in tFileInputDelimited is "@"
- TBD-15074 - tCassandraOutput compilation error for all Universal spark local
- TBD-15114 - compilation error on batch job for Cassandra component with EMR62
- TBD-15141 - Add label to 'path/to/hadoop_conf.jar' in 'Yarn cluster' mode for spark universal
- TBD-15142 - RDD implementation of SPL31xIOdelimited have an error
- TBD-15143 - Migrate to use 3.1 spark libraries in Synapse distribution
- TBD-15155 - Error when tFilterColumn is connected to a tManagePartitions component
- TBD-15158 - Jobs on Synapse via Universal 3.3 is failed because of runtime exception
- TBD-15159 - Unable to pass values of context variables using Universal Spark launcher in Cluster mode
- TDQ-20816 - org.talend.dataquality.semantic added as a JAR file
- TDQ-21204 - tDqReportRun: Fixed the issue when the report datamart is snowflake
R2023-04
New features in R2023-04
- APPINT-18348 - Improve Code Editor for cConfig
- APPINT-35444 - Improve Code Editor for cProcessor
- APPINT-35477 - Improve Code Editor for cBeanRegister
- APPINT-35400 - tRestClient: add dynamic setting for "Advanced settings"/"Log messages"
- TBD-14943 - GA: Universal Spark 3.3.x - Databricks runtime 12.x
- TBD-14942 - GA - Universal Spark 3.3 for AWS EMR clusters
- TBD-14451 - new component tHBaseDeleteRows SparkBatch component
- TBD-12991 - Beta: Universal Spark 3.3 and 3.2 for Azure Synapse Spark pools
- TUP-34619 - Studio Dark Mode and UI simplification
- TUP-38478 - tHTTPClient - new tck connector
- TUP-36966 - Use standard git storage mode in new workspace(GA)
- TDI-47003 - TCK - New tBox connector in Tck for Studio
- TDI-46699 - Add a global variable to tDBRow to track inserts and updates(row count) for Teradata DB
- TDI-47760 - Add global variable "NB_LINE" for tMSSqlRow Component
- TDI-47759 - Add global variable "NB_LINE" for tAzureSynapseRow Component
- TDI-45256 - Add global variable "NB_LINE" for tRedshiftRow Component
- TDI-49447 - Upgrade Snowflake driver to latest version
CVEs fixed in R2023-04
CVE-2022-3171 (libphonenumber-7.2.8.jar), impacted:
APPINT Components
CVE-2022-45688 (json-20140107.jar, json-20090211.jar), impacted:
Studio
APPINT Components
DQ Components
CVE-2022-41854,CVE-2022-38752,CVE-2022-1471(snakeyaml-1.26.jar, snakeyaml-1.31.jar, snakeyaml-1.32.jar, snakeyaml-1.33.jar), impacted:
Studio
APPINT Components
DQ Components
CVE-2022-40152(woodstox-core-5.3.0.jar), impacted:
BD components
CVE-2022-41828 (redshift-jdbc42-2.1.0.3.jar), impacted:
BD components
CVE-2019-10086(commons-beanutils-1.9.3.jar), impacted:
BD components
CVE-2022-34917 (org.apache.kafka:kafka-clients 2.4.0,2.7.0,2.8.0,2.8.1), impacted:
BD components
CVE-2020-28491(jackson-dataformat-cbor 2.10.0,2.10.1), impacted:
BD components
CVE-2018-3258(mysql-connector-java-8.0.12.jar), impacted:
BD components
CVE-2022-45787 (org.apache.james:apache-mime4j:0.6), impacted:
Studio
CVE-2021-26291 ( pax-url-aether-2.6.2.jar), impacted:
DI components
CVE-2022-23710 CVE-2022-23708 (elastic related jars), impacted:
Studio
CVE-2022-41881 (netty related jars), impacted:
Studio
CVE-2023-26464 (log4j jar), impacted:
DQ Libraries
CVE-2019-12415 (poi-4.0.1.jar), impacted:
Studio
Other issues fixed in R2023-04
- TDI-49521 - tBigQuerySQLRow & Input Advanced setting label change
- TDI-47974 - Avoid locale dependent call to toLowerCase
- TDI-49470 - Use try-with-resources in the codegen footer
- TDI-49434 - MDC logging does not work with different Java threads
- TDI-49487 - tBigQuerySqlRow error : index must be less than size if BigQuery request contains a FOR statement
- TDI-49582 - Workday Reference with cache
- TDI-49560 - Align talendcsv jar for tCassandraOutputBulk
- TDI-49549 - BigQuery statement throws null pointer exception
- TDI-49341 - Snowflake component in Talend 8 not loading data to Snowflake, same job works in Talend 7
- TDI-49580 - Enable 'Convert bson document to JSON string' checkbox by default in MongoDB input for migrated jobs
- TDI-31777 - TOS tfileInputDelimited truncates CSV data without warning
- TDI-49458 - skip empty row not working in tfileInputPositional
- TDI-49258 - Upgrade DSSL to support empty json record
- TDI-49614 - "Null value in non-Nullable column" error when executing tDBCDC
- TDI-49340 - Guess schema / list tables does work snowflake component when using authentication using Okta
- TDI-49313 - [Security]: SQL Inject risk
- TUP-37855 - Need to improve logging if can't download jars
- TUP-38173 - Changing context variable name of a joblet's context multiple times leads to context being converted to built-in
- TUP-38212 - Built-in context variables behaved incorrectly in job with joblet
- TUP-38233 - MongoDB connection always failed connect in the first time in wizard
- TUP-38335 - Delay between locking/unlocking jobs in Studio 8.0 and TAC (both latest patch version)
- TUP-38282 - Guess Schema doesn't show Context options
- TUP-37990 - remove custom bundle org.bouncycastle.bcprov
- TUP-37227 - Issue building when items names too long
- TUP-38297 - Improve Update settings for user/password
- TUP-38316 - [801 CI/CD] Duplicate Parameter error in the artifact and creating the task
- TUP-38361 - Update Detection issue - Not all changes are propogated at once.
- TUP-38234 - Restore Job name and description editing in Job tab
- TUP-38617 - Can't switch back to old mode after changing workspace
- TUP-38199 - Remove updates section from Studio preferences
- TUP-38139 - context tab doesn't get updated after press 'undo'
- TUP-37730 - Updated generic schema name is not reflecting in the component Table field
- TUP-38443 - Integrate New tBoxv2 connector
- TUP-38561 - [performance] Studio crash when continuously run more than 2hours from automation test
- TUP-38109 - improve: update patch system first before fixing os profile
- TDM-9988 - Remove commons-io 2.6 shade
- TDM-9951 - JSON Reader fails on null group sequence
- TDM-9888 - Group still visible in output when created as "not visible" in the data mapper structure
- TDM-9930 - Upgrade to swagger-parser 2.1.12
- APPINT-35375 - Importing APIs leads to unclear warning messages
- APPINT-35059 - Cleanup BUILD_TYPE update triggers in Studio (components part)
- APPINT-35439 - cRecipientList component Timeout value in Studio 8.0.1 does not work
- APPINT-35441 - Route is failing with "Caused by: java.lang.NoClassDefFoundError: org/apache/camel/attachment/AttachmentMessage" when cMail component is used
- APPINT-35452 - Error org.osgi.framework.BundleException: Invalid Manifest header "Bundle-Version": 0.1.0-SNAPSHOT
- TBD-13259 - DBR64 - Simple job with Date or Short schema type fails
- TBD-14900 - [8.0.1] performance issue with tHBaseInput component in Big Data Batch job
- TBD-14905 - Mongo Atlas Connection : Error After applying patch "R2022-09-7.3.1"
- TBD-14926 - Java Compilation Errors with tTopBy Component after applying R202209 Patch
- TBD-14951 - OracleDB Migration task affecting DI Jobs
- TBD-14985 - Incorrect field names for Databricks via Universal in Wizard
- TBD-14986 - Transient cluster and Interactive cluster for Databricks are not renamed according to - TBD-14745
- TBD-14998 - Compile error in DynamoDB components with DBR 7.3
- TBD-15001 - Remove tFlume components from 8.0 Studio
- TBD-15010 - IOdelimitedcsvmultiCharacterInclude_Header Failed RDD
- TBD-15016 - class version incompatibility of with standalone spark cluster 3.2.1
- TBD-15045 - wrong jar name for spark-cassandra-connector-assembly
- TBD-15049 - cassandra job have an exeception on spl30
- TBD-15059 - Cassandra spark batch job fail on spl31 and spl24x
- TBD-15069 - ClassNotFoundException when I run spark batch job with tCacheOut and set lzf for compress code
- TBD-15075 - Code error in tHiveWarehouseOutput when used Stream Job with "Enable Hive Partitions"
- TDQ-19715 - tDqReportRun: Fixed the issue causing the component to fail on Java 8
- TDQ-21003 - Improved the UI when 'Overwrite existing items' option is selected
R2023-03
New features in R2023-03
- TDI-49107 - Add support for inputrow / outputrow for tJavaFlex
- TDI-48872 - Support China Azure and other region on AzureStorage components
- TDI-48917 - tAzureStorageConnection component to specify the connection host with a private host name
- TDI-46158 - Talend to leverage Azure Managed Identities for Azure Storage components
- TDI-47390 - tFileInputExcel - support 1904 date system when "Less memory consumed for large excel(Event mode)" is selected
- TDI-46570 - tFileOutputExcel support shared string table
- TDI-49241 - tAS400Output bad insert performance due to Return Generated Keys
- TUP-36736 - UNION, UNION ALL, MINUS & INTERSECT SQL set operators for tELTOracleMap
- TUP-38202 - Preference for repositories where the username and password can be set in the settings (Window > preferences > Talend > Update settings) of the Talend studio
- TUP-35058 - Issues on TMC after publishing artifact with Int type parameter but string values
- TUP-37093 - Send Mapper data to PTP
- TBD-10263 - BETA - Support MongoDB v4+ - Spark Streaming 3.1+
- TBD-13123 - Spark on Kubernetes - DataTap HPE Ezmeral
- TBD-14174 - BETA - Universal Spark 3.3 for AWS EMR clusters
- TBD-14745 - Talend 8/7.3 - Databricks: rename Transient cluster and Interactive cluster
- TBD-14749 - Beta: Universal Spark 3.3.x - Databricks runtime 12.x
- APPINT-35381 - Improve API storage for API imported from API Designer
CVEs fixed in R2023-03
CVE-2020-13936 (velocity-1.7.jar), impacted:
APPINT components
Studio
CVE-2022-41915 (netty-codec-http-4.1.77.Final.jar), impacted:
APPINT components
CVE-2021-37533 (commons-net-3.8.0.jar), impacted:
APPINT components
CVE-2020-7692(google-oauth-client-1.22.0.jar), impacted:
BD components
CVE-2022-46364(cxf-core-3.4.7.jar), impacted:
BD components
CVE-2019-20444 (netty-codec-http 4.1.13.FINAL and 4.1.16.FINAL), impacted:
BD components
CVE-2022-42889 (commons-text-1.8.jar), impacted:
BD components
CVE-2021-37533 (commons-net:commons-net:2.2,3.3,3.6,3.8.0), impacted:
BD components
DI components
CVE-2022-42003 (jackson-databind-2.13.3.jar), impacted:
BD components
CVE-2022-25647 (gson-2.2.4.jar), impacted:
BD components
CVE-2022-25857 (snakeyaml-1.24.jar and snakeyaml-1.30.jar), impacted:
BD components
CVE-2023-22899 (zip4j-2.10.0.jar), impacted:
DI components
Other issues fixed in R2023-03
- TDI-49284 - tFileInputMSPositional gives junk/error output
- TDI-49336 - Add filter (required_if ) for the three jars only visible DBType = HSQLDB
- TDI-49267 - Update sql fail for tELTOutput when have two ELTMap and two WHERE clause
- TDI-49395 - tHttpRequest set timeout gives French translation.
- TDI-32442 - Data format of Dynamic is not surported for excel2003 with event mode
- TDI-49324 - tCassandraOutputBulkExec should display 'INSERTSTMT' for CASSANDRA3_0
- TDI-49422 - java.lang.NoClassDefFoundError: io/netty/channel/unix/UnixChannel is thrown when connecting Cassandra with SSL
- TDI-49460 - Unable to read data with DeltaReader with java 17.0.5+
- TDI-49298 - tFTPGet dependency jakarta-oro-2.0.8.jar missing when used with tSambaConnection
- TDI-49446 - tFTPPut is transferring the file to the remote directory but the current status shows "No file transfered."
- TDI-49282 - maxDate in TalendDate is not validated
- TUP-29016 - tTaCoKitGuessSchema visible in shared component / preferences of data collected
- TUP-37430 - Cleanup org.talend.libraries
- TUP-37720 - Studio got stuck while committing new changes if gpgsign is true in user settings and user.signingkey isn't set for current repository
- TUP-38119 - Studio can't add branch project as reference project in standard mode
- TUP-37874 - [Security]: SQL inject risk
- TUP-37568 - Edits to the Help Contents menu
- TUP-37919 - [TDM]Input connections order changes when refactored to a joblet
- TUP-38093 - Studio 8.0.1 hangs in "Loading user component" after patch R2023-01
- TUP-37981 - Disable profile OS check by default when install update
- TUP-38230 - Impossible to acces to the Migrate project or test window after R2023-02 update
- TUP-37696 - Issue on redshift SSO metadata after update aws-java-sdk
- TUP-38213 - Oracle CDC: fail to catch the changes on table
- TUP-37697 - tRedShiftInput requires the driver jar of V1 even the setting's version is driver 2
- TUP-38031 - null pointer exception when migrate a job that has joblet from 6
- TUP-38145 - [8.0.1]tELTMap doesn't evaluate globalMap expressions with Integer conversions
- TUP-38248 - [801 Nightly] Create cassandra connection pop up missing some jars which can't be downloaded automatically
- TUP-38032 - [Studio 8.0]"Overwrite existing item" option is not display even increase the window height to maximum
- TUP-37176 - SSO logs out way too often on the Studio
- TUP-35060 - tWarn does not show the TalendDate.TO_CHAR method
- TUP-38349 - No Migration/Test dialog after logon Project/master if Project/Test has been logged and migrated in git new mode
- TBD-11985 - [Spak Streaming] BigQuery Ouput compile error
- TBD-14746 - Job fails to generate Java code with complex tMap
- TBD-14748 - Missing migration on tKafkaInput, leading to compile errors on all distributions
- TBD-14769 - NoSuchMethodError in Cassandra spark batch and streaming with universal 3.2, 3.3
- TBD-14799 - NoClassDefFoundError for deltalake job
- TBD-14818 - Spark job failing with error scheme-specific part at index 5: hdfs
- TBD-14849 - tHiveWarehouseConfiguration - username and pwd getting printed out in the CDP cluster yarn/spark logs
- TBD-14868 - Validate components updated in scope of TDI-49284
- TBD-14869 - tHiveInput/tHiveOutput components don't have "Storage" section in configuration with Spark Universal
- TBD-14870 - "Partitioning with range" checkbox is shown in "tManagePartition" for "Auto" and "Coalesce" modes
- TBD-14877 - Compile error when tPubsubOutput in streaming job
- TBD-14896 - NoSuchMethodError for DynamoDB components on EMR 6.6 with universal 3.2
- TBD-14904 - [BUG]can't create mongoDB table with bigdecimal data type
- TBD-14918 - Code error in tHiveWarehouseOutput when used with Stream Job
- TDM-9704 - Hl7v2 VARIES Composites have inconsistent element names across releases
- TDM-9919 - Add possibility to skip output conversion for cMap
- TDM-9842 - Remove displayed grid from connection panel in Standard map editor
- APPINT-35125 - Cleanup use of "org.talend.libraries" group id for APPINT components
- APPINT-35365 - Output Flows are empty when creating tRESTRequest from API
- APPINT-35380 - Failover url with context variable does not work when install feature from nexus (cMQConnectionFactory)
- APPINT-35407 - Remove opportunity to create test case for data services components
- TDQ-20973 - Upgraded org.talend.daikon.multitenant-core from 0.31.12 to 7.0.5
- TDQ-20875 - Removed org.talend.libraries from the Maven path
R2023-02
New features in R2023-02
- TUP-37660 - Upgrade SQLite JDBC jar to the latest
- TUP-37674 - Remove "SAP Hana" from feature title "NoSQL/ SAP HANA / BigData"
- TUP-37595 - reintroduce ingres/vectorwise in metedata
- TUP-37361 - Deprecate Studio - Exchange integration
- TUP-36122 - Unified component for Netsuite
- TUP-37353 - Guess Schema for tBigQueryInput
- TDI-46024 - Netsuite component needs API version 2020.x and 2021.x in Studio
- TDI-46488 - tRabbitMQInput: Manual acknowledge for RabbitMQ Messages
- TDI-48284 - Support for PostgreSQL 15
- TDI-45841 - Update SQLite component to support Dynamic data type
- TDI-49089 - Adjusted file based table join and ODP extraction to work with prefix or path and filename
- TDI-48882 - Reintroduce Ingres / Vectorwise components
- TBD-10112 - Optimisation in tHBaseInput component in Big Data Batch job.
- TBD-12733 - Spike: TBD/Talend 8 - Yarn cluster mode improvements
- TBD-14449 - KUDU format extensions in tImpalaCreateTable Standard component
- TBD-14450 - new component tHBaseDeleteRows Standard component
- TBD-14453 - performance extensions in tPartition SparkBatch component
- TBD-14454 - performance dedicated Coalesce extensions from tPartition SparkBatch component
- TBD-14455 - new SparkBatch component for performance/memory management
- TBD-14542 - Can't run spark batch job with hbase components success when I use CDP knox
CVEs fixed in R2023-02
CVE-2022-36033 (jsoup-1.14.3.jar), impacted:
DI components
CVE-2022-45693 (jettison-1.5.1.jar), impacted:
DI components
APPINT components
CVE-2022-40151 (xstream-1.4.19.jar), impacted:
Studio
DI components
APPINT components
DQ components
CVE-2022-41828(redshift-jdbc42-2.1.0.3.jar), impacted:
BD components
CVE-2020-13949(libthrift-0.12.0.jar), impacted:
BD components
CVE-2021-38296(spark-hive-thriftserver_2.12-3.1.1.jar), impacted:
BD components
CVE-2022-40152(woodstox-core-5.0.3.jar), impacted:
BD components
CVE-2020-13936 (velocity-1.7.jar), impacted:
DI components
CVE-2021-23926 (xmlbeans-2.6.0.jar), impacted:
DI components
CVE-2022-41881 (netty-codec-haproxy-4.1.77.Final.jar), impacted:
DI components
CVE-2021-39139,CVE-2021-39149 (com.thoughtworks.xstream:xstream:1.4.17), impacted:
APPINT components
CVE-2022-31692 (spring-security-web-5.6.5.jar), impacted:
Studio
CVE-2018-10899 (jolokia-core-1.6.0.jar), impacted:
Studio
CVE-2021-37533 (commons-net:commons-net:2.2,3.3,3.6,3.8.0), impacted:
Studio
DQ Libraries
Other issues fixed in R2023-02
- TUP-33645 - [TCK Studio Integration] backslash is not escaped
- TUP-37425 - Performance: Not Responding while Retrieving schema and the database contains many tables
- TUP-37692 - XPath json use context can't get any data when running job
- TUP-37392 - tELTPostgresqlMap with enabled delimited identifier will have a compile error after migration to v8
- TUP-37471 - tELTPostgresqlMap generates a different query after migration to v8
- TUP-37349 - Data viewer for tCouchBaseInput get npe error
- TUP-37898 - Could detect previous monthly patch even studio already install the latest patch
- TUP-37806 - [Studio 8]wrong message on Publish to Cloud with standard Git storage mode
- TUP-37920 - SQLite: Table list shouldn't be empty while retrieving schema
- TUP-35407 - support customize project pom template
- TUP-37358 - Adding org.ops4j.pax.url.mvn.useFallbackRepositories=false for studio ops4j
- TUP-37253 - Excel Metadata fails to set column names and results in IndexOutOfBounds for æ character
- TUP-37941 - Can't update studio from R2022-09 built studio to R2023-01
- TUP-37344 - If access token & refresh token change to invalid, can't show log in dialog when user selected auto login
- TUP-37475 - Migration task does not work for joblet in tck component
- TUP-37395 - Schema changes made on DB side not being reflected in Studio 8.0
- TUP-36823 - Generated SQL Query for Teradata misses reserved word "TIME"
- TUP-37168 - Studio can't add branch project as reference project
- TUP-38047 - Migration: Ingres/Vectorwise metadata changed to JDBC metadata after migration
- TDI-48437 - Parent job doesn't end when child job fails due to talendStats_DB connection error
- TDI-49081 - Drag a tMessaging component in job will throw error "Path configuration.deliveryMode not found in settings for form Advanced" in Error Log
- TDI-49091 - tAssert_ condition evaluation issue
- TDI-49253 - Salesforce UI show migration issue for Mutual Auth connection
- TDI-49263 - tExtractJSONField and tFileInputJSON label issue
- TDI-49268 - the file seems to be not closed when componentError occurs
- TDI-49185 - tCassandraInput doesn't work with uuid typed column
- TDI-49151 - Need API to get snowflake schema changes
- TDM-8840 - Import studio Database Connection into TDM Database
- TDM-9510 - Cannot update DatabaseLookup Column of an imported Map
- TDM-9635 - Improve TDM component named mechanism
- TDM-9728 - Support MySQL5 with 5.1.49 driver
- TDM-9786 - run job with old runtime returns NPE
- TBD-13171 - NPE error when I run - TBD-13036 attachment job and check use dataset API
- TBD-13671 - Kerberos configuration is missing in hadoop cluster metadata with Knox
- TBD-14213 - Runtime exception on job with Redshift components using SPL24
- TBD-14315 - Error on Universal/Dataproc at 3.1.x (GCP)
- TBD-14604 - Inconsistence Duplicate Data in tmap when run on CDP 7.1.7 cluster
- TBD-14660 - Spark job got "ExecutorLostFailure" after install Nov.patch
- TBD-14667 - CVE fixes for R2023-02
- TBD-14668 - Spark Job got error date format could not be parsed
- TBD-14670 - CVE-2022-41828 on redshift-jdbc42-2.1.0.3
- TBD-14687 - Spark job returned "Too much elements for the fields in csv try to put 48 in 47 record fields"
- TBD-14689 - tkafkainput Error in Big Data Streaming mode
- TBD-14691 - Spark Job with CSV source using delimited "^" running successfully but the data result is not valid whether null or not split as the defined delimited
- TBD-14721 - CVE-2020-13949 on libthrift-0.12.0
- TBD-14722 - CVE-2021-38296 on spark-hive-thriftserver_2.12-3.1.1
- TBD-14723 - CVE-2022-40152 on woodstox-core-5.0.3
- TBD-14728 - redshift in spark 3.1 Local: NoClassDefFoundError: org/apache/commons/text/lookup/StringLookupFactory
- TBD-14732 - NoSuchMethodError when I run spark batch job using teradata component with universal 2.4
- TBD-14735 - java.lang.NoClassDefFoundError: org/apache/commons/text/lookup/StringLookupFactory in cdh 6.1
- TBD-14768 - ClassNotFoundException in Cassandra spark batch with universal 3.0, 3.1
- TBD-14786 - tHiveRow Compilation error when set application name is unticked
- TBD-14794 - EMR 6.2.0 (Hive 3.1.2) job gives error SLF4J: Class path contains multiple SLF4J bindings.
- TBD-14805 - Streaming job containing tFixedFlowInput fails with code issue
- APPINT-35268 - Studio not reusing SSL connection with tRestClient component.
- APPINT-35204 - Removal of binary dependency libraries from source
- APPINT-35280 - Error message when click "Update API definition" menu for OAS3.0
- APPINT-35370 - Project analysis tool does not detect missing dependencies which are preinstalled to Nexus or Maven repo
- APPINT-35368 - Detail Message: FormatterUtils cannot be resolved
- TDQ-20787 - Report in PDF: Fixed the issue causing the catalog or schema name to be wrong
- TDQ-20874 - Updated our terminology to meet the bias-free policy
R2023-01
New features in R2023-01
- TDI-46523 - Virtual Host in tRabbitMQ component.
- TDI-47527 - Upgrade tika 1 to tika 2
- TDI-40021 - Snowflake metadata Connection mis-maps integer data type
- TDI-49130 - Move tSAPHanaXXX components from bigdata to DI-EE
- TUP-36197 - Remove git branch name in project setting
- TUP-37472 - Oracle version cleanup
- TUP-34564 - Enable signing GIT commits from GPG
- TUP-30674 - Support rename on custom jar and inner code.
- TUP-32445 - Add the support of the module view for TCK/tcomp frameworks
- TDQ-20936 - Oracle: Removed versions 8 to 10 and deprecated versions 11 and 12
- TBD-14602 - Oracle version cleanup
- APPINT-35224 - Optimize the cMQConnectionFactory/cAMQP components so that failover URLs also can be supported in Talend 8.0
CVEs fixed in R2023-01
CVE-2022-31684 (reactor-netty-http-1.0.18.jar), impacted:
DI components
CVE-2012-0881 (xerces:xercesImpl:2.11.0.jar), impacted:
Studio
CVE-2020-13956 (org.apache.httpcomponents:httpclient:4.5.10.jar), impacted
Studio
CVE-2012-5785 (axis2-kernel-1.7.8.jar), impacted:
Studio
CVE-2022-36033 (org.jsoup:jsoup:1.14.2.jar, org.jsoup:jsoup:1.14.3.jar), impacted
Studio
CVE-2022-46364 (cxf-core-3.4.4.jar, cxf-core-3.4.7.jar), impacted:
DI Components
APPINT Components
MDM Components
Studio
CVE-2022-46363 (cxf-rt-transports-http-3.4.4.jar), impacted:
APPINT Components
CVE-2021-45046 (org.apache.logging.log4j:log4j-core:2.13.3), impacted:
APPINT Components
CVE-2022-40664 (org.apache.shiro:shiro-lang:1.7.1), impacted:
APPINT Components
CVE-2022-25312 (org.apache.any23:apache-any23-core:2.3), impacted:
APPINT Components
CVE-2022-33980 (org.apache.commons:commons-configuration2:2.1.1), impacted:
BD Components
APPINT Components
CVE-2022-40152 (woodstox-core-6.2.6.jar,woodstox-core-6.2.7.jar,woodstox-core-6.2.8.jar,woodstox-core-5.2.0jar,woodstox-core-5.3.0jar), impacted:
DI Components
APPINT Components
MDM Components
DQ Libraries
Studio
CVE-2022-45685,CVE-2022-45693 (jettison-1.5.1.jar), impacted:
DQ Libraries
(netty-handler-4.1.84.Final.jar), impacted:
DQ Libraries
CVE-2022-41828 (redshift-jdbc42-2.1.0.3.jar), impacted:
DI components
Studio
SourceClear Premium (No CVE) (commons-codec-1.9.jar), impacted:
DI components
CVE-2022-25168 (hadoop-common-2.6.0-cdh5.4.0), impacted:
BD components
CVE-2019-20444 (netty-codec-http 4.1.13.FINAL and 4.1.16.FINAL), impacted:
BD components
CVE-2019-16942 (jackson-databind-2.10.0), impacted:
BD components
CVE-2017-12629 (lucene-query-parser-6.6.1), impacted:
BD components
CVE-2018-1282 (hive-jdbc-2.1.1), impacted:
BD components
CVE-2020-35491,CVE-2019-16943(jackson-mapper-asl-1.9.13), impacted:
BD components
Other issues fixed in R2023-01
- TDI-48981 - Empty input file passed to tBigQueryBulkExec causes job to never end
- TDI-48440 - Improve Xml file processing security
- TDI-48900 - [Studio7.3.1]Component tXSLT uses deprecated code java.io.StringBufferInputStream
- TDI-49026 - Improve stream closing in javajet code for tFileInputPositional
- TDI-48610 - Align daikon/crypto-utils to 7.0.x
- TUP-37391 - [8.0.1] Deploy Job to MDM server fails : HTTP 401 org.springframework.security.authentication.BadCredentialsException: Failed to decode basic authentication token
- TUP-37467 - [8.0.1&7.3.1] custom component are no more build as snapshot but releases since june/july patch
- TUP-37416 - Can't execute job with JSON component linked to reposoitory
- TUP-37012 - Help Pane: Online Tools menu: Bugtracker/sources/exchange/forum menus
- TUP-37010 - Help Pane: Online Tools: remove Babili menu
- TUP-37706 - SQL Compilation error for tELTMap component after applying patch R2022-11 on Talend studio 8.0.1
- TUP-37751 - Data view/Guess schema fail if set java interpreter to jdk 8
- TUP-37614 - Validate studio cloud connection with new release
- TUP-37698 - Field separator is not working as expected in Talend 801
- TUP-37644 - Add jfrog artifactory as repository-type to commandline document
- TUP-37823 - [JETL] Fail to install patch on ubuntu and mac
- TDM-9567 - [EDI] show sample for some elements with d98b structure and will get unexpected result
- TDM-9608 - [EDI] Repeating delimiter used in between EDI composites instead of an element delimiter
- TDM-9733 - [tHMap] Renaming an input connection then adding a new connection causes an Exception during execution
- TDM-9777 - [tHMap] An Execution error occurs if an HL7V2 structure is used in an InputWrapper structure
- TDM-9753 - Job run fail when input use structure created from json schema and wrapper
- TDQ-20381 - tDataEncrypt/tDataDecrypt: Fixed the issue causing Jobs to fail when using Databricks with Spark 3.1, 3.2, and 3.3
- TDQ-20585 - DQ components/DQ Libraries: Upgraded crypto-utils/daikon to 7.0.5
- TBD-14705 - [SparkStreaming][Kafka] tKafkaInputAvro and tkafkaInput not working with spark version 3.2
- TBD-14695 - tHiveWarehouseConfiguration - Unable to create PoolableConnectionFactory
- TBD-14677 - Compile error on Databricks with tFileInputJson on S3
- TBD-14727 - compile error for spark streaming job when using tkafkaInput with universal 3.2
- APPINT-35241 - Avoid build process to generate sources mutiple times
- APPINT-35275 - tRestClient schema is deleted when switching from Built-in to Repository and back
- APPINT-35298 - Fail to run/build/publish REST service after switch build type from Microservice to OSGI
R2022-12
New features in R2022-12
- TUP-37162 - Improvement needed for standard Git mode
- TUP-37296 - Improve git preference page to show reference relationship for invalid case according to figma design
- TDI-48713 - Add JWT authentication for WQL
- TDI-48883 - Deprecate old versions of Microsoft CRM
- TDI-49016 - Oracle version cleanup
- TDI-47992 - Add support for BW On Hana for the ADSO components
- TUP-35746 - Change the download of jars
- TBD-11847 - [Feature Request] Use Big Decimal with tRedShiftOutput
- TBD-13689 - Unable to read Avro Kafka data from Schema Registry
- TBD-14257 - TFileInput components do not work with TGSConfiguration on Databricks + GCP job
- TBD-14440 - GA - Universal Spark 3.3 - Databricks runtime 11.x
- TBD-14443 - Support tGSConfiguration with spark universal in streaming jobs
- TBD-14447 - Version Managment - evolve spark spark 212.3.2.1 -> 212.3.2.2
- TBD-14511 - GA - Universal Spark 3.2.x for Amazon EMR 6.6.0 and onwards
- TDQ-20097 - tDataQualityRules: Support for dynamic schema in Standard Jobs
- TDQ-20764 - tDataQualityRules: Support for Databricks with Spark 3.3
- TDQ-20723 - DQ Batch components: Support for Databricks with Spark 3.3
- TDQ-20724 - DQ Streaming components: Support for Databricks with Spark 3.3
- APPINT-34728 - Code improvement : dependency externalization for microservices
CVEs fixed in R2022-12
CVE-2022-40149 (jettison-1.1.jar), impacted:
DI components
studio
CVE-2022-30126 (org.apache.tika:tika-core:1.28.1), impacted:
DI components
APPINT Components
CVE-2022-37865 (ivy-2.4.0.jar), impacted:
DI components
BD components
DQ Libraries
CVE-2022-45047 (sshd-common-2.8.0.jar), impacted:
DI components
CVE-2022-3171 (protobuf-java-3.19.6.jar), impacted:
BD components
DI components
CVE- (aws-java-sdk-core-1.9.16.jar), impacted:
BD components
CVE- (bctls-jdk15on-1.68.jar, bcprov-jdk15on-1.68.jar), impacted:
BD components
DI components
studio
CVE- (commons-codec-1.11.jar), impacted:
studio
CVE-2022-42920 (bcel-5.2.jar, bcel-6.3.1.jar), impacted:
DQ components
CVE-2022-41704 (batik-bridge-1.15.jar), impacted:
DQ Libraries
CVE-2022-42890 (batik-script-1.15.jar), impacted:
DQ Libraries
CVE-2022-25857 (snakeyaml-1.26.jar), impacted:
studio
CVE-2019-14439 (jackson-databind-2.4.0.jar), impacted:
APPINT Components
CVE-2020-9548 (jackson-databind-2.7.9.jar), impacted:
APPINT Components
CVE- (reload4j-1.2.19.jar), impacted:
APPINT Components
Other issues fixed in R2022-12
- TDI-45967 - tSnowflakeOutput can't upsert and update data with dynamic column when tMysqlInput's as input
- TDI-48891 - tFileInputMail fails with java.lang.StringIndexOutOfBoundsException if attachment filename doesn't contain a dot "."
- TDI-48812 - Error log when use Neo4jv4ImportTool on wizard or palette
- TDI-48912 - [TCK][Messaging] Effect of rollback action isn't available for the second Input
- TDI-48777 - [TCK][Messaging] Websphere Rollback either does not work or work partly aka Global commit problem with timeout
- TDI-48824 - tMicrosoftCrmXxx - OAuth calls are executed twice
- TDI-48876 - tAccessInput/Output/Row is unable to work in Java 11 if the AccessDB is configured with password
- TDI-48775 - Salesforce Connection - Session reuse option not working with Mutual Auth
- TDI-46383 - tRedShifBulkExec/tRedShiftOutputBulkExec don't support web identity Token, Inherited credentials from AWS role, and profile credential
- TDI-47253 - Correct migration task AddHourFormatToBigqueryBulkOutput returns
- TDI-48823 - tWorkdayInput - Error on FinancialManagement.GetLedgers SOAP call
- TUP-36969 - Upgrade slf4j to 1.7.34
- TUP-37254 - Error in selectively generating all poms when a job is used as child job from multiple jobs and test cases also selected as dependency.
- TUP-37268 - Can't retrieve configuration from cloudera by jobserver
- TUP-37153 - Dead lock when migrating tck metadatas and jobs
- TUP-37404 - tMarketoInput default schema cannot propagate to the following component
- TUP-37228 - Studio errors when attempting to create a Cloudera Dynamic Distro when repository.apache.org port 80 is blocked
- TUP-37161 - Pop up windows can not be closed when log on a migrate big project
- TUP-37051 - Studio perspective continuously reset after install R2022-09 patch
- TUP-37347 - New git mode corrupt git project
- TUP-37414 - Uncommitted changes are lost with "standard Git storage mode"
- TUP-37213 - Studio can't login TMC project when add muti-refer project
- TUP-37287 - Project will missing items/reference relationship if follow below steps.
- TUP-37250 - Can't log in remote project if it has uncommit files on local connection
- TUP-37360 - Compilation error for tELTMap component after applying patch R2022-11 on Talend studio 8.0.1
- TUP-36933 - [7.3.1] import dependencies is not working when we do a copy from branch
- TUP-36657 - Fix p2 settings inside config.ini automatically if they are broken
- TUP-37119 - Skip unnecessary api call to TMC
- TUP-37007 - Disable DTDs feature for DocumentBuilder in class org.eclipse.urischeme.patched.internal.registration.PlistFileWriter
- TDM-9685 - SAP IDocs Reader fails on Decimal with precision 18
- TDM-6125 - Add function to check string present in string collection
- TDM-9533 - An XQuery compilation occurs when the regex defined in the Properties for Matches or Replace contains the single quote character
- TDM-9669 - Remove Reverse Map option
- TDM-9670 - Remove Map Inheritance
- TDM-9671 - Remove option to create a Report Map
- TDM-9676 - Add substring-before and substring-after functions
- TDM-9682 - Add AgConcatLastPresentValue and ConcatLastPresentValue
- TDM-9702 - XSD Import fails to create Structures when name starts with CON. on Windows
- TBD-12530 - [BUG] A lot of compile errors in Spark Streaming jobs with several pipelines working in parallel with some components
- TBD-12765 - [BUG] UI: Move the "Use Knox" checkbox to "Connection" section
- TBD-13110 - Failed to generate code for streaming job with tFileInputXML
- TBD-13230 - NullPointerException on Spark job with tCollectAndCheck if "Path or table name" uses context
- TBD-14091 - Compile error on Spark Batch job with tCassandra components on Spark Local 3.0
- TBD-14209 - Compile error on tPubSubInputAvro component using Spark Local 2.4-3.3
- TBD-14331 - CDP knox doesn't show by default in metadata
- TBD-14332 - Knox Timeout doesn't update from metadata
- TBD-14362 - tKafkaCreateTopic failing with ClassNotFoundException for kafka versions 0.9.0.1 and 0.10.0.1
- TBD-14363 - [Studio 8] Compile error on tKafkaInputAvro using Spark Local 2.4-3.3
- TBD-14421 - [8.01 BD]tMongoDBConfiguration is not support connection string and DB Version 4.4.X and later
- TBD-14428 - NoSuchMethodError: org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy on emr 6.2.x
- TBD-14436 - Compile error after migration old EMR 6.2 jobs
- TBD-14492 - ClassNotFoundException when spark batch job use hive components
- TBD-14498 - Getting "Path does not exist: dbfs:XXX/" when using tS3Configuration as storage configuration for tAvroInput
- TBD-14499 - Issue with Use Kerberos authentication checkbox in tImpalaConnection and tImpalaInput components
- TBD-14505 - Use custom classpath is added for all spark universal
- TBD-14506 - Compile error "rdd_row2 cannot be resolved" when use attachment job
- TBD-14509 - wrong jar name and maven URI for commons-pool jar
- TBD-14528 - Joblets configuration not recognized in the batch job
- TBD-14541 - [BUG] Spark Batch job with tFileOutputPositional passes successfully with Exit code= 0, but doesn't write data to the GS bucket
- TBD-11030 - Spark SQL queries to reduce the amount of data retrieved from S3 using S3 select
- TDQ-20873 - tDataQualityRules: Fixed the issue preventing from using a phone semantic type
- TDQ-20615 - tDataQualityRules: Fixed the issue causing the Job to fail when the URL has been removed
- TDQ-20834 - tRulesurvivorship: Fixed the issue preventing the component from working properly
- TDQ-20840 - tDuplicateRow: Fixed the issue preventing from using context
- TDQ-20854 - tDuplicateRow: Fixed the issue causing a processor exception
- TDQ-20937 - Routines: Fixed the issue causing wrong results when using DataMasking.createRandomDate
- APPINT-35136 - Salesforce connection receiving intermittent exceptions in a route
- APPINT-35186 - "Set-Cookie" information are no more exited in header after install patch 2022-10 for Studio 8.0
- APPINT-35115 - Add opportunity to import API files with OAS 3.0 format in Studio metadata
- APPINT-35133 - Route with spring-redis component fails when running as microservice
- APPINT-35209 - jettison-1.5.1.jar lost when run job with tRESTRequest or tRESTClient
- APPINT-35244 - Override Routelet Contexts is Throwing Error addComponent(String, Component) in the type CamelContext
- APPINT-35134 - Link about "validation details" of warning still there when switch to error API definition
- APPINT-35176 - Upgrade slf4j to 1.7.34
R2022-11
New features in R2022-11
- TUP-35957 - Use standard git storage mode in workspace(Beta)
- TUP-36567 - Migrate GIT multiple working tree storage mode to standard storage mode
- TDI-48392 - Neo4J Deprecation
- TDI-48395 - Create tNeo4jV4ImportTool
- TDI-47508 - Unbundle aws-java-sdk for javajet components
- TDI-48543 - Issue to get Authorization Token tMicrosoftCrmInput (ROPC)
- TDI-47566 - tKafkaCreateTopic timeout value remains hardcoded
- TDI-40737 - JMS: migrate to tacokit
- TDI-48442 - MERGE query for tELTTeradataOutput/Netezza components
- TDI-48675 - JDBC ELT components handle Japanese table,schama
- TDI-48719 - Guess schema service for processors
- TUP-36683 - Selective generateAllPoms
- TUP-33040 - JDBC ELT components cannot handle table/column name in Japanese
- TUP-32228 - Load multiple libraries with routine by detect the pom file of the jar
- TUP-33031 - List invalid items with Project analysis of 8.0
- TBD-14233 - GA - Universal Spark 3.3 spark local mode
- TBD-13985 - CDE 1.15 : GA
- TBD-13997 - Beta - Universal Spark 3.3 - Databricks runtime 11.x
- TBD-14288 - Add Dynamic schema on TAvroInput - batch
- APPINT-34707 - Include new route components in Studio for data schemas management
- APPINT-34708 - Include new route components in Studio for databases management
- APPINT-35069 - App. Int. Demos to include new components (data schemas & DB operations)
- APPINT-34899 - Automatic refresh of the Cloud Artifact view when selecting a Job or Route
- APPINT-34985 - Automatic refresh of the Cloud Artifact view when selecting a SOAP Service
CVEs fixed in R2022-11
CVE-2022-25857 (snakeyaml-1.26.jar), impacted:
DI components
TSAP-RFC-SERVER
Talend Metadata Bridge
CVE-2022-42889 (org.apache.commons:commons-text:[1.5-1.10.0)), impacted:
studio
DQ libraries
BD components
DQ components
APPINT Components
DI components
CVE-2022-42003, CVE-2022-42004 (jackson-databind-2.13.2.2jar), impacted:
studio
metadata
DQ libraries
MDM components
APPINT Components
DI components
CVE-2022-3171 (com.google.protobuf:protobuf-java:3.19.2), impacted:
studio
DQ libraries
DQ components
CVE-2022-34169 (xalan:xalan:2.7.2), impacted:
DQ components
CVE-2022-34917 (org.apache.kafka:kafka-clients:3.1.0), impacted:
APPINT Components
CVE-2022-39135 (org.apache.calcite:calcite-core:1.26.0), impacted:
DI components
CVE-2022-41853 (org.hsqldb:hsqldb:2.3.1), impacted:
studio
DI components
SourceClear Premium (No CVE) (ch.qos.reload4j:reload4j < 1.2.22), impacted:
studio
DI components
Other issues fixed in R2022-11
- TUP-36712 - Schema lost when convert DeltaLake job to spark
- TUP-36673 - Disable git related logs during running generateAllPoms
- TUP-36853 - get error when convert standard job with DeltaLake component to Big data streaming
- TUP-36686 - Studio Branch does not update automatically after deletion of earlier branches
- TUP-36833 - DB Common folder not showing under Palette tab
- TUP-36831 - Migration task not working for tck connection component
- TUP-36904 - Ubuntu ARM64: Cannot "login with TalendCloud" with installed studio
- TUP-36760 - Remove Workspace option from "Other login mode">"Manage Connections">Preference
- TUP-36630 - Studio need to respect update settings in TMC
- TUP-36931 - TCK Neo4j studio feature should be changed after Neo4jv4ImportTool is released
- TDI-48637 - Tableau change internal hyper daemon indication
- TDI-47950 - Remove 'For Studio Only' label for Workday 'WS-Security certificate authentication'
- TDI-48407 - tGoogleDriveList component does not handle 'include shared folders/files' param
- TDI-48569 - tSalesforceInput - Dynamic Schema doesn't output reference field
- TDI-48748 - Show field in Connection (Datastore) that depends on next-level configuration
- TDI-48477 - tOracleCDC,tDB2CDC,tSybaseCDC use the hidden db schema property when "use existing connection"
- TDI-48778 - tGroovy : Support Java 17 at runtime
- TDI-48779 - tExtractJSONField: Support Java 17 at runtime
- TDI-48465 - [8.0.1] TDBOutputBulk error with oracle when the record separator is set as "||||"
- TDI-48676 - Limitation size of context variable file can hold
- TDI-48546 - tSalesforceOutput component throws java.lang.StringIndexOutOfBoundsException when the Parallelization is enabled
- TDI-48810 - Job build fails with : Duplicate nested type CompareUtil after R2022-10v2
- TDM-9667 - Remove getModulesNeeded from MapperComponent
- TDM-9629 - Optimize 'Generate' function
- TDM-9626 - The structure's JSON Rep Properties Character Encoding should be by default UTF-8
- TDM-9560 - Fix error message for Database Jars Importer
- TDM-9610 - Isomap with XML namespaced attribute from XML to Avro fails
- TDM-6495 - WriteURL can't create parent folder if it does not exist
- TDM-9291 - Improve representations' sorting
- TDM-9509 - Implement a formatNumber string function
- TDM-9520 - Change Help buttons on TDM dialogue
- TDM-9507 - IsNull returns an empty value
- TDM-9534 - Unify question and button
- TDQ-20819 - Business rule: Fixed the issue preventing from running an analysis after updating the Where Clause setting
- TBD-14265 - Runtime exception on Spark job with tAzureConfiguration in ADLS Gen2 mode using Spark Universal 3.3 Local
- TBD-13875 - [SPL32, SPL33] Runtime exception on Spark job with Redshift components
- TBD-14431 - Spark job compilation error
- TBD-14425 - Compile error for BigQuery in spark batch with universal 3.3x
- TBD-14424 - Compile errors on Spark job with tAvroMap component
- TBD-14321 - Getting Path does not exist exception on Talend 8 - 09-2022 patch and Databricks
- TBD-14365 - spark.hadoop.fs.s3.impl Spark settings are overridden when using tS3Configuration component
- TBD-14317 - tHiveInput component issue in patch R2022-02
- TBD-14328 - ClassNotFoundException when check service for CDP 7.x knox
- TBD-14412 - Impossible to create CDP dynamic distribution 7.1.7.0-551 version
- TBD-14407 - No option to change instalation CLASSPATH for CDP in spark job
- TBD-14446 - NPE when dragging and dropping a HDFS metadata to tHDFSConfiguration
- TBD-14427 - ClassNotFound in KinesisInput with universal spark 2.4
- TBD-14432 - ClassNotFound in KinesisOutput with universal spark 2.4
- APPINT-35117 - Duplicates lines in karaf logs on runtime and mixed logs in logs of routes on cloud
- APPINT-35116 - Failed to publish service to nexus when checking Snapshot with Default version
- APPINT-35123 - Route not able to complie with CI Builder
- APPINT-35024 - Improve API bridge dependencies management
R2022-10
New features in R2022-10
- TDI-47807 - Support Neo4j Aura
- TDI-47598 - Kafka support version 2.6+ (3.2 as of today)
- TDI-42323 - tFileInputExcel add entry to custom ratio
- TBD-14263 - Support MongoDB v4+ - Spark Batch 3.1+ - GA
- TUP-36777 - Improve workspace setting for "Log in with Talend Cloud"
- APPINT-26700 - Ability to modify microservice application properties file within Talend Studio
- TDQ-20614 - tDataQualityRules: Support for Databricks with Spark 3.2
- TDQ-20721 - DQ Batch components: Support for Spark 3.3 in local mode
- TDQ-20722 - DQ Streaming components: Support for Spark 3.3 in local mode
CVEs fixed in R2022-10
CVE-2022-24823 (netty-common-4.1.75.final.jar), impacted:
DI components
DQ Libraries
CVE-2022-33980 (commons-configuration2:2.1.1), impacted:
BD components
CVE-2022-25857 (snakeyaml-1.27.jar,snakeyaml-1.30.jar), impacted:
Studio
APPINT Components
CVE-2022-40149 (org.codehaus.jettison:jettison:[1.1 1.4.1]), impacted:
APPINT Components
DQ Libraries
CVE-2022-40155 (xstream-1.4.19.jar), impacted:
DQ Libraries
CVE-2022-38648 (batik-bridge-1.14.jar), impacted:
DQ Libraries
CVE-2022-25914 (jib-core-0.12.jar), impacted:
Studio
CVE-2022-25168 (hadoop-common-3.2.3.jar), impacted:
DI components
Other issues fixed in R2022-10
- TDI-48495 - tS3List gives warn not error when dieonError enabled
- TDI-48547 - tSplunkEventCollector encoding issue
- TDI-48267 - upgrade format-detection jar to 6.1.1 for fileio connector and tsetdynamicschema component
- TDI-48540 - tJasperOutput can't find the class/method
- TDI-48480 - "OutOfMemoryError: Required array size too large" error when ingesting large files with tBigQueryOutput
- TDI-48434 - java.lang.NullPointerException at com.talend.excel.xssf.event.ColumnUtil.calculateIndexOfColumn(ColumnUtil.java:12) when using tFileInputExcel
- TDI-48476 - Align jetty-XXX version in connectors-se repository
- TDI-48458 - Component tDBCDC keeps "old" Schema value after option "Use an existing connection" is checked
- TDI-48612 - tKafkaCommit missing code for Kafka version 0.9.0.1
- TDI-48359 - tAzureAdlsGen2Connection/Input/Output timeout parameter never used in runtime since TDI-46813
- TDI-48475 - tDBOutput open twice the connection in Studio 8.0.1 as compare with 7.2.1
- TDI-48625 - tSybaseCDC has strange configuration layout
- TDI-48473 - Job using tLDAPInput with Protocol=LDAPS fails in MDM server : Caused by: java.lang.ClassNotFoundException: talend.ssl.AdvancedSocketFactory
- TDI-48321 - tSCP and tSSH components cannot work with redhat server
- TDI-48562 - tKafkaCreatTopic with version 2.4.X fails with TimeoutException when connecting to Kafka with SSL enabled
- TDI-48550 - tDBSCD component does not change date(time) fields to NULL
- TDI-48448 - tDBOutput - BigDecimal values rounded when "Enable parallel execution" activated
- TDI-48574 - Avoid error log and NPE after after a connector use TCOMP-2230 allow a "ui.scope" target for the tck ActiveIf json metadata info
- TDI-48205 - tAzureAdlsGen2 Get/Put/Delete missing timeout parameter
- TUP-36765 - Code generation issue on Spark job with Spark Universal 3.3 Local
- TUP-36284 - Compile error in Studio
- TUP-36519 - "Detect and update all jobs" does not update all jobs
- TUP-36653 - Schema Update Detection popping up everytime upon opening the job
- TUP-36812 - If user installed JAVA version less than 11, Web browser can't call back SSO client.
- TUP-36781 - If do not select "ask me at startup" on login project page, next time studio will popup "Branches has been changed! Please check and logon manually" dialog
- TUP-36769 - Can't open learn more link if there is no license in Studio.
- TUP-36732 - Studio can not fetch SSO access token automatically if stay on logon dialog for long time
- TUP-36169 - Performance issue when execute "Generate Doc as html"
- TUP-36726 - "Support NLS" works unstable
- TUP-36858 - network issue when logon git offline project
- TUP-36614 - [8.0.1] unable to open reference project after a "checkout as local branch"
- TUP-36584 - tMap component hang with tRowGenerator; can only end task using Task Manager
- TDM-9393 - JSON Sample Importer should not create elements with Any types
- TDM-9455 - Problem to open TDM help
- TDM-9468 - Warning dialog won't pop when job run with map which miss loop expression
- TDM-9508 - Synchronize dialog shouldn't pop when add/remove onsubjobOK connection
- TDM-9561 - Incorrect parsing of EDIFACT data
- TDM-9554 - Decimal Cobol field of size 18 missing properties when exported to avro
- TDM-9479 - Can't create flattening map with error throw
- TDM-9579 - Get npe when cut element name which type is value
- TDM-9585 - Regenerate map for thmap should get error if structure in Recycle bin
- TDM-9590 - Streaming job run fail when map remove value which set in structure
- TDM-9607 - CSV Reader looses tab as delimiter in runtime configuration
- TDM-9311 - tHmap issue in a joblet called from another Joblet
- TBD-10400 - Reject flow doesn't work correctly for dates in extract components
- TBD-13810 - Request for a Big Data/Spark component to handle delimited files using Dynamic Schema
- TBD-14194 - Running Parallel Job because of Resource Changed on CDP Cloud Cluster
- TBD-14224 - NPE exception while opening BigData Streaming Job
- TBD-14279 - Compile error when run sparkstreaminglocalmongodbj01240_sparkjob2
- TBD-14294 - TFileInputDelimited when using headers more than 1 unexpected behavior
- TBD-14305 - some TUJ Jobs can't generate code
- TBD-14313 - Compile error when tFileInputDelimited CSV option is not checked and escape was set as """
- TBD-14316 - Spark job - "Syntax error on token "Invalid Character", ) expected" after upgrading to R2022-09
- TBD-14359 - 'lineSep' can contain only 1 character when tFileInputDelimited with default row separator "\n" on Windows
- TBD-14374 - Spark job - java.lang.ClassCastException: java.lang.String cannot be cast to java.util.Date
- TBD-14382 - TFileInputDelimited - NPE on parse data
- TBD-14383 - TFileInputDElimited - error parse date
- TBD-14384 - TFileInputDelimited - when error occurs we kept an empy row
- TBD-14387 - Runtime exception on tFileInputDelimited TUJs with RejectFlow Minor
- APPINT-34581 - Route and data services features versions behave differently in Talend Runtime
- APPINT-35034 - Bundles are going to Resolved State while deploying and Undeploying the Route
- APPINT-35038 - Adding a comment breaks tRESTRequest and the resulting body is "null"
- APPINT-35070 - Not able to retrieve the cookies from trestclient - 2
- TDQ-20692 - tDqReportRun: Fixed the issue causing the contexts to be cleared after clicking Browse report
- TDQ-20713 - tDataDecrypt: Fixed the issue preventing from using input data that is already decrypted
- TDQ-20751 - tDqReportRun: Improved the context switching for a Snowflake connection
- TDQ-20690 - tDataEncrypt/tDataDecrypt: Improved the UI by standardizing the labels of Spark and Standard components
- TDQ-20746 - CVE: Aligned to gson-2.8.9 for MSSQL metadata part
- TDQ-20760 - Improved the UI by rewriting the Exist client dependency dialog
R2022-09
New features in R2022-09
- TUP-36373 - Delete .m2 with UI option when apply a monthly update
- TUP-36340 - Studio requires orai18n.jar when Oracle 19c is in specific character set like JA16SJISTILDE
- TUP-35976 - Required username and password in the update settings of studio 8.0.1
- TUP-36602 - Feature to install Bigtable in studio
- TUP-35190 - Use TMC email instead of login name as Git Commit Author in Studio
- TUP-34352 - Support for Mac OSX 12 Monterey
- TUP-32606 - Support SSO on Studio
- TDM-8983 - Provide an Unflattening feature
- TDI-48282 - Workday Output SOAP component
- TDI-46676 - Add MDC context to Log4j2
- TDI-48343 - Change TDS component (tdatastewardshiptaskinput) to support the new pagination approach
- TDI-48233 - Google Bigtable in studio
- TDI-48332 - Oracle components requires orai18n.jar when Oracle 19c is in specific character set like JA16SJISTILDE
- TDI-48456 - Add Microsoft Exchange as credential type to tPOP
- TBD-13647 - Databricks - Switch from transient to permanent configuration for the big data job
- TBD-13810 - Request for a Big Data/Spark component to handle delimited files using Dynamic Schema
- TBD-13932 - GA - Universal Spark 3.2.x for Databricks 10.x and above on google
- TBD-13996 - Spark local mode - Universal Spark 3.3 beta
- TBD-14016 - Support MongoDB v4+ - Spark Batch 3.1+ - beta
- TDQ-19700 - Snowflake in JDBC: Support of context switching to switch DBs and schemas
- TDQ-20282 - DQ Batch components: Support of Databricks with Spark 3.2
- TDQ-20281 - DQ Streaming components: Support of Databricks with Spark 3.2
CVEs fixed in R2022-09
CVE-2020-10683 (dom4j-1.1.jar), impacted:
Studio
CVE-2022-31197 (org.postgresql:postgresql:42.2.25), impacted:
metadata
DI components
CVE-2022-2047 (jetty-io.jar), impacted:
DI components
CVE-2022-36364 (avatica-core-1.11.0.jar), impacted:
DI components
CVE-2022-34169 (xalan:xalan:2.7.2), impacted:
DI libraries
CVE-2022-25168 (hadoop-common-3.2.3.jar), impacted:
BD components
DQ libraries
TDM-9448 - Fix CVE in Unflattener editor
TDQ-20610 - org.apache.lucene:lucene-core upgraded to 8.11.2
CVE-2022-31159 (aws-java-sdk.jar), impacted:
DI components
BD components
CVE-2021-35516 (commons-compress-1.20.jar), impacted:
metadata bridge
CVE-2021-44228, CVE-2021-44832, CVE-2021-45046, CVE-2021-45105 (tadt-definitions.translator-14.1.8-jar-with-dependencies.jar), impacted:
APPINT API translator
CVE-2022-21724 (postgresql-42.2.25.jar), impacted:
DQ components
CVE-2012-5785 (axis2-1.6.2.jar), impacted:
DQ components
CVE-2019-12415 (poi-ooxml-3.17.jar), impacted:
DQ components
Other issues fixed in R2022-09
- TDI-47441 - Azure-dls-gen2 has 10mb of excel dependencies despite not support Excel data format
- TDI-47865 - [TCK][Zendesk] An exception is generated in the studio log when retrieving schema of tZendeskInput
- TDI-48048 - tAzureAdlsGen2XX can't support the blob path includes "
- TDI-48316 - tGSCopy does not work when disabling Rename option
- TDI-48293 - COPY command executing before the PUT command completes in tsnowflakeoutputbulkexec
- TDI-48417 - tGoogleDriveGet to log message when it does nothing
- TDI-48431 - Component tChronometerStop reports java.nio.BufferOverflowException when running on a Jobserver
- TDI-48446 - tELTPostgresqlMap doesn't require (USEEXISTINGCONNECTION == 'false') when import driver jars
- TDI-48363 - Skip empty enum property for UI form validation
- TDI-48398 - Execution failing in Linux server
- TDI-48213 - Improve stream closing in javajet code
- TDI-48255 - tDynamoDBInput failing with "#" in column
- TDI-48362 - Workday Web Services certificate authentication doesn't work
- TDI-48560 - Compile error while log4j is deactivated
- TUP-35231 - tELTMap update query not be wrapped for SET column when enable
Use update statement without subqueries
in tELTOutput - TUP-36440 - JSON parsing issue when creating a new JSON file input in a repository
- TUP-36251 - [8.0.1] File JSON metadata not working when special character or space is available in the field name
- TUP-35898 - Studio does not display an error message when importing bad zip job archive
- TUP-36593 - Nexus proxy password is stored in clear text in project setting preference
- TUP-36483 - Code generation fails with : Caused by: org.eclipse.emf.common.util.BasicEList$BasicIndexOutOfBoundsException: index=6, size=6
- TUP-36320 - Studio got stuck after pasting long context name into tELTSAPMap editor->Output table‘s Expression cell
- TUP-35879 - Default value is not saved into the job in tck component
- TUP-36118 - AMC page unable to load all projects
- TUP-35511 - [JDBC TCK]: improve the ui layout for tck connector in studio
- TUP-35886 - Rename tck component unexpected result in studio
- TDM-9431 - Cannot create unit tests for tHMap (TPS-5218)
- TDM-9462 - Flattening map not working correctly for EDI 834 document
- TDM-9463 - TDM flattening map creation error with EDI 834
- TDM-9117 - Reload table Defintions for Database connection doesn't work
- TDM-9406 - [tHMap]Investigate renameData to see if the joblet connection can be traced to its corresponding main job connection
- TDM-9412 - Add Mariadb
- TDM-9423 - [tHMap]ClassCastException occurs when a WrapperStructure is used for a single InputStream output
- TDM-9456 - SAP IDoc importer creates elements with names starting with a digit
- TDM-9514 - Backport translated messages from 8.8.8 to the current 8.0.1 monthly
- TBD-6693 - Commenting last line of tJava prevents compilation
- TBD-12332 - [Spark Local 3.0.1] Compile error on job with tKinesisInputAvro component
- TBD-13939 - org.apache.spark.sql.AnalysisException: java.lang.NoSuchFieldError: out Hive Error with CDP 7.X Distribution
- TBD-14013 - Runtime exception on CDP Spark job when Date/Timestamp is used in tMap
- TBD-14110 - Runtime exception on tHCatalog components using EMR62 distribution
- TBD-14118 - Enable authentication properties in tGoogleCloudConfiguration
- TBD-14177 - java.lang.ClassNotFoundException: org.apache.hadoop.fs.ByteBufferPositionedReadable
- TBD-14207 - [7.3] Hadoop username is ignored when job has no Kerberos properties and hadoop-conf jar is used
- TBD-14268 - DBR 73 transient mode is changed to interactive after import 73DBR jobs
- TBD-14273 - Cannot import joblet successfully
- TBD-14279 - Compile error when run sparkstreaminglocalmongodbj01240_sparkjob2
- APPINT-34973 - Missing jar when running SOAP service in Studio with wsp:Policy in WSDL
- APPINT-34501 - Secure Jolokia and Spring-Boot actuator endpoints exposed by microservices
- TDQ-20725 - Reference project: Fixed the issue preventing from finding the Drools package
- TDQ-20698 - Fixed the issue preventing from running a Job using tMDMConnection and tSOAP
- TDQ-20718 - tHashInput: Limit of 65,535 bytes have been extended
- TDQ-20612 - UI improvement: Fixed the spelling of 'User-defined indicators'
- TDQ-20714 - Improved performances of the data mart persistent data
- TDQ-20694 - Azure Databricks table: Improved the performance to preview the column data for BD
R2022-08
New features in R2022-08
- TUP-29393 - Simplify the connection time out preference setting in studio
- TUP-33285 - [CI] Be able to specify the encryption key file
- TUP-35571 - Support "Install External software...." in Studio 8
- TUP-35963 - Context and global variables are not available in tELTSAPMap component
- TDI-46563 - Talend Component firing ANALYSE COMPRESSION command
- TDI-47833 - [Tech Preview] Workday Web Services input
- TDI-46737 - Print the deployment version into the job log
- TDI-47447 - include the modern authentification of Microsoft in tPOP
- TDI-47369 - include the modern authentification of Microsoft in tSendMail XOAUTH2
- TDQ-20279 - Batch DQ components: Support of Apache Spark 3.2 in local mode
- TDQ-20280 - Streaming DQ components: Support of Apache Spark 3.2 in local mode
- TDQ-20144 - Masking/Encryption components: A cryptographic key can be used as a password
- TBD-13957 - Tech Preview - AWS EMR 6.6.0 and above - Universal Spark 3.2
- APPINT-34664 - Support routes in "Cloud artifact" view
CVEs fixed in R2022-08
CVE-2022-34169 (xalan:xalan:2.7.2), impacted:
DQ libraries
CVE-2022-31159 (com.amazonaws:aws-java-sdk-s3:1.12.261), impacted:
DQ libraries
CVE-2022-2047 (org.eclipse.jetty:jetty-http:11.0.6), impacted:
DQ libraries
CVE-2022-2191 (org.eclipse.jetty:jetty-io:11.0.6), impacted:
DQ libraries
CVE-2022-33980 (commons-configuration2:2.1.0-2.7.0), impacted:
DI components
MDM components
Studio
SourceClear Premium (No CVE) (maven-core-3.8.3), impacted:
Studio
Build
DQ Components
DQ libraries
CVE-2021-40690 (xmlsec:2.1.2), impacted:
DI components
CVE-2021-22573 (google-oauth-client-1.31.0-1.31.5), impacted:
DI components
CVE-2022-23437 (xercesImpl-2.12.0.jar), impacted:
DI Components
CVE-2021-38986, CVE-2022-22321 (com.ibm.mq.allclient-9.2.4.0.jar), impacted:
DI Components
CVE-2022-26336 (poi-4.1.2-20200903124306modifiedtalend.jar, poi-ooxml-4.1.2-20200903124306modifiedtalend.jar), impacted:
DI Components
CVE-2022-26612 (org.apache.hadoop:hadoop-common:3.2.3), impacted:
BD Components
CVE-2022-29885 (tomcat-embed:9.0.62 jars), impacted:
APPINT Components
PRISMA-2021-0193 (flatpack-4.0.5.jar), impacted:
APPINT Components
CVE-2022-2048 (jetty:9.4.43.v20210629), impacted:
APPINT Components
CVE-2021-29425 (hadoop-core-1.2.1.jar), impacted:
studio
CVE-2018-10054 (com.h2database:h2:2.1.210), impacted:
Studio
Other issues fixed in R2022-08
- TUP-35863 - Upgrade: maven-settings:3.0
- TUP-35865 - Upgrade org.codehaus.woodstox:wstx-asl:3.2.4
- TUP-35909 - NullPointerException with "Select Context Variable” button
- TUP-36128 - tELTmap component error in Talend 8.0
- TUP-36192 - Talend 8 - Unable to Save Job
- TUP-36341 - Unable to run DQ reports with subjob+joblet on a cloud or remote engine
- TUP-36157 - Error when install Bigtable in studio: Illegal character in query
- TUP-36242 - [8.0.1] jobs changing Hadoop metadata distribution after changing project/branch
- TDI-48199 - SalesforceEinstein don't support dynamic now
- TDI-48093 - Google Drive component is not working with huge files.
- TDI-48203 - routines.system.JSONObject(Object bean) use reflect to call method invoke, that's dangerous for evil script inject
- TDI-47976 - Fix some potential NPEs in the javajet code
- TDI-48322 - Align javax.mail version to 1.6.7
- TDI-48221 - tDBBulkExec (MYSQL) Failing with error
- TDI-48024 - Performance issues when running job using jobserver after applying log4j2 patches.
- TDI-48082 - None of the tGreenplum components other then tGreenplumConnection has the additional JDBC Parameters option
- TDI-48254 - Encoding issues in tRSSOutput component
- TDI-48238 - tsamba gets issue when running job from TMC
- TDQ-20641 - tDataDecrypt: Fixed the issue preventing from using ";" in the input file
- TDQ-20362 - Analyses: Fixed the issue causing a column loss after renaming the JDBC connection
- TDQ-20485 - tRuleSurvivorship/tRules: Drools jars upgraded to 7.73.0.Final
- TBD-12926 - [EMR 6.2] java.lang.NoSuchMethodError error on Spark job with Hive table, which location is on S3
- TBD-13375 - NoSuchMethodError with tHiveInput when reading from external table on EMR 6.2
- TBD-13515 - Migration issue for spark job on EMR 6.2
- TBD-14018 - Getting error "org.apache.spark.streaming.pubsub.PubsubUtils cannot be resolved to a type" when using tPubSubInput component
- TBD-14020 - Caused by: java.lang.ArrayIndexOutOfBoundsException: in Talend 7.3.1
- TBD-14022 - [7.3.1] R2022-05 or higher tS3Configuration component check box "Inherit credentials from AWS" no longer works
- TBD-14108 - tMap - Compile error if output uses a Date with "yyyy-MM-dd HH:mm:ss" pattern
- TBD-14109 - Wrong field name in hCatalog components
- TBD-14115 - Filters and Expressions in tMap component throws error in Spark streaming job
- TBD-14117 - NoClassDefFoundError when I create CDP7 via retrieve from cloudera
- TBD-14121 - Compile error on statistics for Spark > 3.0
- TBD-14128 - Can't generate code when using tS3Config and distribution different than EMR
- TBD-14168 - Compile error when the DI job don't contain tHiveConnection and in batch/streaming jobs with spark universal 3.2
- APPINT-34738 - Integrate Talend-customized Microsoft MQ driver jar with improved native library loading
- APPINT-34755 - Use latest monthly patch version instead of 8.0.1-SNAPSHOT for Talend Runtime libraries
- APPINT-34916 - Compile error occurred when using tesbConsumer/tRESTClient + Dynamic Settings: Authentication Type default value
- APPINT-34876 - [CI]Return error page when access Prometheus url for route published via CI as Microservice
- APPINT-34902 - Align bouncycastle version to 1.70
- APPINT-34974 - routerExchangetRouteFault1 cannot be resolved
R2022-07v2
CVEs fixed in R2022-07v2
None
Other issues fixed in R2022-07v2
- TUP-36343 - Avoid possible installation issue of R2022-07 from CI.
- Spark - Fix compilation issue with date pattern using tMap
R2022-07
New features in R2022-07
- TUP-32040 - CI: Detect if project is at higher patch level than studio
- TUP-35208 - CI - Show project details when list projects from workspace
- TUP-30684 - snowflake Feature request to refresh the table schema instead of automatically refreshing all table schemas
- TDI-44990 - Support Dynamic Schema in MongoDB output components
- TDI-44761 - Algorithms Support by SFTP
- TBD-10175 - Support Datasets API in tMap - Spark Batch - Simple mapping
- TBD-12570 - Cloudera CDP Public Cloud Support IDBroker
- TBD-13184 - GA - Universal Spark 3.2.x for Databricks 10.x and above on aws and azure
- TBD-13825 - GA - Azure Synapse Spark pools with Azure AD Service Principal
- TDQ-19618 - Match Analysis: The View rows feature is now supported
- TDQ-19828 - tDataQualityRules: The component is now supported on Apache Spark Batch and Streaming (Local Spark and Cloudera)
CVEs fixed in R2022-07
CVE-2022-29599 (maven-shared-utils:3.2.1), impacted:
Studio
CVE-2021-26291 (maven-artifact-manager-2.0.6.jar, maven-artifact-manager-2.0.9.jar), impacted:
Studio
CVE-2016-2510 (bsh-2.0b4.jar), impacted:
Studio
CVE-2016-3506 (ojdbc6.jar), impacted:
BD components
CVE-2021-30468 (cxf-3.3.x), impacted:
BD Components
CVE-2022-25647 (gson-2.8.1.jar,com.google.code.gson:gson:2.2.4-2.8.5), impacted:
Studio
DI components
BD components
CVE-2021-29425| CWE-22 (commons-io-2.6.jar), impacted:
Studio bridge
DQ Components
CVE-2021-38153 (kafka-clients-2.0.0.jar, kafka-clients-2.4.1.jar), impacted:
DI components
CVE-2020-15250 (woodstox-core-5.1.0.jar), impacted:
DI components
MDM components
CVE-2022-24823 (netty-common-4.1.74.Final.jar), impacted:
APPINT components
CVE-2022-22970 (spring-core-5.3.19.jar), impacted:
Studio
DQ components
CVE-2020-36518 (jackson-databind:2.11.4), impacted:
MDM Components
Other issues fixed in R2022-07
- TUP-18979 - Migration tasks including mapping files
- TUP-31721 - CommonExceptionHandler ... is duplicated
- TUP-35513 - CI: Support nexus properties in local mode
- TUP-32331 - Import job pop up error when my branch named #branch
- TUP-35329 - CI: Support customize jvm arguments for p2 installation
- TUP-35942 - Job design will be reverted when changing a joblet name
- TUP-35637 - [Bug] some job of Project C and Project D are missing after run mvn package.
- TUP-35599 - SuggestionValues.Item support of user friendly UI label different from it's id
- TUP-35939 - tFileOutput components resulting in File not found error when selecting a file path for saving the output file
- TUP-35645 - Studio update git for nothing
- TUP-35948 - TP_ALL as cloud/on-prem license
- TUP-35774 - The prompt feature for context variables
- TUP-36107 - In Studio 8 Stats & Logs project settings are removed after enabling "Publish to artifact repository" feature
- TUP-35887 - "build job" working in 7.2.1 fails in 8.0.1: Failed to generate code : NPE org.talend.designer.dbmap.language.oracle.OracleGenerationManager.addQuoteForSpecialChar
- TDI-48004 - [TCK][Studio] Unable to run the ADLSGen2 in the Talend-runtime (OSGI Mode)
- TDI-48035 - Add "Use custom null marker" option to tBigQueryOutput
- TDI-47908 - 'Stats&Logs' can't handle 'java.lang.Error'
- TDI-48209 - Upgrade tCloudXXX components libraries.
- TDI-48159 - tSalesforceBulkExec json format can't work with force-wsc-53.0.0
- TDI-48117 - SAP Filters do not work with SAP FTP option for tsapinfocubeinput
- TDI-48115 - CosmosDB--->Action:Upsert with set not work as expected
- TDI-48104 - Oracle float field errors out while writing to Parquet file using Dynamic schema
- TDI-48043 - tFileOutputParquet sanitize field name for parquet schema
- TDI-47714 - [JDBC TCK]: "Use existed connection" ui appear in tjdbcoutputbulk if that component in tck jdbc family, need to avoid that
- TDI-47694 - [JDBC TCK]: Inject runtime context for tck connector runtime
- TDI-44576 - tMongodboutput: 'Update all documents' not work when 'Bulk write' with 'Set' or "Upsert and set" action on data
- TBD-13372 - knox: check service failed when using cdp 7.1.6.0-297 dynamic with knox
- TBD-13433 - Compile error when I run a simple spark streaming job with Yarn Cluster on EMR62
- TBD-13832 - [SPL32] Runtime exception on Streaming job with tAvroInput component
- TBD-13890 - Spark Job Execution fails with error "java.lang.IllegalArgumentException: Field "var1" does not exist"
- TBD-13907 - Missing Username Field in Spark configuration for CDP 7.X distribution.
- TBD-13925 - Missing library in spark streaming job from kafka
- TBD-13940 - Hive connection fails with org.apache.hadoop.security.UserGroupInformation
- TBD-13990 - [Patch R2022-05v28.0.1] tHiveConnection component doesn't generate code for urltHiveConnection variable definition
- TBD-13998 - Issue with Use Kerberos authentication checkbox in tImpalaConnection and tImpalaInput components
- APPINT-34807 - 'Publish to Cloud' from Studio 8.0.1 Last Cloud Version on moving a job from one folder to the other.
- APPINT-31958 - Wrong endpoint displayed in console message when using cRest/tRESTRequest
- APPINT-34694 - ClassNotFoundException when running routelet
- APPINT-34772 - Adding <b>VALUES</b> in tRouteInput throws exception
- APPINT-34729 - tRestClient/tESBConsumer Dynamic settings don't work with context variables
- APPINT-34693 - cAggregate must be updated to allow customer to configure "persistentFileName" and "levelDBFile" / "hawtDBFile" options
- APPINT-33559 - Requested screenshot is not available
- APPINT-34489 - Compile error when CI publish MS route with Prometheus as docker image
- TDQ-20481 - crypto-utils upgraded to 6.8.2
- TDQ-20322 - tDqReportRun: Improved the error message about analysis with no columns
- TDQ-20357 - tMatchGroup: A default length of output columns has been set
- TDQ-20547 - tMDMBulkLoad: bulkloadclient jar file upgraded to 6.3
- TDQ-18200 - New error message when Number of connections per analysis is invalid.
- TDQ-19435 - Match Analysis: Path as "D:/" is now allowed in the Store on disk field
- TDQ-19680 - User-defined Indicators: Fixed the issue letting users open two editors of the same UDI
- TDQ-20047 - tThresholdViolationAlert: Fixed the issue preventing from running a Job with Snowflake as data mart
- TDQ-20233 - tBRMS: The component can now run on JBoss BRMS 6.2 and Redhat BRMS 6.2
- TDQ-20574 - Failure to create an artifact task
R2022-06
New features in R2022-06
- TUP-27797 - Need Auto Commit feature to be disabled during new branch creation
- TUP-35399 - Improve Studio update notification
- TUP-33085 - Add Icon(s) to open Help
- TUP-35301 - [JDBC TCK]: Support MODULE_LIST field for studio tck plugin
- TUP-34855 - Setup custom JKS for job signature from GUI
- TUP-34931 - Support Sybase 17
- TUP-35192 - Hide the Debug->Modules from show view
- TUP-28853 - Documentation does not show picture preview in HTML documentation
- TUP-33929 - [CI] Enhance generateAllPoms for circular projects
- TDI-44884 - Support Sybase 17
- TDI-46323 - Allow Couchbase to be used with AD account/user
- TDI-47297 - Add Put & Get & Delete components for AzureAdlsGen2
- TDI-47398 - tMicrosoftCRM Components: Upgrade ADAL to MSAL
- TDI-47984 - Align hadoop-common 3.2.3 for tFileORC/Parquet
- TBD-12132 - Tech preview - Databricks 10.0.x on Google with Universal Spark 3.2.x
- TBD-12165 - Support Canned ACL for Cluster conf logging - S3 / Databricks
- TBD-13208 - Customer is looking to configure 2 tAzureFSConfiguration in the same job
- TBD-13424 - Upgrade Redshift driver to v2.x for all Redshift components (batch & streaming)
- TBD-13823 - GA - Universal Spark 3.2 local mode
- TBD-13824 - GA - Apache Spark 3.2 standalone
- TBD-13836 - Tech preview: CDE 1.15: QA/Test with Spark 3.2 on AWS and Azure
- APPINT-34622 - tRestClient // Proxysettings don't work with context variables
- APPINT-24774 - POST/PUT operations when importing API in tRESTRequest should declare a body parameter
- TDQ-20295 - DQ Streaming components: Support of Databricks with Apache Spark 3.1
- TDQ-20296 - DQ Batch components: Support of Databricks with Apache Spark 3.1
CVEs fixed in R2022-06
CVE-2018-10237 (guava-24.0-jre.jar,guava-25.1-android.jar), impacted:
studio
CVE-2022-21724 (postgresql-42.2.14.jar), impacted:
metadata
DI components
DQ components
CVE-2022-21449 (nimbus-jose-jwt-8.11.jar), impacted:
DI components
DQ Libraries
CVE-2019-16869 (core-io-1.6.2.jar), impacted:
DI components
CVE-2022-25647 (gson-2.8.6.jar), impacted:
DQ Libraries
CVE-2022-24823 (netty-common-4.1.59.Final.jar,netty-all-4.1.59.Final.jar), impacted:
DQ Libraries
CVE-2021-23926 (xmlbeans-2.3.0.jar,xmlbeans-2.6.0.jar), impacted:
studio
CVE-2021-29425 (commons-io-2.6.jar), impacted:
studio
SourceClear Premium(No CVE) (mongo-java-driver-3.12.8.jar), impacted:
DI Components
CVE-2022-22970 (spring-messaging-5.3.19.jar), impacted:
APPINT components
Other issues fixed in R2022-06
- TDI-46054 - Unable to run MSCRM OnPremise 2015
- TDI-47731 - Component tdbRow(Snowflake flavour) does not return output when executing an ELT SQL
- TDI-45946 - timetz and timestamptz was not do mapping for the DB Type
- TDI-47879 - tExtractJSONFields NB_LINE name not updated
- TDI-47989 - tFileInputParquet throwing error with Dynamic schema
- TDI-47975 - [TCK][Studio]Guess schema fail when reading Delta format for tAzureAdlsGen2Input Shared Access Signature
- TDI-47895 - Exception in component tDBOutput_1 when retrieving the FLOAT datatype from the Oracle Database using Dynamic schema type.
- TDI-47951 - Redshift components throw NPE when set password property value null
- TDI-48101 - tSAPTableeInput duplicate alias issue for dynamic
- TDI-48069 - Wrong value for the redshift of driver 2 version on tRedshiftBulkExec
- TDI-47803 - Compile error after applying Patch20220107R2022-01_v1-7.3.1
- TDI-47997 - [JDBC TCK]: can't get user defined schema info in tck runtime in studio
- TDI-47932 - EncryptClientSecretMicrosoftCRMMigrationTask returns wrong value
- TDI-46827 - Use of RandomStringUtils in NsTokenPassport.java is not secure
- TUP-28879 - JDBC metadata's modification cannot be porpagated to components(Which use the metadata)
- TUP-35371 - [801 Studio] switching branches fails without errors when a job is open
- TUP-35413 - Hadoop metadata connection with context variables encountered NPE : Problems occurred when invoking code from plug-in: "org.eclipse.jface"
- TUP-31233 - Routine pom is not updated after installed the required jar of user routine
- TUP-35611 - detectCVE: SystemRoutine doesn't exist in cveindex.csv in 731-2022-R05
- TUP-35518 - Talend Studio 7.3 R2022-03 Linux(CentOS) - Designer UI Issues
- TUP-35608 - Stat and Logs screen - Database connection dropdown incorrect
- TUP-35531 - Default test branch name is wrong if update and additional features are required
- TUP-35598 - Studio throw java.lang.OutOfMemoryError: Metaspace after do retrieve schema for redshitsso.
- TUP-35613 - Can't display the dataset settings of AzureAdlsGen2 metadata wizard with CSV format in default GUI size
- TUP-33655 - Improve Git pull & Merge if current branch and target branch are on different monthly update.
- TUP-35633 - 'Use local Update settings' checkbox should not be displayed in studio update settings when TMC update config is not set for the project.
- TUP-35585 - Zero install fail to install custom tck component in 801.
- TUP-35556 - Handle demo feedbacks for update from TMC
- TUP-35683 - doc use job for route, joblet for routelet
- TUP-35508 - Better to improve context prompt for JDBC
- TUP-35539 - Netsuite: parent node show as "Items missing parent node (Deprecated)" after import or do delete the datastore directly.
- TUP-35193 - Using "-DitemFilter" in the pomGeneration process doesn't generate the poms required
- TUP-35326 - [JDBC TCK]: can't pass table value to runtime when use existed connection
- TUP-35885 - With Git repository name GD customer gets randomly "Failed to create the part's controls" error
- TUP-35806 - Studio can't complete the update if the process is broken
- TUP-35974 - Even Studio installed patch version higher than what set in "update URL", studio still could get the update available info
- TDM-9424 - Structure which create from xsd file export avro/csv get error
- TDM-9454 - Combination of distinct and filtering on same loop does not work
- TDM-9428 - Greater function does not work with numbers
- TDM-9426 - Support Spark 3.2
- TDM-9304 - Incorrect imported structure from JSON with choice
- TDM-8597 - Optimize export wizard of 'CSV export' and 'avro export'
- TDM-9344 - JSON Writer:optional element don't have value needn't show when test run
- TDM-9338 - Execution status print twice with the new runtime
- TDM-9460 - tHmap hangs while generating code while mapping from IDOC to UBL xsd
- TBD-12250 - tRestWebServiceOutput has compile error on DBR7.3 (Streaming job)
- TBD-12251 - tRestWebServiceLookupInput has compile error on DBR7.3 (Streaming job)
- TBD-12327 - tKinesisOutput has compile error on dbr7.3 and other distributions
- TBD-13149 - Cleanup DI Hive component
- TBD-13423 - [spark streaming] it gets NoSuchMethodError: java.nio.ByteBuffer.rewind()Ljava/nio/ByteBuffer when write bytearray
- TBD-13600 - Issue with tFileInputXML component in Big Data Spark Job
- TBD-13605 - [EMR 5.29] Compile error on Spark job with Snowflake components
- TBD-13706 - Runtime exception when I run attachment job with spark local 24
- TBD-13717 - Compile error on tRestWebService Input/Output component
- TBD-13814 - Log4j:ERROR Could not instantiate class [org.apache.hadoop.metrics.jvm.EventCounter]
- TBD-13830 - java.lang.ClassNotFoundException: org.apache.hadoop.fs.ByteBufferPositionedReadable
- TBD-13852 - NoClassDefFoundError when I run di job with hive components
- TBD-13882 - Compile error for Teradata components on spark local 2.4
- TBD-13897 - Missing jars for EMR 6.2.0 hive jdbc connection
- TBD-13905 - Compile issue with tFileInputXML component in Big Data Spark Job Synapse CI
- TBD-13954 - streaming/hive: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient when using spark standalone 3.2
- TBD-13983 - Canned ACL/UI: "Log Delivery right" in dropdown list is wrong
- TBD-13984 - ClassNotFoundException when I run spark streaming job with RedshiftLookupInput V2
- TBD-13987 - tFileInputXML can't read from s3 using full uri
- TBD-13991 - Hive metadata cannot be created for EMR 62
- TBD-14004 - NoSuchMethodError when I run spark batch job with redshift components with EMR62
- APPINT-34565 - Migration issue - Wrong statement displayed for tRESTClient timeout parameters
- APPINT-34610 - tRouteFault no longer supported
- APPINT-34618 - sqljdbc_auth.dll already loaded in another classloader
- APPINT-34575 - "Use Selected Routelet Context" not work as expeced for routelet
- TDQ-19623 - tDqReportRun: Fixed the issue preventing from using analysis and database from the reference project
- TDQ-20360 - Snowflake with JDBC connection as a context model: Fixed the error causing to upload JAR file manually
- TDQ-20369 - PostgreSQL: Fixed the issue causing datamart and view tables to be generated under the wrong schema
- TDQ-20476 - Match analysis: Fixed the issue preventing from running the analysis when Store on disk is selected
- TDQ-20245 - tRecommend: Fixed the issue preventing from using the component on Apache Spark 2.4 and 3.0 local mode
- TDQ-20479 - PostgreSQL database: Fixed the issue preventing from running an analysis with Available Internet patterns
R2022-05
New features in R2022-05
- TUP-34889 - Support to prompt Context on Metadata Connection
- TUP-28953 - Spark Big Data/streaming job are missing "open another version" action
- TUP-32821 - Credential property value in json format in tck framework
- TUP-33928 - Controlled Studio Updates from TMC
- TDI-45629 - tFileOutputJSON: Enabling Dynamic Datatype Support
- TDI-45870 - tWriteJsonField / tFileOuputJSON to avoid scientific notation for numbers
- TDI-46162 - Google Analytics for Studio
- TDI-47820 - Enhance Dynamic support for tSAPTableInput to use the RFC Server
- TDI-43829 - Add support for zip4j 2.x libraries to tFileArchive/unArchive components
- TDI-47152 - upgrade httpclient 3.x to httpclient 4.5.13 for tFileFetch component
- TBD-13476 - Tech preview - Universal Spark 3.2.x for Databricks 10.x and above (interactive & transient) - AWS & Azure
- TBD-13581 - [BUG]tHiveConnection doesn't support spark 3.1.x dataproc 2.0.x
- TBD-13687 - DeltaLake API version to align with Databricks Runtime
- APPINT-34469 - Detect CVE for Route
- APPINT-34429 - Add missing password decryption support for microservice builds
- APPINT-34382 - cSetHeader now allows headers removal
- TDQ-20293 - Made some Batch components support Apache Spark 3.1 in local mode
- TDQ-20294 - Made some Streaming components support Apache Spark 3.1 in local mode
CVEs fixed in R2022-05
CVE-2021-43859 (xstream-1.4.18.jar), impacted:
DI Components
CVE-2019-12415 (poi-ooxml-4.0.1.jar), impacted:
DI Components
CVE-2021-43797 (netty-codec-http-4.1.68.Final.jar), impacted:
DI Components
CVE-2020-36518 (jackson-databind:2.10.5.1,2.11.4,2.12.0,2.12.1), impacted:
DI Components
Studio
DQ Libraries
CVE-2016-2183 (org.bouncycastle:bcprov-jdk16:1.46), impacted:
Studio
CVE-2022-22968 (org.springframework:spring-context:5.3.18), impacted:
APPINT Components
DQ Components
Studio
CVE-2022-26612 (org.apache.hadoop:hadoop-common:3.2.1), impacted:
DI Components
DQ Libraries
SourceClear Premium(No CVE) (org.ops4j.pax.url:pax-url-aether:2.6.2), impacted:
DI Components
Other issues fixed in R2022-05
- TDI-46061 - tNeo4jv4 --> log lever set too low, should not display the info log in console when running the job.
- TDI-47779 - Tableau Output is throwing a NPE when processing a null value
- TDI-47802 - "Parameter Type Conflict" reported when using tOracleSP component with CLOB/AUTO-MAPPING
- TDI-47772 - Snowflake Output - precision with "0" produces error on create table
- TDI-47736 - [TCK][Cosmos] Unable to run like clause with the tCosmosDBSQLAPIInput in Windows 10
- TDI-47338 - [Java 17] Unable to open the tJDBCInput jobs created after 731 R2021-08
- TDI-47426 - [TCK] [AWS DocumentDB] --> tDocumentDBConnection will not check in runtime
- TDI-47519 - Kafka use Existing connection with SSL/TLS conflicts with schema registry settings
- TDI-47810 - [7.3.1] Talend Studio : JDBC component UI refresh performance issues
- TDI-46924 - Deprecate the version of 'sap jco 3.* ' for tSAPConnection
- TDI-46733 - SAP components parameter group name misleading issue
- TDI-47819 - tJDBCInput component results in error with Dynamic schema inTalend latest versions.
- TDI-47257 - tELTOracleOutput does not print messages during execution unlike other tELT*Output components
- TUP-34109 - [7.3.1] slow project export compared to studio 6.5.1
- TUP-35219 - Nullpointer exception with building job on commandline-script mode
- TUP-34508 - Upgrade CXF-3.3.X to 3.4.4
- TUP-35154 - Incorrect display of localized UI elements
- TUP-35368 - DetectCVE: tRESTRequest cannot be deteced in report
- TUP-35048 - Job takes about 30-60 minutes to build in Studio
- TUP-35505 - Listing of Preparations fails with Talend 8.0.1 R2022-04 Release
- TUP-35248 - Context password exposed when hovering over context on Talend 8
- TUP-35078 - tJDBCSCDELT does not work correctly on Snowflake
- TUP-33119 - SuggestionValues.Item label is received at runtime instead of id when used inside table
- TUP-35049 - Talend 7.3.1 is not restoring joblet from older version to new version
- TUP-35252 - Additional parameter can not update to the job after modified
- TUP-35315 - Redshift SSO support driver 2.x
- TUP-35538 - failed to run job when studio is Chinese on R04
- TUP-35142 - Using "-" in at the beginning of passwords for TAC users cannot be parsed by Commandline
- TUP-32889 - Credential value with double quotes in tck framework
- TUP-35400 - Save snowflake metadata failed when selected table name start with number
- TUP-35541 - log4j-1.2.17 is used in mssql and SAS metadata
- TDM-9425 - [tHMap]Save and cleanup MapExecutionCommand and OutputResults in local concurrentHashMap
- TDM-9408 - [tHMap]Save the Execution Status and Severity in the local globalMap
- TDM-9298 - Remove Importer for java classes and JAR files
- TDM-9380 - Remove DirectoryExecMapRuntimeImpl
- TDM-9313 - Structure with choice recursive data can't parse right in map
- TDM-9290 - Position reported by JSON Importer on errors is sometimes offset by 1
- TDM-9303 - Optimize MapExecutor usage in tHMap
- TDM-9405 - ConcurrentModificationException - on job data as service in runtime ESB
- TBD-13324 - Talend Job to add partitions on S3 glue table fails after the patch update to R2021-09
- TBD-13488 - Parquet files are not created with Snappy or Gzip compression
- TBD-13511 - [7.3] extra column in schema vs hive sql using thiveinput (Patch: R202201-log4j) error out
- TBD-13622 - spark job that use hive component can't run success when I set yarn cluster mode for EMR529
- TBD-13653 - [EMR 6.3] Runtime exception on Spark job with Hive components
- TBD-13702 - Migration from v7.0.1 to v7.3 , incorrectly sets 'Action' parameter in hdfs components
- TBD-13744 - THDFSoutput does not keep the ACTION status
- TBD-13753 - [8.0.1] When using Spark CDE jobs with dynamic context the job doesnt leverage the context values
- TBD-13812 - CDP7.1.7.0-551 dynamic distribution missing config guava-28.1-jre.jar while testing Hadoop cluster connection
- TBD-13377 - [7.3.1] Spark EMR job perf issue when migrating from R2021-02 to R2021-09
- APPINT-34523 - Issue with tRestRequest component when Multipart is being selected
- APPINT-34578 - MDM components causing 'java.lang.ClassNotFoundException: com.sun.xml.internal.ws.spi.ProviderImpl' in SOAP Service
- APPINT-34620 - Missing libraries after upgrading to Talend 8.01-R2022-04 Release
- APPINT-23838 - Missing required query parameter cause Server error HTTP 500 with tRESTRequest
- APPINT-32309 - Diff rest endpoint when dropping API definition from metadata view (tRESTRequest)
- APPINT-32536 - Fail to Run Microservice when context include Date type
- APPINT-34474 - HawtDBAggregationRepository has to be replaced by LevelDBAggregationRepository in cAggregator
- APPINT-34497 - Message showed twice when switching from built-in to property in tRESTRequest
- APPINT-34539 - Routelet is not working with Use Route Context Name
- APPINT-34569 - Job including tRESTand tRESTClient deployed to runtime gives error: com.sun.jersey.api.client.ClientHandlerException
- APPINT-34604 - Issue deploying a micro-service to RE
- APPINT-34565 - Wrong statement displayed for tRESTClient timeout parameters
- APPINT-34570 - Compile error about setAccessToken(String) when import tRESTclient model with OAuth2 authentication from 731
- TDQ-20303 - Melissa Data components: Fixed the issue preventing from getting failure info in the Stats and Logs tables as configured in Project Settings
- TDQ-20304 - tMDMBulkLoad: Fixed the dependency issue from R2022-04
- TDQ-20206 - tDqReportRun: Improved an error message
- TDQ-20297 - Characters handling functions: Fixed the issue causing the result to be the same when using different algorithms
- TDQ-20299 - tDqReportRun: Fixed the issue preventing from running Jobs in parallel
- TDQ-20301 - Components: Improved the jar files by improving the mvn path
- TDQ-20065 - CVE: CXF 3.3.X upgraded to 3.4.X
- TDQ-20315 - Tested and confirmed that CSV files can be profiles on ADLS and S3
R2022-04
New features in R2022-04
- TUP-34516 - CI - ZeroInstall: Refactor CI builder to prepare for publish it to public repository
- TUP-33038 - [CI] Improve the P2 installation process
- TUP-32273 - CI: when installation is present and license expired CI should update the license based on -Dlicense.path
- TUP-31734 - Prompt users to Test patches when migrating projects
- TUP-34849 - Support retrieve SAP ADSOs metadata for provisioning
- TUP-35069 - Upgrade Redshift driver to v2.x
- TDI-47211 - Upgrade Libraries for Ms-SQL Server - Support for MSSQL Database 2019
- TDI-45052 - connect SAP BW4/Hana (tSAPADSOOutput)
- TDI-43313 - Dynamic suppport for tSAPTableInput
- TDI-47565 - Add List, Delete, Properties to SMB components v2/3
- TDI-46111 - [7.1] Security vulnerabilities with Teradata 16 drivers
- TDI-47263 - Upgrade Redshift driver to v2.x
- TUP-34896 - support teradata jdbc version 17
- TUP-34929 - Upgrade Libraries for Ms-SQL Server - Support for MSSQL Database 2019
- TDQ-20141 - Data privacy components: Security enhanced for masking data using PBKDF2 with 300,000 iterations
- TBD-13105 - Support using multiple tGSConfiguration in spark jobs
- TBD-13185 - Make the universal spark 3.2.x plugin able to run spark local jobs
- TBD-13328 - Tech preview - Azure AD Service Principal for Azure Synapse Spark pools configuration in Spark job
- TBD-13391 - GA - Spark Universal 3.1.x for AWS EMR 6.3.x / 6.4.x / 6.5.x
- TBD-13504 - Smoke test - CDP Public Cloud + KNOX + Impala
- TBD-13517 - Tech preview - Support Open Source Apache Spark Standalone cluster with Spark 3.2.x
- TBD-13522 - GA Cloudera CDE on AWS
- TBD-13632 - GA - Universal Spark 3.1.x for Google Dataproc 2.0.x and above
- TBD-13685 - GA - Universal Distribution with Spark serverless 3.1.x - Databricks Transient cluster
CVEs fixed in R2022-04
CVE-2021-35517 (commons-compress-1.19.jar), impacted:
metadata bridge
CVE-2021-33813 (jdom2-2.0.6.jar), impacted:
DI Components
CVE-2021-30129 (sshd-core-2.7.0.jar), impacted:
DI Components
CVE-2021-22569 (protobuf-java-2.5.0.jar,protobuf-java-3.4.0.jar), impacted:
DQ Components
Studio
CVE-2019-4055 (com.ibm.mq.allclient-8.0.0.9.jar), impacted:
DI Components
CVE-2020-36518 (jackson-core-2.11.4/2.12.0.jar,jackson-databind-2.11.4/2.12.0.jar), impacted:
Build
APPINT Components
CVE-2021-38153 (kafka-clients-2.8.0.jar), impacted:
APPINT Components
CVE-2021-22096 (spring-core-5.3.8.jar), impacted:
APPINT Components
CVE-2022-23305 CVE-2022-23302 CVE-2021-4104 CVE-2019-17571 (log4j1.x), impacted:
DI Components
DQ Components
BD Compoents
Studio
CVE-2017-5929 (logback-core-1.0.9.jar,logback-classic-1.0.9.jar), impacted:
DI Components
CVE-2021-30468 (cxf-3.3.x), impacted:
DI Components
Studio
SourceClear Premium(No CVE) (org.ops4j.pax.url.mvn_2.6.2.Talend.jar), impacted:
Studio
Other issues fixed in R2022-04
- TUP-34337 - [CI] Enable timeout settings when fetching files from P2 repository
- TUP-35133 - Run a job with subjob failed after applied a patch with new version of CI-Builder
- TUP-34716 - can't get the right "ACTIVEDATABASEDELIMITED_IDENTIFIERS" property value in tELTMap in javajet
- TUP-35238 - Drag and drop Redshift metadata to list components lost some components
- TUP-34930 - Talend Studio 7.3 font color issues
- TUP-34645 - Send username and password via http request body
- TDI-47428 - Job is OK and no relevant error or warning on component when Table name is not defined in tDBOutput (JDBC)
- TDI-47452 - Error when generating a job with tXmlMap , if a field contains some special characters
- TDI-47073 - tBigQueryOutput component needs right description
- TDI-47287 - tFTPPut - throws null pointer exception when no existing file
- TDI-47608 - [TCK][Tableau] Since the "Data source name" field is mandatory, we should keep it display at the beginning
- TDI-47651 - Redshiftoutput component takes more time to insert
- TDI-47560 - tSybaseOutput error if the input data is in the BigDecimal Type with Length and Precision definition
- TDI-47641 - Issue Pulling data from NetSuite CreditMemo and Invoice Record Type
- TDI-47670 - tFileInputXML: result of XPath "count" depends on XML formatting
- TDI-47725 - tDBOutput returns counter NB_LINE = 0
- TDI-47539 - Microsoft CRM: change application secret as a password field
- TDI-47538 - tAzureAdlsGen2Output component converts BigDecimal to String
- TDI-47649 - ngdbc.jar shouldn't be required when tSAPADSOInput uses connection type 'SAP JCO3'
- TDI-47687 - tSCP component reuse session
- TDI-47404 - Upgrade CXF-3.3.X to 3.4.4
- TDI-47589 - "Write Excel 2007 format" leads to tFileOutputExcel poor performance
- TDI-47201 - Studio not connecting via proxy when snowflake connection uses oauth
- TDI-47496 - Column names in a main query are not enclosed when enabling "Delimited identifiers"
- TDI-46584 - tServiceNowInput Limit disable option in Advanced settings not working
- TUP-27413 - SQL Builder: Graphical Editor is Empty for a specific table
- TUP-34378 - Job could build out successfully if contains component which cannot be loaded
- TUP-34994 - Retrieve schema pop up error for my imported mongoDB
- TUP-35034 - CI - stop the build if custom component is missing
- TUP-34989 - DetectCVE: Some indexes are missing in cveindex.csv
- TUP-34822 - [bug] Forward slash in path of -DcveIndexFilePath and -DcveReportFilePath cannot be recognized correctly
- TUP-35180 - [CI] detectCVE can't use relative paths
- TUP-34987 - Identify Jobs having CVEs remediated improvement.
- TUP-35020 - Unable to ask for the feature manager to install the plugin for the new TCK connectors
- TUP-35191 - Receiving error popup: netsuite can't be deployed when the feature is installed
- TDQ-20255 - Microsoft SQL Server: Libraries upgraded
- TDQ-19622 - Analysis from Hive connection: Fixed the issue causing the tables to be displayed twice in the Column selector wizard
- TDQ-20110 - tDqReportRun: Fixed the issue causing some jars to be installed
- TDQ-20185 - tPatternMasking: Fixed the issue causing the NoClassDefFoundError
- TDQ-20222 - Reports: Fixed the issue preventing from running a report on a Cloud or Remote Engine
- TDQ-19997 - Git project: Fixed the issue causing the NullPointerException error when editing the file connection
- TDQ-20209 - (Un)Masking components, Apache Spark Streaming: Fixed the issue preventing from unmasking data to initial data when the tweak is invalid
- TDQ-19768 - tDqReportRun: Fixed the issue causing the Job to fail when using a match analysis with the Custom Matcher
- TDQ-20234 - tDqReportRun: Fixed the duplicate records issue for snowflake as datamart when parallelize running
- TDM-9394 - [tHMap]Deactivated output connection loses its metadata table
- TDM-9285 - [tHMap]Using a tUnite as an output connection causes an NPE during code generation
- TDM-9334 - With Flat representation Decimal property is not working as expected
- TDM-9278 - [OldRuntime]Execution status is accumulated when there are multiple executions for a tHMap
- TDM-9359 - Get npe when click thmaprecord/thmapinput which used in joblet
- TBD-12119 - Inherit credentials option in tS3Configuration should be hidden for all distributions except EMR and Databricks (AWS)
- TBD-13500 - Spark tFileInputDelimited ExtractDelimited_Function.call NumberFormatException
- TBD-13587 - CDP Private Cloud/Public Cloud: Add zookeeper libraries to HiveServer2 HA components for standard components
- TBD-13619 - Job fails with error java.lang.IllegalArgumentException: Field "WGTCHARGEABLE" does not exist with Patch R2022-02v1-7.3.1
- TBD-13645 - [Talend 8.0.1] Hbase component has compiler error in spark job
- TBD-13681 - Authentication with IDBroker failed when running spark job with S3 on CDP PC AWS
- TBD-13701 - Fail to generate code when job uses tMap with advanced expressions
- TBD-13730 - Compile error on tHDFSConnection on DI job with ERM62 cluster
- TBD-13737 - The thdfsconnection doesnt include Hadoop-Auth jar in the build for CDP 7.1.1 inbuilt distribution
- TBD-13739 - [8.0.1-R2022-03] Code is not generated for Spark Big Data Jobs with component tCassandraOutput
- TBD-13740 - [7.3.1-TPS-5153] TalendDate.getPartOfDate function fails with error Syntax error on token "YEAR", invalid AssignmentOperator
- APPINT-34485 - No task created when publishing a SOAP Service to Cloud from Studio 8
- APPINT-33991 - [Ubuntu20] API definition mapping could not be shown in cREST in Ubuntu20
- APPINT-34277 - Cannot create two AMQP Connections in same route
- APPINT-34296 - Error show in error log when publish a new created job not committed and pushed
- APPINT-33830 - Wrong statement displayed for tRESTClient timeout parameters
- APPINT-34414 - Build Route as MS ZIP will package useless joblet/code folders in ZIP root
- APPINT-34443 - Jar mismatch issue when using trest and tresclient in Talend Runtime
- APPINT-34398 - Failed to build route as Microservice when enable Prometheus
- APPINT-34491 - Missing jar when running SOAP service in Studio
- APPINT-34517 - Limit microservices available endpoints to info, health and jolokia
- APPINT-34547 - Failed to run route with cMQConnection (AMQP)
R2022-03v2
CVEs fixed in R2022-03v2
CVE-2022-22950 CVE-2022-22965 (spring-core), upgraded to version 5.3.18, impacted:
APPINT Components
DQ Components
BD Compoents
Studio
Other issues fixed in R2022-03v2
- APPINT-34517 - Limit microservices available endpoints to info, health and jolokia
R2022-03
New features in R2022-03
- TUP-33406 - Identify Jobs having CVEs remediated
- TUP-34545 - [CICD] builder-maven-plugin:7.3.4:generateAllPoms seems to not take in account Project filter
- TUP-33990 - Pendo tracking for Studio integrations with API Designer & API Tester
- TUP-33202 - Use new mapping for Cassandra driver version 4 in metadata.
- TDI-46441 - Upgrade Cassandra driver to latest (4.12) to support latest version of Cassandra
- TDI-47154 - send exception info for audit log
- TDI-47136 - Upgrade snowflake JDBC driver 3.13.14
- TBD-12969 - Tech preview - Cloudera CDE experience on AWS with the Universal Distribution (Data Engineer)
- TBD-12854 - Support for AWS EMR 6.3.x / 6.4.x and 6.5.x with Universal Spark 3.1.x as technical preview (yarn distrib)
- TBD-13256 - Tech Preview Spark Universal 3.1 for Databricks transient cluster only
- TBD-13468 - GA - CDP Public Cloud DataHub with Knox
- TDM-8112 - JSON Schema to support on creating structures
- TDM-9033 - Add representation options to reduce size of JSON output
- TDQ-20069 - tDataQualityRules: Improved the component
- TDQ-19889 - Analyses and reports: Enabled the prompt to use context variables from Profiling perspective
- TDQ-20094 - tDataMasking/tPatternMasking: New option Use a column containing the tweaks to use an input column to provide the tweaks
CVEs fixed in R2022-03
CVE-2021-36373 (ant-1.10.9.jar), impacted:
DI Components
CVE-2012-5785 (axis2-kernel-1.8.0.jar), impacted:
DI Components
CVE-2021-22569 (protobuf-java-3.4.0.jar), impacted:
DI Components
CVE-2022-23221 (h2-2.0.206.jar), impacted:
Studio
CVE-2022-23437 (xercesImpl-2.12.0.jar), impacted:
Studio
CVE-2022-23305 (log4j-1.2.17.jar), impacted:
Build, Deploy job
CVE-2021-43859 (xstream-1.4.18.jar), impacted:
APPINT Components
DQ Libraries
Studio
CVE-2021-43797 (netty-codec-4.1.68.Final.jar), impacted:
APPINT Components
CVE-2021-22096 (spring-core-5.1.18.RELEASE.jar), impacted:
Studio
Other issues fixed in R2022-03
- TDI-47385 - tMap error when tenary operator is used in join condition of column with Date type
- TDI-47436 - tPostgreSqlOutput doesn't support dynamic column with upsert
- TDI-47437 - tPostgreSqlOutput can't support additional columns column with upsert
- TDI-47435 - tPostgreSqlOutput compile errors when 'Debug query mode' and 'Upsert'
- TDI-47440 - Cannot connect to Salesforce with password starting with double-quotes
- TDI-47477 - Issue with tExtractPositionalFields in 7.3.1 version
- TDI-46768 - [TCK][Studio] Unable to run ADLSGen2 in the ESB runtime (OSGI Mode) with 731 R2021-09
- TDI-47524 - tPostgreSqlOutput can't work when columns include dynamic and replace one non-dynamic column
- TDI-47401 - MSSQL database getting data as "True" and "false" instead of "0" and "1"
- TDI-47493 - tSAPInfoObjectOutput can't handle medium and long texts
- TDI-47230 - OOM caused by org.talend.transform.runtime.lib.MapExecutorImpl From tHmap
- TDI-46642 - Observability: connector_label is not correct
- TDI-46789 - tMSSqlOutputBulkExec cannot work with server on Linux platform, where as tMSSqlBulkExec can
- TUP-35003 - DetectCVE: One not fixed item always show in report
- TUP-34791 - Add project reference to Project Login Pendo tracking
- TUP-28898 - Drag Exasol connection to a job choose tDBOutput(Exasol) not work as tExasolOutput
- TUP-34652 - Sybase CDC query that is generated groups by all columns
- TUP-34769 - Error fields for Rejects get dropped from tSalesforceOutput after Sync Columns
- TUP-34593 - Cannot connect to Salesforce with password starting with double-quotes
- TUP-34609 - Cannot retrieve Module Name in tSalesforceInput with password starting with double-quotes
- TUP-34427 - Resource:"The system cannot find the path specified" error shows if build job first then run job and job calls child job which using resource
- TUP-33120 - Button appears cropped in License Window
- TUP-32950 - On Ubuntu 18.04.5 documentation comment is displayed as a black box in Talend Studio designer tab
- TUP-30599 - tMap drag and drop does not work seamlessly in Linux GUI as it does in Windows
- TUP-33381 - Remove all the logs related to other OS
- TBD-13437 - "Inherit credentials from AWS" option in tS3Configuration component for S3 authentication not working
- TBD-13493 - Hive connection failed in Talend 8 with CDH 7.1.6
- TBD-13649 - Error shows after trying to open a specific spark job
- TBD-13657 - Dataset<DS_out_53AvroRecord> is not applicable for the arguments
- APPINT-33070 - tRestClient Accept Multipart results in row1 code generation error
- APPINT-34318 - Deployment in Runtime fails with - "javax.xml.transform.stream.StreamSource@541b668d'. Use a StreamSource or ObjectSource"
- APPINT-33481 - Cannot auto create component: jetty when execute microservice jar of chttp
- APPINT-33781 - Build KAR and browse with sub-directory having same name as route
- APPINT-33965 - Replacement of ScriptEngine nashorn for safer alternative
- APPINT-34310 - Unexpected "lib" folder at root of ZIP microservices builds
- APPINT-34330 - Not able to publish a DI job through CICD when it contains tRestClient
- APPINT-34332 - Redirection to wrong preference page using link in API creation wizard
- TDM-9308 - Improve blacklist mechanism for JSON Schema import
- TDM-9302 - Performance Issues with Talend Jobs after applying Talend Studio Patch R2021_12, suspecting tHMap
- TDM-9263 - Mapping builds fine in Studio, but fails within CI
- TDM-9261 - run DI job return NPE error
- TDM-9257 - XQuery code generation fails with NPE when function is incomplete
- TDM-9255 - [tHMap]Regression: Map creation wizard shows an error when no input is connected
- TDM-9254 - JSON default alternative matcher should accept integer as exact match for Double/Float
- TDM-9224 - Infinite Loop in AvroSchemaUpdater
- TDM-9215 - Fix numeric enumeration in avro export/import completely
- TDM-8954 - Cobol level 88 exported as avro schema and imported again looses numericity
- TDQ-20053 - Simple Analysis: Fixed the error preventing from creating a Simple Analysis from a Parquet format file
- TDQ-20106 - Report: Fixed the error preventing from running a report from a Basic Column Analysis
- TDQ-19508 - tMatchGroup with T-Swoosh algorithm: Improved the interface to inform about Sort the output data by GID in Multi-passing mode
- TDQ-20184 - Job generated from report: Fixed the issue causing a Data Integration child Job containing tFileInputExcel to fail
R2022-02
New features in R2022-02
- TDI-46964 - Google Drive: Correct way to guarantee that resource is created onsubjobok
- TDI-47199 - Couchbase v7 in Studio
- TDI-45863 - Capability to manage files using Samba v2 or higher
- TDI-41801 - Connector in Talend Studio to Read /write data from/to AWS DocumentDB
- TDI-40320 - Add Tableau components in Studio
- APPINT-26018 - Unify the cloud connection configuration between Studio Project Connection and Publish to Cloud/API bridge
- TBD-12989 - Spark 3.1.x universal launcher for Databricks 8.0 and above - Interactive cluster only
- TBD-12990 - Tech preview - Spark Universal 3.1.x for Google Dataproc 2.0.x
- TBD-13494 - Make the universal spark 3.1 plugin able to run spark local jobs
- TUP-34032 - Support connection string and X509 authentication method for MongoDB Metadata
- TUP-33432 - Improve feature manager top bar button for mac
CVEs fixed in R2022-02
CVE-2020-25638 (maven-shared-utils:[0.4,0.1]), impacted:
Studio
CVE-2021-42392 (com.h2database:h2:1.4.198), impacted:
Studio
CVE-2012-5785 (axis2-kernel-1.7.8.jar), impacted:
metadata bridge
CVE-2012-0881 (xercesImpl:[2.11.0,2.11.0]), impacted:
metadata bridge
Other issues fixed in R2022-02
- TDI-47259 - tAzureAdlsGen2Output Date type for AVRO and Parquet caused log warn message in Input
- TDI-35717 - tOracleBulkExec's "action on table" was used when invisible
- TDI-47325 - Cannot create data source(SAP BW version 7.5)
- TDI-47395 - tPostgresqlOutput cannot select Insert as Action on Data when disable the Log4j
- TDI-47396 - tSCPGet doesn't always close session
- TDI-47484 - TDS job became slow when large retry number is used.
- TDI-47375 - tMicrosoftCRM components with compile error when using OnPremise 2011
- TDI-47193 - Talend Studio 8.0.1 compiling error with more than one tDataPrepRun
- TDI-46848 - Dynamics CRM ON-PREMISE with OAuth 2.0 authentication
- TUP-34390 - Wrong file selection dialog title for "Export custom settings" in Modules view
- TUP-33675 - Throw "Invalid key name: mdm.encryption.key" in error log when studio start up
- TUP-34660 - TOS: Cannot build job successfully
- TUP-34510 - Wrong dependency on TOS build
- TUP-34432 - No "Find features needed for the import" dialog shows when importing items which contains resource items
- TUP-34120 - Restart studio after install feature will have : "Workbench has not been created yet" in error log
- TUP-34156 - UI is broken for TCK Table structures in 8.0.1 + nighty
- TUP-34410 - Integrate Tableau Connector
- TUP-34575 - Correction to messages.properties file
- TUP-34383 - Studio not responding on 'publish to Cloud'
- TUP-33639 - Job which import by metedata bridge:NPE when check/uncheck "use project settings" in stats&logs
- TUP-34682 - Studio 8.0.1 R2022-01-can't access Support Exchange
- TUP-34574 - Feature Manager unexpectedly list duplicate category
- TUP-34401 - Detect Dependencies is not working
- TUP-34053 - Can't fetch correct Parquet file schema when using 'Create Simple Analysis'
- TUP-33321 - Small bottom right notif window "Welcome to Studio 8 ..." always in the foreground even switching to another application
- TUP-34433 - Plugins not always removed from studio after apply an update
- TUP-34663 - Integrate Amazon DocumentDB into Studio
- APPINT-34245 - RESTFUL Endpoint Job with tDBOutput is failing
- APPINT-34254 - ClassNotFoundException: org.talend.fileprocess.FileInputDelimited when Rest service calls tFileInput* inside joblet
- APPINT-31044 - Data service's endpoint can't be updated if passed as a context variable
- APPINT-32893 - API Designer - Issue with tRestRequest
- APPINT-33765 - ClassNotFoundException in runtime when DB connection (SQLServer) in joblet without using alias
- APPINT-34206 - Camel Property DSL Generation Compile Error
- APPINT-34319 - Property language not working in cSetProperty and cSetHeader
- APPINT-34329 - Add back support for separate logs in TMC for individual Data Services/Routes (Studio part)
- APPINT-34339 - Using json path in camel components leads to no class def found error
- APPINT-34316 - Compilation error with routes using cBean (Reference to another bean)
- TBD-10632 - AvroParquetOutputFormat issue with tSqoopImport on HDP31
- TBD-13204 - ClassNotFoundException: org.xerial.snappy.Snappy when tFileOutputParquet in streaming job on studio 8.0
- TBD-13285 - Talend Azure Synapse HDFS component issues
- TBD-13315 - Compile error when di job use tHDFSConnection
- TBD-13319 - Compile error when spark streaming job uses tTopBy with CDP7 built-in
- TBD-13374 - tImpalaConnection - Use Kerberos authentication checkbox does not work
- TBD-13441 - [QA] Check TUP-34053 Can't fetch correct Parquet file schema when using 'Create Simple Analysis'
- TBD-13463 - No FileSystem for scheme: HDFS on any EMR 5.29 job on Talend 8
- TBD-13498 - [7.3 ,R2022-01 ]UPPER case context variables getting converted to LOWER cases with thiveinput (Patch: R202201-log4j)
- TBD-13507 - Hard-coded value in hql is transformed to unexpected case in target parquet file
- TBD-13519 - Error "Syntax error on token "class", Identifier expected" after applying temp patch Patch20220113TBD-13323_v1-7.3.1
- TDQ-19421 - Semantic-aware analysis ->"Check Connection" in preference page will restore the data in elastic search server
- TDQ-19754 - Snowflake Datamart: improve the error message to give user a valuable reminder
- TDM-9219 - Not able to build a Talend Data Mapper job on 7.3.1 from Commandline.
- TDM-9227 - [7.3.1] Trim on value no more working in DataMapper field with fixed length in structure (Regression)
- TDM-7427 - data type optional segment is in test run result
- TDM-7904 - Json structure with invisible group can't parse data while highlight right
- TDM-9077 - Avro exporter produces wrong operand avroloc within Choices and Alternatives
- TDM-9119 - Check support for Distinct(using GroupBy) with Streaming
- TDM-9147 - Variable $var in TDM expressions gets exported as $$var
- TDM-9201 - Cobol Show Document error reporting must be improved
- TDM-9205 - [tHMap]Cleanup unused log level in the component xml file
- TDM-9213 - Enum numericity in exported avro schema is needed for most writers
- TDM-9214 - Default JSON Choice matcher should use Enum values when available
- TDM-9217 - Avro export of Structure inheriting from Choice element is missing recursive cases
- TDM-9222 - JSON Reader gets stackoverflow with recursive Choice
- TDM-9223 - Improve avro schema export performance for Show Document
- TDM-9226 - Null item in JSON array is omitted on output
- TDM-9237 - JSON Reader encodes ellipsis character
R2022-01v2
CVEs fixed in R2022-01v2
None
Other issues fixed in R2022-01v2
- TUP-34595 - Issue while logging into a Cloud Project using a proxy with R2022-01
R2022-01
New features in R2022-01
- TUP-33284 - Allow Publishing to cloud only if the job items are committed and pushed to Git
- TUP-32059 - Add git info in the jobinfo.properties when building job from CI
- TUP-33610 - Remove deprecated item in NoSQL connections.
- TDI-46470 - tKafkaOutput NB_LINES and other statistical after variables
- TDI-46430 - tKafka to handle Avro data in DI jobs
- TDI-46806 - Azure Blob Storage supporting the latest API version
- TDI-46460 - Integrate Apache Kudu / TCK in Studio
- TDI-47330 - Improved error logging for ODP and ADSO input
- TDI-46837 - tELTSAPMap: Improved logging for SAP components
- TDI-46093 - Add connection component for Tck ADLS gen2
- TDI-46875 - Implement $inc in MongoDBOutput in order to increment the value of existing field
- TDI-46698 - MongoDB add .skip / .batchSize options to input
- TDI-46627 - Upsert and push functionality in tmongodboutput component
- TDI-46665 - TCOMPv0 (Daikon) to support java 17 (runtime)
- TDI-46151 - Filter data based on return value in subquery in source database before pushing it down to a tDBInput to execute
- TDI-46093 - Add connection component for Tck ADLS gen2
- APPINT-34208 - Publish to cloud from CI: provide project/GIT informations in published artifact model
- APPINT-33784 - Project analysis task - Warn about custom component dependencies risk
- TBD-13144 - Upgrade kafka to 2.4.0
- TBD-13222 - Remove deprecated version for NoSQL in spark/spark stream components.
- TBD-13262 - HWC/Knox job is not able to connect to cluster
- TBD-13254 - Smoke test CDP Atlas
- TBD-13381 - Simplify drop-down naming for Cloudera CDP distribution
- TBD-13389 - Tech preview - CDP Public Cloud with Knox (official certification)
- TDQ-19814 - tDataQualityRules: New component to use DQ rules in the Studio
CVEs fixed in R2022-01
CVE-2012-0881 (xercesImpl-2.9.1.jar), impacted:
Studio
SourceClear Premium (No CVE) (jackson-mapper-asl-1.9.15-TALEND,jackson-core-asl-1.9.15-TALEND), impacted:
Studio
DI Components
DQ Components
SourceClear Premium (No CVE) (maven-core-3.8.1), impacted:
Studio
Build
DQ Components
CVE-2021-36373 (ant-1.10.9.jar), impacted:
Build, publish docker images
CVE-2015-5237 (protobuf-java-2.5.0.jar), impacted:
DI Components
CVE-2021-37136, CVE-2021-37137 (netty-codec-4.0.33.Final.jar,netty-codec-4.1.65.Final.jar), impacted:
DI Components
Cassandra metadata
CVE-2021-45105 (log4j-core-2.16.0.jar, log4j-1.2-api-2.16.0.jar), impacted:
DI Components
DQ Components
APPINT Components
Studio
CVE-2012-5785 (axis2-kerne-1.8.0.jar), impacted:
Studio
CVE-2021-22144 (elasticsearch-7.3.2.jar), impacted:
Studio
Other issues fixed in R2022-01
- TUP-34111 - [7.3.1] slow studio build time for remote execution, compared to local exec, or build job with R2021-01 or higher
- TUP-33966 - Studio/commandline fails to generate code for the job, throws "Invalid thread access"
- TUP-33369 - Need restart Studio to show FeatureList after network is broken and fixed later
- TUP-33964 - Integrate Apache Kudu Connector
- TUP-33863 - Update of Metadata Hadoop Cluster does not change spark version when propagated
- TUP-34123 - 'talendcsv-1.0.0.jar' is missing on 'Guess Schema' operation
- TUP-33939 - Ubuntu: Cannot close "Quick Tour" after logon a migrated project with a new extracted Studio
- TUP-34312 - Remove the signer from CI builder
- TUP-33185 - [CI] Cannot read .project file
- TUP-33830 - [7.3] ref project compilation error
- TUP-33962 - Error in handling default value as NULL
- TUP-34095 - Feature Manager> what's new is not expected to be to editable
- TUP-34356 - Improve update wizard to expand the what's new scroll pane according to the size of the dialog
- TUP-34127 - Feature manager should popup error if update version is lower than studio version
- TUP-30975 - Can't move Couchbase connection to folder
- TUP-33897 - Remove username from Studio Cloud Login
- TUP-33644 - TMC: error pop up when uncheck "use manual commit mode" and check out as local branch
- TUP-33776 - "Enable Parallel execution" in tOracleInput and tRESTClient
- TUP-34274 - [8.0] missing tesbconsumner component in studio with data management license
- TUP-34405 - Feature ESBConsumer is not active after import in a 73 existing project.
- TUP-33883 - Commandline upgrade script can't load update url from studio configuration
- TUP-34440 - Missing some tcompv0 basic plugins updates in 8.0 patch
- TUP-33214 - Migrated 731 project could not show the build popup for job build operation and gives error(IllegalArgumentException: Comparison method violates its general contract!) in macOS
- TDI-46910 - [tELTMap] The way to escape Db Column in multi-byte character in is different between input and output
- TDI-44321 - Update misleading text on SSL connection in tMongoDBConnection
- TDI-46834 - Additional columns in tDBOutput doesn't generate code properly for MySQL and Oracle
- TDI-46943 - Dynamic schema fail's with Excel
- TDI-46743 - tFileDelete cannot delete xlsx file which is generated by tFileOutputExcel when enable Streaming append and protect and multiple sheets
- TDI-47228 - tPostgresqlOutput: Upsert action not visible when using existing connection.
- TDI-46410 - [7.3.1] issue with tadvancedfileoutputXML after upgrade from 6.1.1
- TDI-47271 - tKafkaCreateTopic cannot work in studio 8.0.1
- TDI-46870 - Upgrade kafka-client to 2.4.0
- TDI-47272 - tfileinputparquet issue with parquet file metadata
- TDI-47222 - [TCK Studio Integration] Stop executed before Flush
- TDI-47122 - Metadata details are not loaded from Snowflake
- TDI-47213 - AzureAdslGen2Output migration failed with regular expression
- TDI-47234 - Job using tXSLT that was working fine before R2021-11 no more works after R2021-11
- TDI-47319 - tKafkaOutput compile error version Kafka 0.8.2.0
- TDM-9200 - the special characters generated in the output XML file in 7.3.1
- TDM-9043 - JSON Reader supporting expressions as discriminators
- TDM-9125 - TDM: Group By doesn't work with multiple entries
- TDM-9197 - get error when install TDM feature to esb runtime
- TDM-8449 - Support JSONL
- TDM-8488 - Flattening map throw error when choose blank structure
- TDM-9017 - PutValueToExternalMap value is converted to String if a Java function is used
- TDM-9038 - JSON sample importer creates untyped element for {}
- TDM-9076 - Avro exporter fails for operands defined after expression
- TDM-9078 - Avro exporter fails to export expressions set on Choices
- TDM-9092 - SecondChoice, which passes the IsPresent expr, is not parsed/highlighted
- TDM-9157 - Distinct Loop with Child Loop using IndexRangeLoop has XPathException
- TDM-9174 - tuj job tdmTDMT627csv_writer is failed with JSON syntax error
- TDM-9176 - Upgrade codehaus.jackson dependency to 1.9.16-TALEND
- TDM-9203 - JSON default choice handler fails on optional array
- TDM-9208 - Expressions in a map with JSON reps are not exported in avro schema
- APPINT-34210 - The microservice jar could not be generated when route with cREST as client + saml
- APPINT-34013 - "Component must have a valid id" when adding <cxf:bus> element in route's spring tab
- APPINT-34077 - RuntimeException: java.lang.NoClassDefFoundError: org/apache/cxf/databinding/DataBinding
- APPINT-34052 - Issue while overriding microservice context param with commandline
- APPINT-34157 - No task created when publishing a microservice to Cloud from Studio 8
- APPINT-34048 - Sync up the Region names of cAWSConnection
- APPINT-34088 - [CI] Mvn deploy job to tmc failed when use default environment
- TBD-12184 - Password field missing for tImpalaRow
- TBD-12809 - Compile error on Spark job with Hive components using EMR 5.29 cluster
- TBD-13202 - Compile error when tFileStreamInputParquet in streaming job
- TBD-13283 - Snowflake - upgrade spark connector and jdbc driver
- TBD-13289 - Cloudera dynamic distributions issues on Studio 8
- TBD-13297 - Unable to compile and build the job after R2021-11 patch
- TBD-13303 - tImpalaConnection - Impala driver ClassNotFoundException
- TBD-13306 - Header is loaded into target file as a record though hive query has ignored the header
- TBD-13309 - CVE on commons-httpclient-3.0.1
- TBD-13310 - CVE: jackson-mapper(core)-asl-1.9.16-TALEND
- TBD-13323 - Unable to compile Talend Big Data job having data type as BigDecimal in 'tDeltaLakeOutput' component.
- TBD-13327 - "Duplicate field in record" error while opening spark job in studio
- TBD-13464 - Many Compile error when I run new create spark job with HDI4
- TBD-13465 - ClassNotFoundException when I run a simple job with CDP711
- TDQ-19846 - Snowflake: Improved the performance of the DQ data mart
- TDQ-19741 - Snowflake: Correct 'RUN TIME' in generated report file
- TDQ-19163 - tDataMasking: Removed a few unsupported data types to prevent the Job from failing
- TDQ-20005 - Fixed the error preventing the name of business rules from being changed in the data mart
- TDQ-20000 - Column Set Analysis: Fixed the error preventing from generating a report into Snowflake datamart
- TDQ-19925 - tDataMasking: Fixed the NoClassFound error when using the function Bank account generation on Amazon EMR 6.2
R2021-12
New features in R2021-12
- TUP-33718 - Genereate component - jar index data
- TUP-26972 - Prompt to Automatically push changes to Remote Branch
- TUP-22589 - Improve error messages when pushing to read-only GIT branches
- TUP-32064 - Build up to date Studio index automatically
- TUP-33198 - Support retrieve SAP ADSO service metadata with SAP JCO3
- TDI-44717 - [tPostgresqlOutput] Support upsert using "on conflict" clause to enable batch size
- TDI-45710 - tXSLT support for streaming input and output
- TDI-46936 - Cloud- cloud TDS job fails with connection timeout error while reaching to campaign
- TDI-45793 - Extracting data from SAP BW4HANA without direct connection to DB
- TDI-45940 - Workday Raas/Soap supporting Oauth
- TDI-45016 - Add a configurable Query Timeout field to AS400 connection components
- TDI-44609 - Support custom URI for MongoDB Atlas
- TDI-46517 - MongoDB connectivity Authentication with x.509
- APPINT-34089 - Project analysis task - Warn about duplicated routeId usage
- APPINT-33726 - SNS component in Route to support FIFO
- APPINT-34095 - tRESTRequest now accepts to have multipart as optional
- APPINT-33956 - Project analysis task - Seek for components unresolved dependencies
CVEs fixed in R2021-12
CVE-2021-44228, CVE-2021-45046 (log4j-core-2.13.2.jar, log4j-core-2.14.1.jar), impacted:
DI Components
DQ Components
APPINT Components
Studio
metadata bridge
CVE-2020-28052 (bcprov-jdk15on-1.62.jar), impacted:
Studio
SourceClear Premium (No CVE) (oauth2-oidc-sdk-6.5.jar,adal4j-1.6.5.jar), impacted:
DI Components Microsoft SQL Server database metadata
SourceClear Premium (No CVE) (commons-codec-1.11), impacted:
Build, publish docker images
CVE-2021-37714 (jsoup-1.11.2.jar), impacted:
DI Components
CVE-2015-5237 (protobuf-java-3.3.0.jar), impacted:
DI Components
CVE-2021-28168 (jersey-common-2.30.jar), impacted:
DI Components
CVE-2021-39239 (jena-core-2.10.0.jar), impacted:
DI Components
DQ Profiling
CWE-327(bcprov-jdk15on-1.69.jar), impacted:
DI Components
CVE-2021-40690 (xmlsec-2.2.0.jar), impacted:
APPINT Components
CVE-2021-37137 (netty-codec-4.1.50.Final.jar,netty-codec-4.1.59.Final.jar), impacted:
APPINT Components
CVE-2021-20328 (mongodb-driver-core-4.2.3.jar,mongodb-driver-sync-4.2.3.jar,bson-4.2.3.jar,mongo-java-driver-3.12.8.jar), impacted:
DI Components
BD Components
MongoDB metadata
CVE-2021-35517 (commons-compress-1.18.jar), impacted:
metadata bridge
Other issues fixed in R2021-12
- TUP-34105 - Upgraded log4j2 to 2.16.0 for CVE-2021-44228 and CVE-2021-45046
- TUP-34155 - Can't build spark job that use HDI4
- TUP-34094 - Add progressbar for patch update when launching studio
- TUP-33792 - No "Data viewer" for lite studio by default
- TUP-32838 - Custom value in a table column with suggestable values is not allowed
- TUP-33882 - Data preview failed if tSnowflakeInput using exist connection
- TUP-33659 - JETL: "xxxClassNotFoundException: xxx" Error shows in Errorlog after loging into project
- TUP-33854 - JETL studio can't install patch
- TUP-33791 - Error pops up while running job in main project and it call childjob from reference project
- TUP-33734 - Patched new features can't be shown in feature manager if it is located in a deeper category which level more than one
- TUP-33822 - Can't update new patch successfully if last patch is installed from a sub profile (a project which required features less than studio installed)
- TUP-33570 - Retrieve hadoop config from Ambari / Cloudera seems not working
- TUP-33667 - Branch in "auto commit mode" switch to a "Use manual commit mode" branch will popup Uncommitted files found dialog
- TUP-33199 - [Feature Manager->Cancel installation] After clicking on the "Cancel Operation" during installation, "Restart Studio" dialog was popped up which is improper.
- TUP-33735 - "Hierarchical Mapper" can't show properly when switch git branch
- TUP-33692 - Studio reset the ref project version to studio version in some case .
- TUP-33443 - The method tFileInputDelimited1onSubJobError(Exception, String, Map<String,Object>) is undefined for the type xxxxx
- TUP-33713 - Logon popup message in a mess when main project and refer project are on different patch
- TUP-34096 - failed to logon the project, after clicking NO on the patch update restart dialog
- TUP-33445 - Add configurable parameters for MDM Service Request
- TUP-33467 - Need to adjust the UI of 'check connection' when tck component in studio
- TUP-33497 - Bug in tDBOutput component when linking rejects to tMap
- TUP-33533 - Studio generates .bat file with LF as 'End of Line (or new line)' character instead of CRLF
- TUP-33564 - MDM: Met some issue when add Reference Entity in "Edit Business Element" dialog
- TUP-33685 - Update version not saved into project if migrate a project by switch branch.
- TUP-33731 - Remote Project: when do pull and merge for add/remove reference project, ConcurrentModificationException show in error log
- TUP-33617 - java.io.OptionalDataException on tAvroInput
- TUP-33709 - "Failed to create assembly" when compile a BD job with studio commandline
- TUP-33755 - Update wizard error text not wrap if there is something wrong with the update p2
- TUP-33834 - SVN shown in the listProject command help in CommandLine
- TUP-33807 - Sybase ASE Triggers generated by CDC don't work when multiple lines are affected
- TUP-33833 - Fail to log on a project if switch from tpall license to tdi license and the studio installed all feature and a patch
- TUP-32940 - Remove "Also search from Help when performing a component searching"
- TUP-33746 - Feature manager :Active/Deactive Features: "Resotre Defaults" not work
- TUP-33728 - Migrate studio65 job to 801, miss DB connection
- TUP-33121 - Talend Studio gives no error if unable to connect to remote GIT repository
- TUP-33230 - Update patch: need restart to make new patch work for artifactory
- TUP-34140 - run job with tRunJob failed if user B logon a project that user A installed some features contain routine
- TUP-34141 - can't pull the changes of requiredFeatures.json for local mode
- TUP-34149 - JETL: Cannot install patch completely
- TDI-46912 - [tELTOutput] "Drop table if exists and create” does not work
- TDI-46930 - compile error on tFileOutputDelimited after installing the cumulative patch
- TDI-46984 - tFTPGet component unable to get file from FileZilla Server, with a particular Filemask in Studio, after September patch, Patch20210924R2021-09_v2-7.3.1
- TDI-46791 - tBigQueryInput - Component returning extra row of NULL values
- TDI-46905 - tFTPPut treat absolute path FTP server.
- TDI-47170 - tFTPPut treat absolute path sFTP server.
- TDI-46992 - Could the fix for TDI-46373 might have introduced a regression - a limit to the content log - java.nio.BufferOverflowException
- TDI-47179 - tPostgresqlOutput: enable "Batch" checkbox for Upsert action.
- TDI-47005 - In tsalesforceoutput component UPSERT is working even though columns were not aligned
- TDI-46932 - tSAPInput component parses TIMS Midnight as null when using dynamic schema
- TDI-47147 - tmap failed with first match with cache in file
- TDI-47078 - [7.3]Multiple SQL Statements in SQL Template => Duplicate local variable
- TDI-46962 - tAmazonAuoraOutput compilation errors
- TDI-46850 - Upgrade ActiveMQ Jars
- TDM-8894 - Update can't be detected when delete invalid element which used by function
- TDM-9039 - JSON sample importer should process JSONL/NDJson files
- TDM-9089 - Stream job run fail with eclipse runtime
- TDM-9107 - IsPresent value is not created correctly from the imported AVSC
- TDM-9116 - Streamline and trace dirty flag management
- TDM-9133 - regression: retest TDM-8173 and will return error
- TDM-9134 - Relax controls on parent looping expressions for grouping nested loops
- TDM-9139 - tHMap will get the error when first time run if "unroll from loop"
- TDM-9142 - Missing/Incomplete MANIFEST.MF
- TDM-9144 - Align slf4j (maybe others) between standalone target platform and Studio
- TDM-9145 - Distinct on Attribute of type integer is sorted by String
- TDM-9146 - clean unused message
- TDM-9178 - CVE: org.hibernate:hibernate-core:[5.0.9-5.3.20.Final]
- TDQ-19920 - tMatchGroup: Job failed when using a shared connection
- TDQ-17188 - Remote project: Report with 8 analyses failed with the error "Can't execute now"
- TDQ-19849 - tVerifyEmail: Job couldn't be executed on some networks when Check with mail server callback was selected
- TDQ-19750 - Talend Exchange: Activated some indicators, regexes and rules for 8.0
- TDQ-19884 - Fixed the error preventing to import from talend Exchange
- TDQ-19886 - Semantic-aware analysis: Enhanced an error message
- TDQ-19293 - tData(Un)Masking: Enhanced some function names
- TDQ-19834 - CVE: org.apache.jena upgraded to 4.2.0
- TDQ-19203 - Analysis: Studio was unavailable while opening an analysis
- APPINT-34090 - Studio esb/osgi-exclude.properties doesn't work any more
- APPINT-34030 - git commit ID inconsistent when publishing artifact to Cloud.
- APPINT-33788 - Unexpected waiting for javax.sql.DataSource dependencies (part 2)
- APPINT-32136 - Job & Run view displays DI job icon and/or label when a route or routelet editor is active
- APPINT-34059 - Build DemoREST as OSGI failed with offline with error Unresolveable build extension
- APPINT-34073 - NoSuchEndpointException when run route with cAWSConnection + cAWSSQS
- APPINT-33820 - Add setting of owner ESB task as MDC for logging of REST routes and services (backport)
- APPINT-34113 - CXFRS jackson json provider issue
- APPINT-34061 - Missing import for net.sf.saxon.TransformerFactoryImpl
- APPINT-34099 - tRestClient with option "Convert response to DOM document" throw error when receiving 204 response
- APPINT-34066 - [MacOS Big Blure]Fail to build route as OSGI to runtime with ClassNotFoundException on MacOS
- APPINT-34009 - [TCK][Studio] Unable to run Neo4jV4 and CosmosAPI in Microservice Mode
- TBD-13301 - Expression within tMap doesn't compile due to invalidAssignmentOperator; even though the column exists in the input schema
- TBD-13284 - Compile error on Spark job with tMap component
- TBD-13268 - Class not Found encountered when running Spark job against S3
- TBD-13244 - Failed to add json-smart-2.4.7-LATEST.jar to Spark environment
- TBD-13242 - [Spark Streaming] tFileOutputDelimited components sometimes doesn't write byte[] data
- TBD-13238 - java.lang.IllegalArgumentException: Field "entity_name" does not exist.
- TBD-13236 - "Use SSE-KMS encryption" property is absent for tS3Configuration component when EMR distribution is selected
- TBD-13232 - java.lang.String is not a valid external type for schema of bigint
- TBD-13231 - Compile error when tHiveInput in streaming job
- TBD-13227 - java.math.BigDecimal is not a valid external type for schema of int
- TBD-13220 - Nullpointerexception using Cross Join in Spark
- TBD-13203 - Compile error when tCassandraOutput/tCassandraInput in streaming job
- TBD-13199 - Wrong driver cores value is set in spark config when Synapse from repository is used
- TBD-13198 - Wrong tunning properties field name in Synapse wizard
- TBD-13195 - [Talend 8, Azure Synapse] Compile error "org.talend.bigdata cannot be resolved to a type" on simple Batch/Streaming job
- TBD-13194 - Databricks launcher reuploads already existing libs
- TBD-13187 - Compile error on tLogRow when byteArray type is used
- TBD-13175 - EMR 6.2 fails when job contains tDatamasking component
- TBD-13148 - Decimal precision needs to be provided in tHiveOutput schema Component in 7.3.1
- TBD-13139 - Default value defined in tAggregateRow is not taken into account
- TBD-13138 - A schema mismatch detected when writing to the Delta table
- TBD-13128 - HWC doesn't work when using a cluster with Kerberos+SSL
- TBD-13120 - ClassNotFoundException on streaming job with tKafkaInput running on spark local 3.0
- TBD-13102 - Data Load from kafka to Data Bricks in spark streaming job
- TBD-13373 - User did not initialize spark context when I run a simple spark job with HDI4
- TBD-13201 - Spark job running on Synapse failed with IllegalStateException