Talend Cloud Data Catalog and Talend Data Catalog Bridges

MicroStrategy: Extra logging in folders.exclude/include filters

Added extra messages for -folders.exclude and -folders.include. Now the bridge prints warning for each folder from -folders.exclude and -folders.include that does not match any folder in MicroStrategy.

The bridge prints those messages for Import and Test (Test is much faster than whole import). The bridge uses startWith when comparing values from folders.include file to include folders below and folders above.

Erwin Data Modeler export: Support for Databricks schemas

Added support for Databricks schemas (Databases).

Fixed setting of Erwin version "10.00.00.35888" (Erwin 14.0).

Profiles / Data type for attributes / For more profiles like Power BI, BigQuery, Hive, File System

• Microsoft Azure Power BI bridge: update profile, rename entity Repository -> Service.
• Microsoft Azure Power BI bridge: update profile, add Dataflow Step.expression property, specify datatypes.
• Microsoft Azure Power BI bridge: update profile, fix DataSource condition, generate datatypes.
• Apache Spark profile: generate datatypes.
• Microsoft SQL Server ASRS profile: added data types, added missing link paths.
• File System profile: generate datatypes.
• Looker profile: datatypes were already generated.
• Apache Hive profile: is obsolete, replaced with RDBMS profile which already has datatypes.
• Google Big Query profile: is obsolete, replaced with RDBMS profile which already has datatypes.

Talend Data Integration / Snowflake JDBC: Connection Stitching logs warnings about missing end-to-end lineage

Improved case-sensitive column processing.

Microsoft Azure Power BI: CSV output has Datasource referencing profile "Meta Integration ETL Summary (Data Store)" id="190"

Improved Power BI profile and shared the "Meta Integration ETL Summary (Data Store)" profile with a reference link.

Any Database JDBC: Connection pooling

• Added connection pool support.
• Fixed loading of checksum data twice.
• Fixed printing of messages.

AWS Glue ETL: Metadata harvesting from Visual ETL pipelines in AWS Glue Studio and basic transformation libraries in Python notebooks

Improved the support for simple expressions in the formatted string literals.

Any Database SQL DML / Profiles: Data type for attributes

Added data types in the profile for the DML import bridges.

Databricks Notebooks: Create the "catalog" value based on internal connections

Fixed the issue.

Any Databricks / User Agent Tag: Partner format

Added the HTTP User Agent header in requested format.

MicroStrategy: Lineage for two fields with same name

Fixed lineage for attribute with the same names.

SAP S/4HANA / ECC: Request enhancement for Scoping

SAP R/3 bridge: Added new "Exclude content" parameter.

Microsoft Azure Power BI / Exception: java.lang.NullPointerException: Cannot invoke "java.lang.Boolean.booleanValue()" because "this.success" is null

Fixed classpath issue which caused the NPE.

Erwin Data Modeler export: Support for PostgreSQL 13.x, 16.x versions.

Added support for PostgreSQL 13.x, 16.x versions.

Microsoft Power BI and Apache Spark / Profiles: Missing references to other profile objects

• Microsoft Azure Power BI bridge: improve profile, remove StoreType, add ContentProviderType.
• Microsoft Azure Power BI bridge: improve profile, show step description for Dataflow.
• Microsoft Azure Power BI bridge: improve profile, share the ReportingServices profile from 'ReportMicrosoft SQL Server ASRS' with a reference link.
• Apache Spark bridge: improve Apache Spark server profile, fork Spark and SQL based notebooks.

Any Database SQL (for example DML, JDBC SP) / Summarizer / SummaryUtil: Bulk operation flag assumptions

Fixed the default bulk value.

Microsoft Azure Power BI: CSV output contains Dataflow entity only when Workspace import bridge parameter is specified

Obtained new authentication token if the current session is about to expire, no longer rely on token refresh.

Upgraded MSAL library.

Qlik Sense: Cannot invoke "Object.toString()" because the return value of "org.json.simple.JSONObject.get(Object)" is null

Fixed parsing Sheet objects when rows or columns are null.

Oracle Database (via JDBC): Completing with 0 discovery

Fixed the query filter name in Oracle expression parser and resolved the consistency error '[QueryFilter] has no name'.

Improved the Oracle procedure/function named parameters (using string '=>' instead of '=') in expression parser. It fixed consistency error '... the Feature Map has a destination Feature ... whose parent Classifier is not in the Classifier Map'.

MicroStrategy Server: MIMB execution thread was not found

Fixed the issue.

Microsoft SQL Server Database (via JDBC): Consistency error appears in the import log

Fixed the issue.

PostgreSQL Database (via JDBC): Database constraint missing

Added a check constraint support.

ThoughtSpot: New support for current version 10.x

Implemented a new bridge based on REST API V2 to support ThoughtSpot versions 9.2 to 10.x.

ThoughtSpot / New support for current version 10.x: Supported Tools Specifications

Implemented a new bridge based on REST API V2 to support ThoughtSpot versions 9.2 to 10.x.

SAP HANA Database (via JDBC): Unexpected HXE.$PUBLIC connection

Added support for DUMMY system table.