Upgrading and uninstalling Data Movement gateway
This topic explains how to upgrade or uninstall your Data Movement gateway installation. It also provides a table listing the changes introduced in each Data Movement gateway version.
Upgrade procedure
To verify your current version, go to Administration > Data gateways and check the Version column corresponding to your Data Movement gateway.
If there is a new version available, the version number is appended with !. You can hover on to get more information. If the installed gateway version is not supported, Status will be Deactivated, and an upgrade is required to activate the gateway.
Whenever a new version of the Data Movement gateway rpm becomes available, you should download it fromAdministration and upgrade the existing installation.
To do this:
-
Download the new version by clicking on the gateway and then Upgrade.
Acknowledge the customer agreement, and proceed to download the RPM.
- Open a shell prompt and change the working directory to the directory containing the RPM file.
-
Run the following command:
Syntax:
rpm -U <rpm name>
Example:
sudo rpm -U qlik-data-gateway-data-movement.rpm
-
Start the Data Movement gateway service:
sudo systemctl start repagent
-
Optionally, confirm that the service has started:
sudo systemctl status repagent
The status should be as follows:
Active: active (running) since <timestamp> ago
Data Movement gateway version history
Version |
Release date |
Significant changes |
End of support date |
---|---|---|---|
2024.5.28 | November 12, 2024 | Provides functionality required for the soon-to-be-released Schema Evolution feature. | Determined when the next major version is released |
2024.5.27 | November 5, 2024 |
This release resolves the following issues: Oracle source
SAP Extractor source The instructions in the YAML file were updated to reflect the correct version of the SAP Java Connector. Snowflake target When using Data Movement Gateway to connect to Snowflake target via a proxy, the connection would fail with the following error: 500 Failed to connect to Data Movement Gateway |
Determined when the next major version is released |
2024.5.22 | October 15, 2024 | This release resolves an issue in a Full Load + CDC replication task, where the Data task is updated to field for the CDC task would show the Full Load timestamp instead of the CDC timestamp(s). | Determined when the next major version is released |
2024.5.16 | October 8, 2024 |
Resolved issues
|
Determined when the next major version is released |
2024.5.14 | September 10, 2024 |
Enhancements
Resolved issues
|
Determined when the next major version is released |
2024.5.7 | August 6, 2024 |
Enhancements
Newly certified platforms, endpoints and versions
End of support Support for the following database versions has been discontinued:
Resolved issues
|
Determined when the next major version is released |
2023.11.23 | June 26, 2024 |
Enhancements
Resolved issues
|
February 6, 2025 |
2023.11.11 | May 21, 2024 |
Enhancements
Resolved issues
|
Determined when the next major version is released |
2023.11.4 | March 12, 2024 |
Support for installing Data Movement gateway on Red Hat 9.x Customers can now install Data Movement gateway on Red Hat 9.x or on any corresponding and compatible Linux distribution. Setting up Data Movement gateway Changes to Data Movement gateway service commands The commands for stopping, starting and checking the status of the Data Movement gateway service have changed. Data Movement gateway service commands Changes to Amazon Redshift data type mapping
Newly supported databases, database versions, and driver versions This section lists the newly supported databases, database versions, and driver versions.
End-of-support database versions This section provides information about end-of-support database versions.
Resolved issues
|
Determined when the next major version is released |
2023.5.16 | January 9, 2024 |
New data lake targets for Replication projects We are continuing to expand the supported targets for the Replication project in Qlik Cloud Data Integration, in addition to Amazon S3, you can now choose Azure Data Lake Storage (ADLS) and Google Cloud Storage (GCS) for data lake delivery, as Parquet, JSON or CSV file formats. Resolved issues:
|
September 7, 2024 |
2023.5.15 | December 12, 2023 |
Support for Microsoft Fabric as a data pipeline target Microsoft Fabric joins the ever-expanding list of data warehouses that can be used as targets in data pipeline projects. Resolved issues: Updated the Snowflake driver version in the driver installation utility. |
September 7, 2024 |
2023.5.10 | October 31, 2023 |
Expanded Support for Private Connections A private connection can be used to ensure your data traffic remains secure and compliant. It simplifies both network management and security of your VPC (Virtual Private Cloud) without the need to open inbound firewalls ports, proxy devices or routing tables. Qlik Cloud Data Integration already supports private connections to Snowflake, Microsoft SQL Server and Amazon S3 data pipeline targets. With this release, customers can additionally utilize private connections when moving data to Databricks, Microsoft Azure Synapse, Google BigQuery, and Amazon Redshift. PostgreSQL-based data sources
Microsoft Azure SQL (MS-CDC) data source: Geo-replication support Customers moving data from a Microsoft Azure SQL (MS-CDC) data source can now use a Geo Replica database. Oracle data source: HSM (Hardware Security Module) support Qlik Cloud Data Integration now supports reading data from Oracle encrypted tablespaces and encrypted columns during CDC. New regions support Qlik Cloud Data Integration now supports tenants in DE and UK regions. Newly supported versions and third-party software This section lists newly supported database and driver versions.
Microsoft SQL Server driver - Required upgrade Customers moving data to or from Microsoft SQL Server need to upgrade their SQL Server ODBC driver version to 18.x or later. Note that continuing to use SQL Server ODBC Driver 17.x might result in data errors. Upgrading the driver can be done using either the driver installation utility or manually. For instructions, see Driver setup. End-of-support database versions This section provides information about end-of-support database versions.
|
September 7, 2024 |
2022.11.74 |
August 15, 2023 |
Replication support We take a cloud-first approach that enables rapid innovation and adoption. However, that does not mean that we are cloud-only. As part of our continued commitment to improving the long-term value for our customers, we are pleased to announce the release of a new use case for Replication when creating data projects. The new Replication use case is in addition to the existing ability to create data pipelines for all your data integration needs, such as Data Warehouse modernization. The Replication project supports real-time data replication from supported data sources to a supported target. Starting with this latest release, the first target that supports replicating data in real time, is Microsoft SQL Server. In addition to supporting Microsoft SQL Server on-premises, the following cloud providers are also supported:
Microsoft Azure Synapse Analytics target - Required driver upgrade Customers moving data to Microsoft Azure Synapse Analytics need to upgrade their SQL Server ODBC driver version to 18.x or later. Note that continuing to use SQL Server ODBC Driver 17.x might result in data errors. Upgrading the driver can be done using either the driver installation utility or manually. For instructions, see Driver setup. New "Load data from source" option for SaaS application sources A new Load data from source option was introduced, which allows customers to read their data directly from the source during Full Load, instead of using the cached data. For more information on this option including use cases, see Landing settings. Updated CA certificates Data Movement gateway 2022.11.74 includes updated CA certificates, which are needed for authenticating the Qlik Cloud tenant. The updated CA certificates also provide support for the Ireland and Frankfurt regions. Therefore, customers with Qlik Cloud tenants in Ireland or Frankfurt who want to use Qlik Cloud Data Integration must upgrade to this version. Resolved issue Tasks landing data from an Oracle source would sometimes fail when a wide table contained unused or unsupported columns, or LOB columns that were not replicated. |
April 31, 2024 |
2022.11.70 |
June 28, 2023 |
Improved driver installation utility for SAP clients In previous versions, customers needed to run the "source arep_login.sh" command when installing SAP clients. From this version, it is no longer necessary to run this command. Updated CA certificates This version includes updated CA certificates, which are needed for authenticating the Qlik Cloud tenant. Resolved issues
|
September 15, 2023 |
2022.11.63 |
May 2, 2023 |
Driver installation utility This version introduces a driver installation utility that eliminates the need to manually install and configure drivers. The new utility shortens the installation process while significantly reducing the possibility of user error. When the utility is run, the required driver is downloaded automatically, if possible, and installed. If the driver cannot be downloaded (DB2 drivers require login, for example), all you need to do is download the driver, copy it to a dedicated folder on the Data Movement gateway machine, and run the utility. For an example of using the driver installation utility to install a PostgreSQL driver, see Prerequisites Snowflake cloud data platform The Snowflake connector now supports 4-byte emoji characters. Support for Azure Database for PostgreSQL - Flexible Server as a data source The PostgreSQL connector can now move data from Azure Database for PostgreSQL - Flexible Server. Support for Cloud SQL for PostgreSQL as a data source The PostgreSQL connector can now move data from Cloud SQL for PostgreSQL. Newly supported data source versions This version introduces support for the following new data source versions:
Newly supported cloud data platform versions Databricks 11.3 LTS Discontinued support for the following data source versions The following data source versions are no longer supported:
Resolved issues This version resolves the following issues:
|
September 15, 2023 |
2022.5.13 |
October 19, 2022 |
Initial release |
August 2, 2023 |
Uninstalling Data Movement gateway
To uninstall Data Movement gateway, run the following command:
rpm -e <installation package name>
Example:
rpm -e qlik-data-gateway-data-movement-2023.11-1.x86_64
If you do not know the package name, run:
rpm -qa | grep qlik