Skip to main content

Publish to Qlik Cloud Services S3

The following example details definition of a Qlik Cloud Services – S3 publish job using a target that has been pre-defined. Part of that definition requires that groups have been configured with access to S3 buckets in the target definition; and QVDs are accessible to the associated groups through the publish job. Note that all QVDs and non-QVD entities alike are published to S3 buckets as QVDs.

1. TARGET selection

Select QVD and non-QVD entities of interest into My Cart (from discover or catalog modules) or select a pre-defined dataset to publish to Qlik Cloud Services - S3.

Choose icon action (action) dropdown option Qlik Cloud Services – S3 from dataset panel menu or My Cart.

Dataset Name: (required) Name the set of entities that were loaded from My Cart, or populated from discover dataset creation, or from an existing dataset

Publish Job Name: (required) Name the publish job

Description: (optional) Enter any commentary or details about the publish job or target

Target: (required) Choose a pre-defined Qlik Cloud Services – S3 Target. The target pictured below (QCS_S3) was defined here: Publish: add target

Initiate S3 publish job select a pre-defined S3 target


Stage through screens to configure publish job. Save and execute the job.

ENTITY definition

Data Loads:ALL (partitions),  FIXED (choose a particular load), LATEST (load) , SAMPLE (data from latest load)

--Merge Mode is always MERGED

--File Format is always QVD

Buckets:The buckets defined in target definition (mapped to Groups for access) display in drop down.

Stage through entity screen, select the appropriate S3 bucket

Schedule definition

Choose One Time Export for immediate one time load or schedule a Recurring Export with Customize using a Quartz cron expression option. To use a Quartz cron expression to create an automated schedule, choose Recurring, then select the radio button next to Custom Schedule. Complete the entry with the Quartz cron expression. Refer to the following link for guidelines on creation of a Quartz cron expression:

Schedule screen options one time or recurring

CONFIRM. Check the publish logs to confirm FINISHED status or error information.

Confirm target metadata and save at final screen of wizard

3. AWS S3 Target View: Qlik Cloud Services – S3

In S3 section of AWS console, identify the bucket defined in the Qlik Cloud Services - S3 target definition. For the current example, one of the target buckets was "s3a://qcs-functional".

Select the bucket to see the new folder that was created by the publish job (naming convention is QDC_SOURCE_ENTITY).

The folder in the following example is called "QDC_INDEX2020_CPIUSHousing".

After select the AWS bucket the job was published to, drill into view published folder

Drill-in to display the artifacts published to the S3 bucket accessible to Qlik Cloud. Publish to QCS S3 will publish the same artifacts: <QVD_name>.qvd, a status log such as READY, a metadata file metadata.json, profile data profile.txt, and sample data sample.txt.

S3 artifacts are published together

Right-click the QVD to download or open. Any text editor should be able to open the QVD.Like all QVDs the header is standard XML and the data is in proprietary binary format.

right click to open the QVD in text editor

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!