Source types supported for ingest

Source is an onboarding module designed for import and management of enterprise data sources. The following source types are supported:

• Java Database Connectivity (JDBC) for direct routing from relational database management systems
• File Definition Language (FDL) for flat (text and delimited) files
• IBM mainframe data ingest via COBOL copybook data definition
• XML configuration via XML Schema Definition (XSD)
• JSON data files through hierarchical extraction normalization (HEN) files
• QVD (QlikView Data) files are saved to this proprietary data storage format used by most Qlik customers for efficiency and performance

The source module provides a wizard to guide users through environment definition and metadata creation for subsequent one-time or recurrent ingest of data. The steps and protocols vary based on source type and inbound protocol though the first steps are common to most source types once a source connection is selected. All data is then written to HDFS or the file system of choice and registered in HCatalog (or Postgres in the case of single node environments) where it is accessible for analysis through query, transformation, and publish tools. Important to note is that the ingest wizard establishes table structure and environment that data is then loaded into. Once the source wizard steps (or Qlik Sense setup in administration module) have completed successfully, the data must be loaded from external or local file system sources. Data is onboarded into Qlik Catalog through two key stages:

1. Define source / entity metadata
2. Ingest data