Creating the index using the management console

The index is the main element of Qlik Associative Big Data Index, containing indexlets that are persisted data and symbol tables that represent the big data. You can use the Qlik Associative Big Data Index management console to configure the indexing cluster and create the index.

Note: You can only work with a single dataset on a deployment using the management console. You need to set up a new deployment to index a new dataset.

Before you create the index:

Do the following:

  1. Start the indexing cluster services.

    Open the Status tab of the management console and click Start in Indexing services.

    The following services are started on the Indexing manager, Symbol server and Indexer server nodes. If you have several nodes of the same type, for example symbol servers, you will see one instance of the symbol service for each node.

    Note: Do not start QSL services until you have completed indexing as described in this procedure.
    Indexing services
    Service Default port Node
    Indexing Manager Service 55020 Indexing manager
    Indexing Registry Service

    50057

    Indexing manager
    Persistence Service 55010 Indexing manager
    Index Maintenance Service 55050 Indexing manager
    Symbol Service

    55030 (first node)

    Symbol server (there can be multiple nodes)
    Indexer Service

    55040 (first node)

    Indexer server (there can be multiple nodes)
  2. Scan the data and generate a schema.

    Open the Datasets tab of the management console and click Scan.

  3. Review the schema by clicking Edit schema.

    The data scan generates attribute to attribute (A2A) associations in the schema automatically if:

    • multiple tables have fields with exact same names
    • a field mappings file to define the table/field names to be mapped is set in the settings of the dataset.

    You can add or modify A2A associations before you create the index.

    • The Fields tab defines the table/field structure of the dataset. You can add or delete tables and fields.

    • The Associations tab defines the field mapping between tables for A2A creation.

      Each “data” sub-section defines an association of a pair of fields from two different tables.​

    See Schema configuration sample file.

  4. Register the schema by clicking Index.

    The index is created when all tasks are completed:

    • Associations
    • Columns
    • Symbol table
  5. Start the QSL cluster services.

    Open the Status tab of the management console and click Start in QSL services.

    The following services are started.

    QSL services
    Service Default port Node
    QSL registry service

    44000

    QSL executor registry
    QSL worker service 55001 (first node) QSL worker (there can be multiple nodes)
    QSL manager service 55000 QSL manager

Troubleshooting

Troubleshooting may be needed when Qlik Associative Big Data Index indexing does not behave as expected (for example, if the system responds with an error message that needs further investigation or does not respond at all when an error occurs).

You can view logs by clicking Show logs in the Status tab.

Did this information help you?

Thanks for letting us know. Is there anything you'd like to tell us about this topic?

Can you tell us why it did not help you and how we can improve it?