Skip to main content

Publish administration: Specifying Distcp and Hive Queue for publish jobs

A user may want to assign execution of a workflow to an explicit queue to allocate cluster resources/capacity among users and groups. To do that, users can specify a queue name for the Hive and Distcp tasks that execute with publish jobs and are added to the workorder. These properties are specified in Discovery (internal properties); the configurations are automatically transmitted to Hadoop cluster settings and MapReduce (mapred-site.xml) arguments.

Hive queue specification: export.conf.hive.mapreduce.job.queuename=newqueue.name

Distcp queue specification: export.conf.hadoop.mapreduce.job.queuename=newqueue.name

Usage of these optional properties is dependent on cluster and resource management practices specific to the target environment. Note that these properties can be set at either source (inherited by entity) or applied at the entity level.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!