GIS Cloud Suite

Add The Hadoop YARN Cluster

GIS Cloud Suite supports to add internal and external Hadoop YARN cluster. The internal one is the built-in Hadoop YARN cluster in GIS Cloud Suite. The external one is the Hadoop YARN cluster build by users, it is required to configure and add to GIS Cloud Suite. Please follow the steps below to add Hadoop YARN cluster.

Add Built-in Hadoop YARN Cluster

  1. Clicks on Computing Resources > Hadoop YARN Cluster on the left navigation bar.
  2. Clicks Enable on the Hadoop YARN Cluster page.

    openhadoopyarn

  3. After the Hadoop YARN environment get started up, the system would add built-in Hadoop YARN Cluster to Distributed Analyst Service automatically.

    Notes:

    When opening Distributed Analyst Service, select Builtin Hadoop YARN in the Computing Resources option.

Add External Hadoop YARN Cluster

  1. Clicks on Computing Resources > Hadoop YARN Cluster on the left navigation bar.
  2. Clicks on Add Hadoop YARN Cluster.
  3. Fills out the following information to add the Hadoop YARN Cluster.

    addhadoopyarntocomputelist

    • Name(Required): The name of the computing resource, the name is customizable.
    • Computing Resource type(Required): Hadoop YARN Cluster.
    • Cluster configuration directory(Required): The directory(hadoop package/etc/hadoop) of Hadoop YARN master node. Follow the steps below to fill out the directory:

      1. Enter the hadoop package/etc/hadoop directory by using simulation software such as Xshell.
      2. Copy and paste the hadoop directory to anywhere of local machine.
      3. Clicks Select on the Add Hadoop YARN Cluster page, create a new folder and upload all the files in hadoop directory(step 2).
      4. After the files finish uploading, select the folder and click on OK.
    • Add hostname resolution(Required): Please refer to GIS Cloud Suite > Configuration Management > Hostname Resolution.
    • The cluster has been started with Kerberos authentication: (If you open Kerberos authentication, please fiil out the following information)

      • Subject name: The format is ‘username@domain’, such as iserver@SUPERMAP.COM. The username must be a system user in Hadoop YARN master node. The domain is set by Kerberos service, and must be the same as domain of Hadopp YARN cluster.
      • Key file path: The path of the key files in GIS Cloud Suite host machine. The key files were generated when building the cluster. You need to copy the key files to GIS Cloud Suite host machine.
      • Profile path: The path of the Kerberos client configuration files in GIS Cloud Suite host machine.
  4. Clicks on Add, the new added Hadoop YARN cluster would be displayed in the list.

    Notes:

    Build and configure external Hadoop YARN Cluster please see SuperMap iServer Documentation.