Skip to content

Instantly share code, notes, and snippets.

@pcheliniy
Last active May 2, 2025 13:19
Show Gist options
  • Save pcheliniy/cd68fbda6f885ff154d23f03ff8f4d90 to your computer and use it in GitHub Desktop.
Save pcheliniy/cd68fbda6f885ff154d23f03ff8f4d90 to your computer and use it in GitHub Desktop.

Revisions

  1. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 17 additions and 1 deletion.
    18 changes: 17 additions & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -82,4 +82,20 @@ http://ambari:8080/api/v1/clusters/analytics/services/STORM
    | Phoneix Query Server | PHOENIX_QUERY_SERVER | HBASE | 0+ |
    | Storm Supervisor | SUPERVISOR | STORM | 1+ |
    | Ganglia Metrics Collector | GANGLIA_MONITOR | GANGLIA | ALL |
    | Ambari Metrics Collector | METRICS_MONITOR | AMS | ALL |
    | Ambari Metrics Collector | METRICS_MONITOR | AMS | ALL |

    ## Clients
    | Name | Ambari Component Name | Service | Cardinality |
    | ------ | ------ | ------ | -----: |
    | HDFS Client | HDFS_CLIENT | HDFS | 1+ |
    | YARN Client | YARN_CLIENT | YARN | 1+ |
    | MapReduce Client | MAPREDUCE2_CLIENT | MAPREDUCE2 | 1+ |
    | Spark Client | SPARK_CLIENT | SPARK | 1+ |
    | Falcon Client | FALCON_CLIENT | FALCON | 1+ |
    | HBase Client | HBASE_CLIENT | HBASE | 1+ |
    | Hive Client | HIVE_CLIENT | HIVE | 1+ |
    | HCat Client | HCAT | HIVE | 1+ |
    | Mahout Client | MAHOUT | MAHOUT | 0+ |
    | Oozie Client | OOZIE_CLIENT | OOZIE | 1+ |
    | Sqoop Client | SQOOP | SQOOP | 1+ |
    | Zookeeper Client | ZOOKEEPER_CLIENT | ZOOKEEPER | 1+ |
  2. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 15 additions and 1 deletion.
    16 changes: 15 additions & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -68,4 +68,18 @@ http://ambari:8080/api/v1/clusters/analytics/services/STORM
    | Ganglia Server | GANGLIA_SERVER | GANGLIA | 1 |
    | Nagios Server | NAGIOS_SERVER | NAGIOS | 1 |
    | Ambari Metrics Service | METRICS_COLLECTOR | AMS | 1 |
    | Zeppelin Server | ZEPPELIN_MASTER | SPARK / HIVE | 1 |
    | Zeppelin Server | ZEPPELIN_MASTER | SPARK / HIVE | 1 |

    ## Slave Services
    | Name | Ambari Component Name | Service | Cardinality |
    | ------ | ------ | ------ | -----: |
    | DataNode | DATANODE | HDFS | 1+ |
    | Journale Nodes for NameNode HA | JOURNALNODE | HDFS | 0+ (odd #) |
    | Zookeeper Failover Service | ZKFC | HDFS | 0+ |
    | Secondary NameNode | NFS_GATEWAY | HDFS | 0+ |
    | Node Manager | NODEMANAGER |YARN | 1+ |
    | HBase RegionServer | HBASE_REGIONSERVER | HBASE | 1+ |
    | Phoneix Query Server | PHOENIX_QUERY_SERVER | HBASE | 0+ |
    | Storm Supervisor | SUPERVISOR | STORM | 1+ |
    | Ganglia Metrics Collector | GANGLIA_MONITOR | GANGLIA | ALL |
    | Ambari Metrics Collector | METRICS_MONITOR | AMS | ALL |
  3. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 15 additions and 1 deletion.
    16 changes: 15 additions & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -54,4 +54,18 @@ http://ambari:8080/api/v1/clusters/analytics/services/STORM
    | HBase Master | HBASE_MASTER | HBASE | 1+ |
    | Spark Job History Server | SPARK_JOBHISTORYSERVER | SPARK | 1 |
    | Nimbus Server | NIMBUS | STORM | 1 |
    | Storm REST Server | STORM_REST_API | STORM | 1 |
    | Storm REST Server | STORM_REST_API | STORM | 1 |
    | Storm UI | STORM_UI_SERVER | STORM | 1 | |
    | DRPC Server | DRPC_SERVER | STORM | 1 |
    | Falcon Server | FALCON_SERVER | FALCON | 1 |
    | Zookeeper | ZOOKEEPER_SERVER | ZOOKEEPER | 1+ (odd #) |
    | Kafka Broker | KAFKA_BROKER | KAFKA | 1+ |
    | Knox Gateway | KNOX_GATEWAY | KNOX | 1+ |
    | Ranger Admin Server | RANGER_ADMIN | RANGER | 1-3 |
    | Ranger User Sync | RANGER_USERSYNC | RANGER | 1 |
    | Ranger Key Management Server | RANGER_KMS_SERVER | RANGER_KMS | 1+ |
    | Oozie Server | OOZIE_SERVER | OOZIE | 1 |
    | Ganglia Server | GANGLIA_SERVER | GANGLIA | 1 |
    | Nagios Server | NAGIOS_SERVER | NAGIOS | 1 |
    | Ambari Metrics Service | METRICS_COLLECTOR | AMS | 1 |
    | Zeppelin Server | ZEPPELIN_MASTER | SPARK / HIVE | 1 |
  4. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 17 additions and 0 deletions.
    17 changes: 17 additions & 0 deletions ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -38,3 +38,20 @@ http://ambari:8080/api/v1/clusters/analytics/services/STORM
    | UPGRADING | In the process of upgrading the deployed bits. |
    | DISABLED | Disabled master’s backup state. |
    | UNKNOWN | State could not be determined. |

    ##Master Services

    | Name | Ambari Component Name | Service | Cardinality |
    | ------ | ------ | ------ | -----: |
    | NameNode | NAMENODE | HDFS | 1-2 |
    | Secondary NameNode | SECONDARY_NAMENODE | HDFS | 1 |
    | ResourceManger | RESOURCEMANAGER | YARN | 1-2 |
    | Application Timeline Server | APP_TIMELINE_SERVER | YARN | 1 |
    | HistoryServer | HISTORYSERVER | MAPREDUCE2 | 1 |
    | Hive Metastore | HIVE_METASTORE | HIVE | 1-2 |
    | HiveServer2 | HIVE_SERVER | HIVE | 1-2 |
    | WebHcat Server | WEBHCAT_SERVER | HIVE | 1 |
    | HBase Master | HBASE_MASTER | HBASE | 1+ |
    | Spark Job History Server | SPARK_JOBHISTORYSERVER | SPARK | 1 |
    | Nimbus Server | NIMBUS | STORM | 1 |
    | Storm REST Server | STORM_REST_API | STORM | 1 |
  5. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 14 additions and 3 deletions.
    17 changes: 14 additions & 3 deletions ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -4,11 +4,22 @@ curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE \
    http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    ~~~
    ##### Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    ~~~
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST \
    http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    ~~~
    ##### attach components to new host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST -d '{"host_components" : [{"HostRoles":{"component_name":"NIMBUS"}}] }' http://ambari:8080/api/v1/clusters/analytics/hosts?Hosts/host_name=hdp.new.host
    ~~~
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST \
    -d '{"host_components" : [{"HostRoles":{"component_name":"NIMBUS"}}] }' \
    http://ambari:8080/api/v1/clusters/analytics/hosts?Hosts/host_name=hdp.new.host
    ~~~
    ##### change status to installed
    curl -u admin:admin -H "X-Requested-By: ambari" -i -X PUT -d '{"ServiceInfo": {"state" : "INSTALLED"}}' http://ambari:8080/api/v1/clusters/analytics/services/STORM
    ~~~
    curl -u admin:admin -H "X-Requested-By: ambari" -i -X PUT \
    -d '{"ServiceInfo": {"state" : "INSTALLED"}}' \
    http://ambari:8080/api/v1/clusters/analytics/services/STORM
    ~~~

    ## States

  6. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 2 additions and 1 deletion.
    3 changes: 2 additions & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -1,6 +1,7 @@
    ##### remove components
    ~~~
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE \
    http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    ~~~
    ##### Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
  7. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 2 additions and 0 deletions.
    2 changes: 2 additions & 0 deletions ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -1,5 +1,7 @@
    ##### remove components
    ~~~
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    ~~~
    ##### Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    ##### attach components to new host
  8. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 4 additions and 4 deletions.
    8 changes: 4 additions & 4 deletions ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -1,10 +1,10 @@
    #####remove components
    ##### remove components
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # Add new componentns not attached to host
    ##### Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # attach components to new host
    ##### attach components to new host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST -d '{"host_components" : [{"HostRoles":{"component_name":"NIMBUS"}}] }' http://ambari:8080/api/v1/clusters/analytics/hosts?Hosts/host_name=hdp.new.host
    # change status to installed
    ##### change status to installed
    curl -u admin:admin -H "X-Requested-By: ambari" -i -X PUT -d '{"ServiceInfo": {"state" : "INSTALLED"}}' http://ambari:8080/api/v1/clusters/analytics/services/STORM

    ## States
  9. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    ###remove components
    #####remove components
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
  10. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    #remove components
    ###remove components
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
  11. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion ambari-service-move.md
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    # remove components
    #remove components
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
  12. pcheliniy renamed this gist Aug 18, 2016. 1 changed file with 0 additions and 0 deletions.
    File renamed without changes.
  13. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 3 additions and 2 deletions.
    5 changes: 3 additions & 2 deletions ambari-service-move
    Original file line number Diff line number Diff line change
    @@ -7,8 +7,9 @@ curl -u admin:admin -H "X-Requested-By: ambari" -X POST -d '{"host_components" :
    # change status to installed
    curl -u admin:admin -H "X-Requested-By: ambari" -i -X PUT -d '{"ServiceInfo": {"state" : "INSTALLED"}}' http://ambari:8080/api/v1/clusters/analytics/services/STORM

    States
    | State Description
    ## States

    | State | Description |
    | ------ | -----: |
    | INIT | Initial/Clean state. |
    | INSTALLING | In the process of installing. |
  14. pcheliniy revised this gist Aug 18, 2016. 1 changed file with 15 additions and 14 deletions.
    29 changes: 15 additions & 14 deletions ambari-service-move
    Original file line number Diff line number Diff line change
    @@ -8,17 +8,18 @@ curl -u admin:admin -H "X-Requested-By: ambari" -X POST -d '{"host_components" :
    curl -u admin:admin -H "X-Requested-By: ambari" -i -X PUT -d '{"ServiceInfo": {"state" : "INSTALLED"}}' http://ambari:8080/api/v1/clusters/analytics/services/STORM

    States
    State Description
    INIT Initial/Clean state.
    INSTALLING In the process of installing.
    INSTALL_FAILED Install failed.
    INSTALLED State when install completed successfully.
    STARTING In the process of starting.
    STARTED State when start completed successfully.
    STOPPING In the process of stopping.
    UNINSTALLING In the process of uninstalling.
    UNINSTALLED State when uninstall completed successfully.
    WIPING_OUT In the process of wiping out the install.
    UPGRADING In the process of upgrading the deployed bits.
    DISABLED Disabled master’s backup state.
    UNKNOWN State could not be determined.
    | State Description
    | ------ | -----: |
    | INIT | Initial/Clean state. |
    | INSTALLING | In the process of installing. |
    | INSTALL_FAILED | Install failed. |
    | INSTALLED | State when install completed successfully. |
    | STARTING | In the process of starting. |
    | STARTED | State when start completed successfully. |
    | STOPPING | In the process of stopping. |
    | UNINSTALLING | In the process of uninstalling. |
    | UNINSTALLED | State when uninstall completed successfully. |
    | WIPING_OUT | In the process of wiping out the install. |
    | UPGRADING | In the process of upgrading the deployed bits. |
    | DISABLED | Disabled master’s backup state. |
    | UNKNOWN | State could not be determined. |
  15. pcheliniy created this gist Aug 18, 2016.
    24 changes: 24 additions & 0 deletions ambari-service-move
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,24 @@
    # remove components
    curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # Add new componentns not attached to host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST http://ambari:8080/api/v1/clusters/analytics/services/STORM/components/NIMBUS
    # attach components to new host
    curl -u admin:admin -H "X-Requested-By: ambari" -X POST -d '{"host_components" : [{"HostRoles":{"component_name":"NIMBUS"}}] }' http://ambari:8080/api/v1/clusters/analytics/hosts?Hosts/host_name=hdp.new.host
    # change status to installed
    curl -u admin:admin -H "X-Requested-By: ambari" -i -X PUT -d '{"ServiceInfo": {"state" : "INSTALLED"}}' http://ambari:8080/api/v1/clusters/analytics/services/STORM

    States
    State Description
    INIT Initial/Clean state.
    INSTALLING In the process of installing.
    INSTALL_FAILED Install failed.
    INSTALLED State when install completed successfully.
    STARTING In the process of starting.
    STARTED State when start completed successfully.
    STOPPING In the process of stopping.
    UNINSTALLING In the process of uninstalling.
    UNINSTALLED State when uninstall completed successfully.
    WIPING_OUT In the process of wiping out the install.
    UPGRADING In the process of upgrading the deployed bits.
    DISABLED Disabled master’s backup state.
    UNKNOWN State could not be determined.