Last updated：2020-05-08 23:04:52
All service components of Hadoop provide complete native monitoring functions. In addition, we have also integrated Ganglia monitoring tool in KMR. SSH Tunnel should be established before accessing to these resources.
SSH Tunnel should be established before accessing to services in the cluster, and the browser should be configured as follows:
If no EIP is configured for your KMR cluster or you do not want to use SSH Tunnel, you can activate a windows cloud host under the same account. You can skip this step to access to the cluster to monitor resources through internal network address of the master node.
After the cluster is created successfully, you can obtain public network IP, user name, password and SSH port number of the master node as specified in the message sent by the system, and establish SSH Tunnel to connect the cluster through the following configuration:
Configure Firefox, and select “Remote DNS” option to parse the host correctly.
Now, you can access to native Hadoop services directly through your browser.
Ambari provides a powerful set of management and maintenance features for KMR services, including the cluster user, service installation, service monitoring, etc.
As shown in the figure below, after entering the cluster user page through Admin menu in upper right corner, we can see that Ambari has prebuilt a set of users for the Hadoop services installed. These users include two types: first, service users in Ambari system. These users are stored in the metadata repository of Ambari itself; and second, Linux users established on the target host through the Agent service. These Linux users will be used when Hadoop runs. Ambari offers highly automated cluster user function, which not only eliminates the worry of manual maintenance of the cluster users, but also provides the convenience for integrating the privilege later.
In KMR, we integrate Ambari service in the cluster, so you can access to Web console of Ambari to monitor KMR cluster. The service page is shown as follows:
Hadoop and other applications installed on KMR cluster will expose the user interface on the website hosted on the master node. These pages show statistics and monitoring information of various cluster services. Through Establish SSH Tunnel step, you can access to these pages directly with the browser.
|Spark History Server||http://master-private-IP:18080|
Did you find the above information helpful?
Please give us your feedback.
Thank you for your feedback.