Failed to receive heartbeat from agent. (Current Step) - cloudera-manager

Question

I keep getting
35.162.183.137
Retry | Details Installation failed. Failed to receive heartbeat from agent.
How do I fix this? I am unable to add any hosts because of this issue.
Also, cloudera-scm-agent log file looks like this:
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[01/Nov/2016 18:02:20 +0000] 6468 MainThread parcel INFO Agent does create users/groups and apply file permissions
[01/Nov/2016 18:02:20 +0000] 6468 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[01/Nov/2016 18:02:20 +0000] 6468 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Flood daemon (re)start attempt
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Created /opt/cloudera/parcels/.flood
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chowning /opt/cloudera/parcels/.flood to cloudera-scm (498) cloudera-scm (498)
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chmod'ing /opt/cloudera/parcels/.flood to 0755
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Triggering supervisord update.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread downloader ERROR Failed rack peer update: [Errno 111] Connection refused
[01/Nov/2016 18:02:20 +0000] 6468 MainThread firehoses INFO Reporting interval updated: 5.0 -> 60
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Active parcel list updated; recalculating component info.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/java/default java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version misc.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/java/jdk1.6.0_31 java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version 6.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread throttling_logger INFO Identified java component java7 with full version JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) for requested version 7.
[01/Nov/2016 18:02:49 +0000] 6468 DnsResolutionMonitor throttling_logger INFO Using java location: '/usr/java/jdk1.7.0_67-cloudera/bin/java'.
[01/Nov/2016 18:03:19 +0000] 6468 MonitorDaemon-Reporter firehoses INFO Creating a connection to the ACTIVITYMONITOR.
[01/Nov/2016 18:03:19 +0000] 6468 MonitorDaemon-Reporter firehoses INFO Creating a connection to the SERVICEMONITOR.
[01/Nov/2016 18:03:19 +0000] 6468 MonitorDaemon-Reporter firehoses INFO Creating a connection to the HOSTMONITOR.
[01/Nov/2016 18:03:49 +0000] 6468 MonitorDaemon-Reporter throttling_logger ERROR Error sending messages to firehose: mgmt-HOSTMONITOR-5ccf80948a373fcc0e29b2976ccf7c19
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/monitor/firehose.py", line 116, in _send
self._port)
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 742, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
timeout: timed out
I can't figure out the problem with this. Could I get help please.
I have checked and I can ping the new host (from and to) existing host just fine.
ntpd is running
ip6 tables are not running
This new host I am trying to add in AWS ec2 instance with centos 6.7
My existing host is centos 6.7 as well
Also, just in case needed, here is the log details I get in CM:
Support
admin
Add New Hosts to Cluster
Installation failed on all hosts.
0 of 1 host(s) completed successfully.
Uninstalled on 1 host(s) after installation failure. Retry Failed Hosts
Hostname IP Address Progress Status
ec2-35-162-192-55.us-west-2.compute.amazonaws.com 35.162.192.55
Retry | Details Installation failed. Failed to receive heartbeat from agent.
Ensure that the host's hostname is configured properly.
Ensure that port 7182 is accessible on the Cloudera Manager Server (check firewall rules).
Ensure that ports 9000 and 9001 are not in use on the host being added.
Check agent logs in /var/log/cloudera-scm-agent/ on the host being added. (Some of the logs can be found in the installation details).
If Use TLS Encryption for Agents is enabled in Cloudera Manager (Administration -> Settings -> Security), ensure that /etc/cloudera-scm-agent/config.ini has use_tls=1 on the host being added. Restart the corresponding agent and click the Retry link here.
Failed to receive heartbeat from agent. (Current Step) Last Refreshed: Nov 1, 2016 11:37:35 PM IST
/tmp/scm_prepare_node.pc1ddUen
using SSH_CLIENT to get the SCM hostname: 182.18.170.55 37842 22
opening logging file descriptor
Starting installation script...
Acquiring installation lock...
BEGIN flock 4
END (0)
Detecting root privileges...
effective UID is 0
Detecting distribution...
BEGIN grep Tikanga /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 5' /etc/redhat-release
END (1)
BEGIN grep 'Scientific Linux release 5' /etc/redhat-release
END (1)
BEGIN grep Santiago /etc/redhat-release
END (1)
BEGIN grep 'CentOS Linux release 6' /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 6' /etc/redhat-release
CentOS release 6.7 (Final)
END (0)
/etc/redhat-release ==> CentOS 6
Detecting Cloudera Manager Server...
BEGIN host -t PTR 182.18.170.55
END (127)
/tmp/scm_prepare_node.pc1ddUen/scm_prepare_node.sh: line 105: host: command not found
BEGIN which python
/usr/bin/python
END (0)
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 182.18.170.55 7182
END (0)
BEGIN which wget
which: no wget in (/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin)
END (1)
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo
/tmp/scm_prepare_node.pc1ddUen/scm_prepare_node.sh: line 105: wget: command not found
END (127)
Installing package repositories...
validating format of repository file /tmp/scm_prepare_node.pc1ddUen/repos/rhel6/cloudera-manager.repo
installing repository file /tmp/scm_prepare_node.pc1ddUen/repos/rhel6/cloudera-manager.repo
repository file /tmp/scm_prepare_node.pc1ddUen/repos/rhel6/cloudera-manager.repo installed
Refreshing package metadata...
BEGIN yum clean all
Loaded plugins: fastestmirror, presto
Cleaning repos: base cloudera-manager extras updates
Cleaning up Everything
Cleaning up list of fastest mirrors
0 delta-package files removed, by presto
END (0)
BEGIN rm -Rf /var/cache/yum/CentOS6-Base /var/cache/yum/CentOS6-Extras /var/cache/yum/CentOS6-Updates /var/cache/yum/timedhosts.txt /var/cache/yum/x86_64
END (0)
BEGIN yum makecache
Loaded plugins: fastestmirror, presto
Metadata Cache Created
END (0)
Installing jdk package...
BEGIN yum list installed jdk
Loaded plugins: fastestmirror, presto
Error: No matching Packages to list
END (1)
BEGIN yum info jdk
Loaded plugins: fastestmirror, presto
Determining fastest mirrors
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Available Packages
Name : jdk
Arch : x86_64
Epoch : 2000
Version : 1.6.0_31
Release : fcs
Size : 68 M
Repo : cloudera-manager
Summary : Java(TM) Platform Standard Edition Development Kit
URL : http://java.sun.com/
License : Copyright (c) 2011, Oracle and/or its affiliates. All rights
: reserved. Also under other license(s) as shown at the Description
: field.
Description : The Java Platform Standard Edition Development Kit (JDK) includes
: both the runtime environment (Java virtual machine, the Java
: platform classes and supporting files) and development tools
: (compilers, debuggers, tool libraries and other tools).
:
: The JDK is a development environment for building applications,
: applets and components that can be deployed with the Java Platform
: Standard Edition Runtime Environment.
END (0)
BEGIN yum -y install jdk.x86_64
Loaded plugins: fastestmirror, presto
Setting up Install Process
================================================================================
Installing:
jdk x86_64 2000:1.6.0_31-fcs cloudera-manager 68 M
Transaction Summary
================================================================================
Install 1 Package(s)
Total download size: 68 M
Installed size: 143 M
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Package(s) data still to download: 68 M
warning: rpmts_HdrFromFdno: V4 DSA/SHA1 Signature, key ID e8f86acd: NOKEY
Retrieving key from https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
Importing GPG key 0xE8F86ACD:
Userid: "Yum Maintainer <webmaster#cloudera.com>"
From : https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : 2000:jdk-1.6.0_31-fcs.x86_64 1/1
Unpacking JAR files...
rt.jar...
jsse.jar...
charsets.jar...
tools.jar...
localedata.jar...
plugin.jar...
javaws.jar...
deploy.jar...
Verifying : 2000:jdk-1.6.0_31-fcs.x86_64 1/1
Installed:
jdk.x86_64 2000:1.6.0_31-fcs
Complete!
END (0)
remote package jdk installed
Installing oracle-j2sdk1.7 package...
BEGIN yum list installed oracle-j2sdk1.7
Loaded plugins: fastestmirror, presto
Error: No matching Packages to list
END (1)
BEGIN yum info oracle-j2sdk1.7
Loaded plugins: fastestmirror, presto
Resolving Dependencies
--> Running transaction check
---> Package oracle-j2sdk1.7.x86_64 0:1.7.0+update67-1 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
oracle-j2sdk1.7 x86_64 1.7.0+update67-1 cloudera-manager 135 M
Transaction Summary
================================================================================
Install 1 Package(s)
Total download size: 135 M
Installed size: 279 M
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Package(s) data still to download: 135 M
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : oracle-j2sdk1.7-1.7.0+update67-1.x86_64 1/1
Verifying : oracle-j2sdk1.7-1.7.0+update67-1.x86_64 1/1
Installed:
oracle-j2sdk1.7.x86_64 0:1.7.0+update67-1
Complete!
END (0)
remote package oracle-j2sdk1.7 installed
Installing cloudera-manager-agent package...
BEGIN yum list installed cloudera-manager-agent
Loaded plugins: fastestmirror, presto
Error: No matching Packages to list
END (1)
BEGIN yum info cloudera-manager-agent
Loaded plugins: fastestmirror, presto
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Available Packages
Name : cloudera-manager-agent
Arch : x86_64
Version : 5.7.0
Release : 1.cm570.p0.76.el6
Size : 7.5 M
Repo : cloudera-manager
Summary : The Cloudera Manager Agent
URL : http://www.cloudera.com
License : Proprietary
Description : The Cloudera Manager Agent.
:
: The Agent is deployed to machines running services managed by
: Cloudera Manager.
END (0)
Version : 5.7.0
Release : 1.cm570.p0.76.el6
BEGIN yum -y install cloudera-manager-agent
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Resolving Dependencies
--> Running transaction check
---> Package cloudera-manager-agent.x86_64 0:5.7.0-1.cm570.p0.76.el6 will be installed
--> Processing Dependency: cloudera-manager-daemons = 5.7.0 for package: cloudera-manager-agent-5.7.0-1.cm570.p0.76.el6.x86_64
--> Processing Dependency: /lib/lsb/init-functions for package: cloudera-manager-agent-5.7.0-1.cm570.p0.76.el6.x86_64
--> Running transaction check
--> Processing Dependency: openssl = 1.0.1e-48.el6_8.3 for package: openssl-devel-1.0.1e-48.el6_8.3.x86_64
--> Processing Dependency: zlib-devel for package: openssl-devel-1.0.1e-48.el6_8.3.x86_64
--> Processing Dependency: krb5-devel for package: openssl-devel-1.0.1e-48.el6_8.3.x86_64
---> Package perl.x86_64 4:5.10.1-141.el6_7.1 will be installed
--> Processing Dependency: perl-libs = 4:5.10.1-141.el6_7.1 for package: 4:perl-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: perl-libs for package: 4:perl-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: perl(version) for package: 4:perl-5.10.1-141.el6_7.1.x86_64
---> Package python-psycopg2.x86_64 0:2.0.14-2.el6 will be installed
--> Processing Dependency: libpq.so.5()(64bit) for package: python-psycopg2-2.0.14-2.el6.x86_64
---> Package redhat-lsb-core.x86_64 0:4.0-7.el6.centos will be installed
--> Processing Dependency: perl-Test-Simple for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: perl-Test-Harness for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: perl-ExtUtils-MakeMaker for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: perl-CGI for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/time for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/pax for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/patch for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/msgfmt for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/batch for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/at for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /bin/mailx for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /bin/gettext for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /bin/ed for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
---> Package rpcbind.x86_64 0:0.2.0-12.el6 will be installed
--> Processing Dependency: libgssglue for package: rpcbind-0.2.0-12.el6.x86_64
--> Processing Dependency: libtirpc.so.1()(64bit) for package: rpcbind-0.2.0-12.el6.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.3.9-5.el6_2 will be installed
---> Package apr-util.x86_64 0:1.3.9-3.el6_0.1 will be installed
---> Package apr-util-ldap.x86_64 0:1.3.9-3.el6_0.1 will be installed
---> Package at.x86_64 0:3.1.10-48.el6 will be installed
---> Package bind-libs.x86_64 32:9.8.2-0.47.rc1.el6_8.2 will be installed
---> Package ed.x86_64 0:1.1-3.3.el6 will be installed
---> Package gettext.x86_64 0:0.17-18.el6 will be installed
--> Processing Dependency: libgomp.so.1(GOMP_1.0)(64bit) for package: gettext-0.17-18.el6.x86_64
--> Processing Dependency: cvs for package: gettext-0.17-18.el6.x86_64
--> Processing Dependency: libgomp.so.1()(64bit) for package: gettext-0.17-18.el6.x86_64
---> Package httpd-tools.x86_64 0:2.2.15-54.el6.centos will be installed
---> Package krb5-devel.x86_64 0:1.10.3-57.el6 will be installed
--> Processing Dependency: krb5-libs = 1.10.3-57.el6 for package: krb5-devel-1.10.3-57.el6.x86_64
--> Processing Dependency: libselinux-devel for package: krb5-devel-1.10.3-57.el6.x86_64
--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.10.3-57.el6.x86_64
--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.10.3-57.el6.x86_64
---> Package libgssglue.x86_64 0:0.1-11.el6 will be installed
---> Package libtirpc.x86_64 0:0.2.1-11.el6_8 will be installed
---> Package mailcap.noarch 0:2.1.31-2.el6 will be installed
---> Package mailx.x86_64 0:12.4-8.el6_6 will be installed
---> Package openssl.x86_64 0:1.0.1e-42.el6_7.2 will be updated
---> Package openssl.x86_64 0:1.0.1e-48.el6_8.3 will be an update
---> Package patch.x86_64 0:2.6-6.el6 will be installed
---> Package pax.x86_64 0:3.4-10.1.el6 will be installed
---> Package perl-CGI.x86_64 0:3.51-141.el6_7.1 will be installed
---> Package perl-ExtUtils-MakeMaker.x86_64 0:6.55-141.el6_7.1 will be installed
--> Processing Dependency: perl-devel for package: perl-ExtUtils-MakeMaker-6.55-141.el6_7.1.x86_64
---> Package perl-Module-Pluggable.x86_64 1:3.90-141.el6_7.1 will be installed
---> Package perl-Pod-Simple.x86_64 1:3.13-141.el6_7.1 will be installed
--> Processing Dependency: perl(Pod::Escapes) >= 1.04 for package: 1:perl-Pod-Simple-3.13-141.el6_7.1.x86_64
---> Package perl-Test-Harness.x86_64 0:3.17-141.el6_7.1 will be installed
---> Package perl-Test-Simple.x86_64 0:0.92-141.el6_7.1 will be installed
---> Package perl-libs.x86_64 4:5.10.1-141.el6_7.1 will be installed
---> Package perl-version.x86_64 3:0.77-141.el6_7.1 will be installed
---> Package postgresql-libs.x86_64 0:8.4.20-6.el6 will be installed
---> Package time.x86_64 0:1.7-38.el6 will be installed
---> Package zlib-devel.x86_64 0:1.2.3-29.el6 will be installed
--> Running transaction check
---> Package cvs.x86_64 0:1.11.23-16.el6 will be installed
---> Package keyutils-libs-devel.x86_64 0:1.4-5.el6 will be installed
---> Package krb5-libs.x86_64 0:1.10.3-42.el6 will be updated
---> Package krb5-libs.x86_64 0:1.10.3-57.el6 will be an update
---> Package libcom_err-devel.x86_64 0:1.41.12-22.el6 will be installed
---> Package libgomp.x86_64 0:4.4.7-17.el6 will be installed
---> Package libselinux-devel.x86_64 0:2.0.94-7.el6 will be installed
--> Processing Dependency: libselinux = 2.0.94-7.el6 for package: libselinux-devel-2.0.94-7.el6.x86_64
--> Processing Dependency: libsepol-devel >= 2.0.32-1 for package: libselinux-devel-2.0.94-7.el6.x86_64
--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.0.94-7.el6.x86_64
---> Package perl-Pod-Escapes.x86_64 1:1.04-141.el6_7.1 will be installed
---> Package perl-devel.x86_64 4:5.10.1-141.el6_7.1 will be installed
--> Processing Dependency: perl(ExtUtils::ParseXS) for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: glibc-devel for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: gdbm-devel for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: db4-devel for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Running transaction check
---> Package db4-devel.x86_64 0:4.7.25-20.el6_7 will be installed
--> Processing Dependency: db4-cxx = 4.7.25-20.el6_7 for package: db4-devel-4.7.25-20.el6_7.x86_64
--> Processing Dependency: libdb_cxx-4.7.so()(64bit) for package: db4-devel-4.7.25-20.el6_7.x86_64
---> Package gdbm-devel.x86_64 0:1.8.0-39.el6 will be installed
--> Processing Dependency: gdbm = 1.8.0-39.el6 for package: gdbm-devel-1.8.0-39.el6.x86_64
---> Package glibc-devel.x86_64 0:2.12-1.192.el6 will be installed
--> Processing Dependency: glibc-headers = 2.12-1.192.el6 for package: glibc-devel-2.12-1.192.el6.x86_64
--> Processing Dependency: glibc = 2.12-1.192.el6 for package: glibc-devel-2.12-1.192.el6.x86_64
--> Processing Dependency: glibc-headers for package: glibc-devel-2.12-1.192.el6.x86_64
---> Package libselinux.x86_64 0:2.0.94-5.8.el6 will be updated
--> Processing Dependency: libselinux = 2.0.94-5.8.el6 for package: libselinux-utils-2.0.94-5.8.el6.x86_64
--> Processing Dependency: libselinux = 2.0.94-5.8.el6 for package: libselinux-python-2.0.94-5.8.el6.x86_64
---> Package libselinux.x86_64 0:2.0.94-7.el6 will be an update
---> Package libsepol-devel.x86_64 0:2.0.41-4.el6 will be installed
---> Package perl-ExtUtils-ParseXS.x86_64 1:2.2003.0-141.el6_7.1 will be installed
--> Running transaction check
---> Package db4-cxx.x86_64 0:4.7.25-20.el6_7 will be installed
---> Package gdbm.x86_64 0:1.8.0-38.el6 will be updated
---> Package gdbm.x86_64 0:1.8.0-39.el6 will be an update
---> Package glibc.x86_64 0:2.12-1.166.el6_7.7 will be updated
--> Processing Dependency: glibc = 2.12-1.166.el6_7.7 for package: glibc-common-2.12-1.166.el6_7.7.x86_64
---> Package glibc.x86_64 0:2.12-1.192.el6 will be an update
---> Package glibc-headers.x86_64 0:2.12-1.192.el6 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.12-1.192.el6.x86_64
--> Processing Dependency: kernel-headers for package: glibc-headers-2.12-1.192.el6.x86_64
---> Package libselinux-python.x86_64 0:2.0.94-5.8.el6 will be updated
---> Package libselinux-python.x86_64 0:2.0.94-7.el6 will be an update
---> Package libselinux-utils.x86_64 0:2.0.94-5.8.el6 will be updated
---> Package libselinux-utils.x86_64 0:2.0.94-7.el6 will be an update
--> Running transaction check
---> Package glibc-common.x86_64 0:2.12-1.166.el6_7.7 will be updated
---> Package glibc-common.x86_64 0:2.12-1.192.el6 will be an update
---> Package kernel-headers.x86_64 0:2.6.32-642.6.2.el6 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
cloudera-manager-agent x86_64 5.7.0-1.cm570.p0.76.el6 cloudera-manager 7.5 M
Installing for dependencies:
MySQL-python x86_64 1.2.3-0.3.c1.1.el6 base 86 k
libselinux x86_64 2.0.94-7.el6 base 109 k
libselinux-python x86_64 2.0.94-7.el6 base 203 k
libselinux-utils x86_64 2.0.94-7.el6 base 82 k
openssl x86_64 1.0.1e-48.el6_8.3 updates 1.5 M
Transaction Summary
================================================================================
Install 57 Package(s)
Upgrade 8 Package(s)
Total download size: 601 M
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Download delta size: 447 k
Presto reduced the update size by 72% (from 1.5 M to 447 k).
Package(s) data still to download: 600 M
--------------------------------------------------------------------------------
Total 20 MB/s | 600 MB 00:30
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Dependency Updated:
Complete!
END (0)
remote package cloudera-manager-agent installed
Installing cloudera-manager-daemons package...
BEGIN yum list installed cloudera-manager-daemons
Loaded plugins: fastestmirror, presto
Installed Packages
cloudera-manager-daemons.x86_64 5.7.0-1.cm570.p0.76.el6 #cloudera-manager
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info cloudera-manager-daemons
Loaded plugins: fastestmirror, presto
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Installed Packages
Name : cloudera-manager-daemons
Arch : x86_64
Version : 5.7.0
Release : 1.cm570.p0.76.el6
Size : 861 M
Repo : installed
From repo : cloudera-manager
Summary : Provides daemons for monitoring Hadoop and related tools.
URL : http://www.cloudera.com
License : Proprietary
Description : This package includes daemons for monitoring and managing Hadoop.
END (0)
Version : 5.7.0
Release : 1.cm570.p0.76.el6
BEGIN yum -y install cloudera-manager-daemons
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Package cloudera-manager-daemons-5.7.0-1.cm570.p0.76.el6.x86_64 already installed and latest version
Nothing to do
END (0)
remote package cloudera-manager-daemons installed
Installing Unlimited Strength Encryption policy files.
Installation not requested. Step will be skipped.
Configuring Cloudera Manager Agent...
BEGIN grep server_host=182.18.170.55 /etc/cloudera-scm-agent/config.ini
END (1)
BEGIN sed -e 's/\(server_host=\).*/\1182.18.170.55/' -i /etc/cloudera-scm-agent/config.ini
END (0)
scm agent configured
Starting Cloudera Manager Agent...
BEGIN /sbin/service cloudera-scm-agent status
cloudera-scm-agent is stopped
END (3)
BEGIN /sbin/service cloudera-scm-agent start
Starting cloudera-scm-agent: [60G[[0;32m OK [0;39m]
END (0)
agent logs:
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/'
>>/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/parcel.py:17: DeprecationWarning: the sets module is deprecated
>> from sets import Set
>>[01/Nov/2016 18:02:16 +0000] 6456 MainThread agent INFO SCM Agent Version: 5.7.0
>>/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/parcel.py:17: DeprecationWarning: the sets module is deprecated
>> from sets import Set
>>[01/Nov/2016 18:02:16 +0000] 6456 MainThread agent INFO SCM Agent Version: 5.7.0
END (0)
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/'
tail: cannot open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No such file or directory
tail: cannot open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No such file or directory
END (0)
end of agent logs.
scm agent started
Installation script completed successfully.
all done
closing logging file descriptor

Answer 1

This is not a ping issue, because the client timeouts it sounds like a firewall issue.
Check from the client that you can reach the registration port on the server, I think it's 7182 (you can use a tool like telnet to test you can reach from the agent host to the server using that port)
If I remember correctly, the default security configuration is amazon is to only allow a few basic ports and firewall the rest.
Are both hosts in the same AWS security group?

Answer 2

I was getting similar error and it got resolved by doing the below:
Installation successfully completed now. Resolution: I did two things 1) : Disabled firewall by doing iptables -P INPUT ACCEPT iptables -P OUTPUT ACCEPT iptables -P FORWARD ACCEPT iptables -F . 2) The second thing is giving internal IP instead of external IP while adding hosts.