On my dedicated server I currently have Elasticsearch 6 installed. I would like to upgrade to Elasticsearch 7. I'm using the "Download and install the RPM Manually" method. Here's the link that explains the steps:
https://www.elastic.co/guide/en/elasticsearch/reference/current/rpm.html
Here are my terminal steps:
[root#server ~]# wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.0.0-x86_64.rpm
--2019-04-18 17:19:20-- https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.0.0-x86_64.rpm
Resolving artifacts.elastic.co (artifacts.elastic.co)... 2a04:4e42:2e::734, 151.101.198.222
Connecting to artifacts.elastic.co (artifacts.elastic.co)|2a04:4e42:2e::734|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 346827255 (331M) [application/octet-stream]
Saving to: ‘elasticsearch-7.0.0-x86_64.rpm’
100%[=============================================================================================================================================>] 346,827,255 106MB/s in 3.3s
2019-04-18 17:19:43 (102 MB/s) - ‘elasticsearch-7.0.0-x86_64.rpm’ saved [346827255/346827255]
[root#server ~]# wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.0.0-x86_64.rpm.sha512
--2019-04-18 17:20:01-- https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.0.0-x86_64.rpm.sha512
Resolving artifacts.elastic.co (artifacts.elastic.co)... 2a04:4e42:2e::734, 151.101.198.222
Connecting to artifacts.elastic.co (artifacts.elastic.co)|2a04:4e42:2e::734|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 160 [application/octet-stream]
Saving to: ‘elasticsearch-7.0.0-x86_64.rpm.sha512’
100%[=============================================================================================================================================>] 160 --.-K/s in 0s
2019-04-18 17:20:01 (22.7 MB/s) - ‘elasticsearch-7.0.0-x86_64.rpm.sha512’ saved [160/160]
[root#server ~]# shasum -a 512 -c elasticsearch-7.0.0-x86_64.rpm.sha512
elasticsearch-7.0.0-x86_64.rpm: OK
[root#server ~]# sudo rpm --install elasticsearch-7.0.0-x86_64.rpm
warning: elasticsearch-7.0.0-x86_64.rpm: Header V4 RSA/SHA512 Signature, key ID d88e42b4: NOKEY
error: Failed dependencies:
elasticsearch < 7.0.0 is obsoleted by elasticsearch-0:7.0.0-1.x86_64
Here are my server specifications:
Centos: 7.6
Java:
openjdk version "1.8.0_201"
OpenJDK Runtime Environment (build 1.8.0_201-b09)
OpenJDK 64-Bit Server VM (build 25.201-b09, mixed mode)
Did you add the RPM repository previously? I'm not sure where else the obsoleted by elasticsearch-0:7.0.0-1.x86_64 would be coming from otherwise.
If so I'd clean the cache directory, fetch all available versions, and then install the desired one:
yum clean all
yum --showduplicate list elasticsearch
yum install elasticsearch-0:7.0.0-1.x86_64
Related
I am running the command - curl https://cli-assets.heroku.com/install-ubuntu.sh | sh
Which throws the following error -
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1232 100 1232 0 0 5133 0 --:--:-- --:--:-- --:--:-- 5112
This script requires superuser access to install apt packages.
You will be prompted for your password by sudo.
+ dpkg -s apt-transport-https
+ echo ''
sh: line 4: /etc/apt/sources.list.d/heroku.list: No such file or directory
I also ran sudo snap install --classic heroku which returned sudo: snap: command not found.
Then I ran sudo apt install snapd which returned the following -
apt: invalid flag: install
Usage: apt <apt and javac options> <source files>
where apt options include:
-classpath <path> Specify where to find user class files and annotation processor factories
-cp <path> Specify where to find user class files and annotation processor factories
-d <path> Specify where to place processor and javac generated class files
-s <path> Specify where to place processor generated source files
-source <release> Provide source compatibility with specified release
-version Version information
-help Print a synopsis of standard options; use javac -help for more options
-X Print a synopsis of nonstandard options
-J<flag> Pass <flag> directly to the runtime system
-A[key[=value]] Options to pass to annotation processors
-nocompile Do not compile source files to class files
-print Print out textual representation of specified types
-factorypath <path> Specify where to find annotation processor factories
-factory <class> Name of AnnotationProcessorFactory to use; bypasses default discovery process
See javac -help for information on javac options.
warning: The apt tool and its associated API are planned to be
removed in the next major JDK release. These features have been
superseded by javac and the standardized annotation processing API,
javax.annotation.processing and javax.lang.model. Users are
recommended to migrate to the annotation processing features of
javac; see the javac man page for more information.
Finally, I ran wget 0- wget https://toolbelt.heroku.com/install-ubuntu.sh | sh which returned
--2020-09-10 18:15:53-- http://0-/
Resolving 0- (0-)... failed: Name or service not known.
wget: unable to resolve host address ‘0-’
--2020-09-10 18:15:54-- http://wget/
Resolving wget (wget)... failed: Name or service not known.
wget: unable to resolve host address ‘wget’
--2020-09-10 18:15:54-- https://toolbelt.heroku.com/install-ubuntu.sh
Resolving toolbelt.heroku.com (toolbelt.heroku.com)... 54.164.74.108, 107.23.162.152, 34.194.108.77, ...
Connecting to toolbelt.heroku.com (toolbelt.heroku.com)|54.164.74.108|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 719 [text/plain]
Saving to: ‘install-ubuntu.sh’
install-ubuntu.sh 100%[=============================================================>] 719 --.-KB/s in 0s
2020-09-10 18:15:54 (105 MB/s) - ‘install-ubuntu.sh’ saved [719/719]
FINISHED --2020-09-10 18:15:54--
Total wall clock time: 0.4s
Downloaded: 1 files, 719 in 0s (105 MB/s)
So then, I ran bash install-ubuntu.sh which returned -
This script requires superuser access to install apt packages.
You will be prompted for your password by sudo.
sh: line 3: /etc/apt/sources.list.d/heroku.list: No such file or directory
sh: line 6: apt-key: command not found
--2020-09-10 18:16:51-- https://toolbelt.heroku.com/apt/release.key
Resolving toolbelt.heroku.com (toolbelt.heroku.com)... 54.145.36.98, 54.164.74.108, 107.23.162.152, ...
Connecting to toolbelt.heroku.com (toolbelt.heroku.com)|54.145.36.98|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737 (1.7K) [application/octet-stream]
Saving to: ‘STDOUT’
- 0%[ ] 0 --.-KB/s in 0s
Cannot write to ‘-’ (Success).
sh: line 9: apt-get: command not found
sh: line 12: apt-get: command not found
I am taking an online course on Upskill and am on video #125. Please advise how to progress.
Thanks for your time and help.
I have a gist I use specifically for setting up rails on Cloud9 (though I haven't updated it for Rails 6 yet). Recommend you read through it twice before you try to do it. You may need to go out of order in some cases, as exact approach depends on if you are cloning an existing repo or building a new app.
https://gist.github.com/MyklClason/791d6b14606bc56e72eba2995aab8e76
You probably don't need snap.
Also useful bash aliases for Cloud9:
https://gist.github.com/MyklClason/d71a39ace28b9ec9f0ad
As for your actual issue. Heroku toolbelt is obsolete, use this instead:
wget -qO- https://cli-assets.heroku.com/install-ubuntu.sh | sh
Also it's often best to just look online and check how to install the heroku cli (or anything really) for your OS using the offical documentation. Though that may not work for older setup. However, heroku is something where you basically have to use the newest version otherwise you are going to run into problems.
If you didn't figure this out...
nvm i v8
Followed by...
npm install -g heroku
I was trying to perform yum update and received the error below:
yum update
Loaded plugins: downloadonly, fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
epel/metalink | 8.5 kB 00:00
* base: mirror.newmediaexpress.com
* epel: epel.dionipe.id
* extras: mirror.newmediaexpress.com
* updates: mirror.newmediaexpress.com
appistry | 80 kB 00:00 ...
http://repo.appistry.com/centos/6/x86_64/repodata/repomd.xml: [Errno -1] Error importing repomd.xml for appistry: Damaged repomd.xml file
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: appistry. Please verify its path and try again
I have tried yum clean all followed by yum update as suggested by some sites but it does not work. Some people solved it by adding proxy to /etc/yum.conf. My problem is, I don't even see the proxy of the server. Both echo $http_proxy and echo $https_proxy show no output.
Is it possible to solve this issue without proxy? Or is there a way to bypass the proxy? Or do I have to create a proxy? Thanks in advance.
try if you can wget/curl the repo url: http://repo.appistry.com/centos/6/x86_64/repodata/repomd.xml
this would confirm the connectivity from your host
I am using centos6.5 in which successfully deployed ambari-server2.4 with 3 nodes where hadoop,yarn,strom are successfully running.
I am using this url as reference for metron installation:
https://community.hortonworks.com/articles/60805/deploying-a-fresh-metron-cluster-using-ambari-serv.html
I am getting stuck when i try to install metron in ambari-server, adding metron in ambari-repository list is succeed but when installing metron nodes and elasticsearch over target node i get below exception:
Ambari-server Console error:
2017-05-25 16:33:01,138 - Installing package elasticsearch-2.3.3 ('/usr/bin/yum -d 0 -e 0 -y install elasticsearch-2.3.3')
2017-05-25 16:33:02,132 - Execution of '/usr/bin/yum -d 0 -e 0 -y install elasticsearch-2.3.3' returned 1. Error: Cannot retrieve repository metadata (repomd.xml) for repository: METRON-0.4.0. Please verify its path and try again
2017-05-25 16:33:02,132 - Failed to install package elasticsearch-2.3.3. Executing '/usr/bin/yum clean metadata'
2017-05-25 16:33:02,497 - Retrying to install package elasticsearch-2.3.3 after 30 seconds
Command failed after 1 tries
Terminal error:
file:///localrepo/repodata/repomd.xml: [Errno 14] Could not open/read file:///localrepo/repodata/repomd.xml
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: METRON-0.4.0. Please verify its path and try again
I keep getting
35.162.183.137
Retry | Details Installation failed. Failed to receive heartbeat from agent.
How do I fix this? I am unable to add any hosts because of this issue.
Also, cloudera-scm-agent log file looks like this:
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[01/Nov/2016 18:02:20 +0000] 6468 MainThread parcel INFO Agent does create users/groups and apply file permissions
[01/Nov/2016 18:02:20 +0000] 6468 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[01/Nov/2016 18:02:20 +0000] 6468 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Flood daemon (re)start attempt
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Created /opt/cloudera/parcels/.flood
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chowning /opt/cloudera/parcels/.flood to cloudera-scm (498) cloudera-scm (498)
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Chmod'ing /opt/cloudera/parcels/.flood to 0755
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Triggering supervisord update.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread downloader ERROR Failed rack peer update: [Errno 111] Connection refused
[01/Nov/2016 18:02:20 +0000] 6468 MainThread firehoses INFO Reporting interval updated: 5.0 -> 60
[01/Nov/2016 18:02:20 +0000] 6468 MainThread agent INFO Active parcel list updated; recalculating component info.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/java/default java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version misc.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread throttling_logger INFO Identified java component java6 with full version JAVA_HOME=/usr/java/jdk1.6.0_31 java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) for requested version 6.
[01/Nov/2016 18:02:20 +0000] 6468 MainThread throttling_logger INFO Identified java component java7 with full version JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) for requested version 7.
[01/Nov/2016 18:02:49 +0000] 6468 DnsResolutionMonitor throttling_logger INFO Using java location: '/usr/java/jdk1.7.0_67-cloudera/bin/java'.
[01/Nov/2016 18:03:19 +0000] 6468 MonitorDaemon-Reporter firehoses INFO Creating a connection to the ACTIVITYMONITOR.
[01/Nov/2016 18:03:19 +0000] 6468 MonitorDaemon-Reporter firehoses INFO Creating a connection to the SERVICEMONITOR.
[01/Nov/2016 18:03:19 +0000] 6468 MonitorDaemon-Reporter firehoses INFO Creating a connection to the HOSTMONITOR.
[01/Nov/2016 18:03:49 +0000] 6468 MonitorDaemon-Reporter throttling_logger ERROR Error sending messages to firehose: mgmt-HOSTMONITOR-5ccf80948a373fcc0e29b2976ccf7c19
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/monitor/firehose.py", line 116, in _send
self._port)
File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 742, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
timeout: timed out
I can't figure out the problem with this. Could I get help please.
I have checked and I can ping the new host (from and to) existing host just fine.
ntpd is running
ip6 tables are not running
This new host I am trying to add in AWS ec2 instance with centos 6.7
My existing host is centos 6.7 as well
Also, just in case needed, here is the log details I get in CM:
Support
admin
Add New Hosts to Cluster
Installation failed on all hosts.
0 of 1 host(s) completed successfully.
Uninstalled on 1 host(s) after installation failure. Retry Failed Hosts
Hostname IP Address Progress Status
ec2-35-162-192-55.us-west-2.compute.amazonaws.com 35.162.192.55
Retry | Details Installation failed. Failed to receive heartbeat from agent.
Ensure that the host's hostname is configured properly.
Ensure that port 7182 is accessible on the Cloudera Manager Server (check firewall rules).
Ensure that ports 9000 and 9001 are not in use on the host being added.
Check agent logs in /var/log/cloudera-scm-agent/ on the host being added. (Some of the logs can be found in the installation details).
If Use TLS Encryption for Agents is enabled in Cloudera Manager (Administration -> Settings -> Security), ensure that /etc/cloudera-scm-agent/config.ini has use_tls=1 on the host being added. Restart the corresponding agent and click the Retry link here.
Failed to receive heartbeat from agent. (Current Step) Last Refreshed: Nov 1, 2016 11:37:35 PM IST
/tmp/scm_prepare_node.pc1ddUen
using SSH_CLIENT to get the SCM hostname: 182.18.170.55 37842 22
opening logging file descriptor
Starting installation script...
Acquiring installation lock...
BEGIN flock 4
END (0)
Detecting root privileges...
effective UID is 0
Detecting distribution...
BEGIN grep Tikanga /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 5' /etc/redhat-release
END (1)
BEGIN grep 'Scientific Linux release 5' /etc/redhat-release
END (1)
BEGIN grep Santiago /etc/redhat-release
END (1)
BEGIN grep 'CentOS Linux release 6' /etc/redhat-release
END (1)
BEGIN grep 'CentOS release 6' /etc/redhat-release
CentOS release 6.7 (Final)
END (0)
/etc/redhat-release ==> CentOS 6
Detecting Cloudera Manager Server...
BEGIN host -t PTR 182.18.170.55
END (127)
/tmp/scm_prepare_node.pc1ddUen/scm_prepare_node.sh: line 105: host: command not found
BEGIN which python
/usr/bin/python
END (0)
BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 182.18.170.55 7182
END (0)
BEGIN which wget
which: no wget in (/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin)
END (1)
BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo
/tmp/scm_prepare_node.pc1ddUen/scm_prepare_node.sh: line 105: wget: command not found
END (127)
Installing package repositories...
validating format of repository file /tmp/scm_prepare_node.pc1ddUen/repos/rhel6/cloudera-manager.repo
installing repository file /tmp/scm_prepare_node.pc1ddUen/repos/rhel6/cloudera-manager.repo
repository file /tmp/scm_prepare_node.pc1ddUen/repos/rhel6/cloudera-manager.repo installed
Refreshing package metadata...
BEGIN yum clean all
Loaded plugins: fastestmirror, presto
Cleaning repos: base cloudera-manager extras updates
Cleaning up Everything
Cleaning up list of fastest mirrors
0 delta-package files removed, by presto
END (0)
BEGIN rm -Rf /var/cache/yum/CentOS6-Base /var/cache/yum/CentOS6-Extras /var/cache/yum/CentOS6-Updates /var/cache/yum/timedhosts.txt /var/cache/yum/x86_64
END (0)
BEGIN yum makecache
Loaded plugins: fastestmirror, presto
Metadata Cache Created
END (0)
Installing jdk package...
BEGIN yum list installed jdk
Loaded plugins: fastestmirror, presto
Error: No matching Packages to list
END (1)
BEGIN yum info jdk
Loaded plugins: fastestmirror, presto
Determining fastest mirrors
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Available Packages
Name : jdk
Arch : x86_64
Epoch : 2000
Version : 1.6.0_31
Release : fcs
Size : 68 M
Repo : cloudera-manager
Summary : Java(TM) Platform Standard Edition Development Kit
URL : http://java.sun.com/
License : Copyright (c) 2011, Oracle and/or its affiliates. All rights
: reserved. Also under other license(s) as shown at the Description
: field.
Description : The Java Platform Standard Edition Development Kit (JDK) includes
: both the runtime environment (Java virtual machine, the Java
: platform classes and supporting files) and development tools
: (compilers, debuggers, tool libraries and other tools).
:
: The JDK is a development environment for building applications,
: applets and components that can be deployed with the Java Platform
: Standard Edition Runtime Environment.
END (0)
BEGIN yum -y install jdk.x86_64
Loaded plugins: fastestmirror, presto
Setting up Install Process
================================================================================
Installing:
jdk x86_64 2000:1.6.0_31-fcs cloudera-manager 68 M
Transaction Summary
================================================================================
Install 1 Package(s)
Total download size: 68 M
Installed size: 143 M
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Package(s) data still to download: 68 M
warning: rpmts_HdrFromFdno: V4 DSA/SHA1 Signature, key ID e8f86acd: NOKEY
Retrieving key from https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
Importing GPG key 0xE8F86ACD:
Userid: "Yum Maintainer <webmaster#cloudera.com>"
From : https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : 2000:jdk-1.6.0_31-fcs.x86_64 1/1
Unpacking JAR files...
rt.jar...
jsse.jar...
charsets.jar...
tools.jar...
localedata.jar...
plugin.jar...
javaws.jar...
deploy.jar...
Verifying : 2000:jdk-1.6.0_31-fcs.x86_64 1/1
Installed:
jdk.x86_64 2000:1.6.0_31-fcs
Complete!
END (0)
remote package jdk installed
Installing oracle-j2sdk1.7 package...
BEGIN yum list installed oracle-j2sdk1.7
Loaded plugins: fastestmirror, presto
Error: No matching Packages to list
END (1)
BEGIN yum info oracle-j2sdk1.7
Loaded plugins: fastestmirror, presto
Resolving Dependencies
--> Running transaction check
---> Package oracle-j2sdk1.7.x86_64 0:1.7.0+update67-1 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
oracle-j2sdk1.7 x86_64 1.7.0+update67-1 cloudera-manager 135 M
Transaction Summary
================================================================================
Install 1 Package(s)
Total download size: 135 M
Installed size: 279 M
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Package(s) data still to download: 135 M
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : oracle-j2sdk1.7-1.7.0+update67-1.x86_64 1/1
Verifying : oracle-j2sdk1.7-1.7.0+update67-1.x86_64 1/1
Installed:
oracle-j2sdk1.7.x86_64 0:1.7.0+update67-1
Complete!
END (0)
remote package oracle-j2sdk1.7 installed
Installing cloudera-manager-agent package...
BEGIN yum list installed cloudera-manager-agent
Loaded plugins: fastestmirror, presto
Error: No matching Packages to list
END (1)
BEGIN yum info cloudera-manager-agent
Loaded plugins: fastestmirror, presto
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Available Packages
Name : cloudera-manager-agent
Arch : x86_64
Version : 5.7.0
Release : 1.cm570.p0.76.el6
Size : 7.5 M
Repo : cloudera-manager
Summary : The Cloudera Manager Agent
URL : http://www.cloudera.com
License : Proprietary
Description : The Cloudera Manager Agent.
:
: The Agent is deployed to machines running services managed by
: Cloudera Manager.
END (0)
Version : 5.7.0
Release : 1.cm570.p0.76.el6
BEGIN yum -y install cloudera-manager-agent
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Resolving Dependencies
--> Running transaction check
---> Package cloudera-manager-agent.x86_64 0:5.7.0-1.cm570.p0.76.el6 will be installed
--> Processing Dependency: cloudera-manager-daemons = 5.7.0 for package: cloudera-manager-agent-5.7.0-1.cm570.p0.76.el6.x86_64
--> Processing Dependency: /lib/lsb/init-functions for package: cloudera-manager-agent-5.7.0-1.cm570.p0.76.el6.x86_64
--> Running transaction check
--> Processing Dependency: openssl = 1.0.1e-48.el6_8.3 for package: openssl-devel-1.0.1e-48.el6_8.3.x86_64
--> Processing Dependency: zlib-devel for package: openssl-devel-1.0.1e-48.el6_8.3.x86_64
--> Processing Dependency: krb5-devel for package: openssl-devel-1.0.1e-48.el6_8.3.x86_64
---> Package perl.x86_64 4:5.10.1-141.el6_7.1 will be installed
--> Processing Dependency: perl-libs = 4:5.10.1-141.el6_7.1 for package: 4:perl-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: perl-libs for package: 4:perl-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: perl(version) for package: 4:perl-5.10.1-141.el6_7.1.x86_64
---> Package python-psycopg2.x86_64 0:2.0.14-2.el6 will be installed
--> Processing Dependency: libpq.so.5()(64bit) for package: python-psycopg2-2.0.14-2.el6.x86_64
---> Package redhat-lsb-core.x86_64 0:4.0-7.el6.centos will be installed
--> Processing Dependency: perl-Test-Simple for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: perl-Test-Harness for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: perl-ExtUtils-MakeMaker for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: perl-CGI for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/time for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/pax for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/patch for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/msgfmt for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/batch for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /usr/bin/at for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /bin/mailx for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /bin/gettext for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
--> Processing Dependency: /bin/ed for package: redhat-lsb-core-4.0-7.el6.centos.x86_64
---> Package rpcbind.x86_64 0:0.2.0-12.el6 will be installed
--> Processing Dependency: libgssglue for package: rpcbind-0.2.0-12.el6.x86_64
--> Processing Dependency: libtirpc.so.1()(64bit) for package: rpcbind-0.2.0-12.el6.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.3.9-5.el6_2 will be installed
---> Package apr-util.x86_64 0:1.3.9-3.el6_0.1 will be installed
---> Package apr-util-ldap.x86_64 0:1.3.9-3.el6_0.1 will be installed
---> Package at.x86_64 0:3.1.10-48.el6 will be installed
---> Package bind-libs.x86_64 32:9.8.2-0.47.rc1.el6_8.2 will be installed
---> Package ed.x86_64 0:1.1-3.3.el6 will be installed
---> Package gettext.x86_64 0:0.17-18.el6 will be installed
--> Processing Dependency: libgomp.so.1(GOMP_1.0)(64bit) for package: gettext-0.17-18.el6.x86_64
--> Processing Dependency: cvs for package: gettext-0.17-18.el6.x86_64
--> Processing Dependency: libgomp.so.1()(64bit) for package: gettext-0.17-18.el6.x86_64
---> Package httpd-tools.x86_64 0:2.2.15-54.el6.centos will be installed
---> Package krb5-devel.x86_64 0:1.10.3-57.el6 will be installed
--> Processing Dependency: krb5-libs = 1.10.3-57.el6 for package: krb5-devel-1.10.3-57.el6.x86_64
--> Processing Dependency: libselinux-devel for package: krb5-devel-1.10.3-57.el6.x86_64
--> Processing Dependency: libcom_err-devel for package: krb5-devel-1.10.3-57.el6.x86_64
--> Processing Dependency: keyutils-libs-devel for package: krb5-devel-1.10.3-57.el6.x86_64
---> Package libgssglue.x86_64 0:0.1-11.el6 will be installed
---> Package libtirpc.x86_64 0:0.2.1-11.el6_8 will be installed
---> Package mailcap.noarch 0:2.1.31-2.el6 will be installed
---> Package mailx.x86_64 0:12.4-8.el6_6 will be installed
---> Package openssl.x86_64 0:1.0.1e-42.el6_7.2 will be updated
---> Package openssl.x86_64 0:1.0.1e-48.el6_8.3 will be an update
---> Package patch.x86_64 0:2.6-6.el6 will be installed
---> Package pax.x86_64 0:3.4-10.1.el6 will be installed
---> Package perl-CGI.x86_64 0:3.51-141.el6_7.1 will be installed
---> Package perl-ExtUtils-MakeMaker.x86_64 0:6.55-141.el6_7.1 will be installed
--> Processing Dependency: perl-devel for package: perl-ExtUtils-MakeMaker-6.55-141.el6_7.1.x86_64
---> Package perl-Module-Pluggable.x86_64 1:3.90-141.el6_7.1 will be installed
---> Package perl-Pod-Simple.x86_64 1:3.13-141.el6_7.1 will be installed
--> Processing Dependency: perl(Pod::Escapes) >= 1.04 for package: 1:perl-Pod-Simple-3.13-141.el6_7.1.x86_64
---> Package perl-Test-Harness.x86_64 0:3.17-141.el6_7.1 will be installed
---> Package perl-Test-Simple.x86_64 0:0.92-141.el6_7.1 will be installed
---> Package perl-libs.x86_64 4:5.10.1-141.el6_7.1 will be installed
---> Package perl-version.x86_64 3:0.77-141.el6_7.1 will be installed
---> Package postgresql-libs.x86_64 0:8.4.20-6.el6 will be installed
---> Package time.x86_64 0:1.7-38.el6 will be installed
---> Package zlib-devel.x86_64 0:1.2.3-29.el6 will be installed
--> Running transaction check
---> Package cvs.x86_64 0:1.11.23-16.el6 will be installed
---> Package keyutils-libs-devel.x86_64 0:1.4-5.el6 will be installed
---> Package krb5-libs.x86_64 0:1.10.3-42.el6 will be updated
---> Package krb5-libs.x86_64 0:1.10.3-57.el6 will be an update
---> Package libcom_err-devel.x86_64 0:1.41.12-22.el6 will be installed
---> Package libgomp.x86_64 0:4.4.7-17.el6 will be installed
---> Package libselinux-devel.x86_64 0:2.0.94-7.el6 will be installed
--> Processing Dependency: libselinux = 2.0.94-7.el6 for package: libselinux-devel-2.0.94-7.el6.x86_64
--> Processing Dependency: libsepol-devel >= 2.0.32-1 for package: libselinux-devel-2.0.94-7.el6.x86_64
--> Processing Dependency: pkgconfig(libsepol) for package: libselinux-devel-2.0.94-7.el6.x86_64
---> Package perl-Pod-Escapes.x86_64 1:1.04-141.el6_7.1 will be installed
---> Package perl-devel.x86_64 4:5.10.1-141.el6_7.1 will be installed
--> Processing Dependency: perl(ExtUtils::ParseXS) for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: glibc-devel for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: gdbm-devel for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Processing Dependency: db4-devel for package: 4:perl-devel-5.10.1-141.el6_7.1.x86_64
--> Running transaction check
---> Package db4-devel.x86_64 0:4.7.25-20.el6_7 will be installed
--> Processing Dependency: db4-cxx = 4.7.25-20.el6_7 for package: db4-devel-4.7.25-20.el6_7.x86_64
--> Processing Dependency: libdb_cxx-4.7.so()(64bit) for package: db4-devel-4.7.25-20.el6_7.x86_64
---> Package gdbm-devel.x86_64 0:1.8.0-39.el6 will be installed
--> Processing Dependency: gdbm = 1.8.0-39.el6 for package: gdbm-devel-1.8.0-39.el6.x86_64
---> Package glibc-devel.x86_64 0:2.12-1.192.el6 will be installed
--> Processing Dependency: glibc-headers = 2.12-1.192.el6 for package: glibc-devel-2.12-1.192.el6.x86_64
--> Processing Dependency: glibc = 2.12-1.192.el6 for package: glibc-devel-2.12-1.192.el6.x86_64
--> Processing Dependency: glibc-headers for package: glibc-devel-2.12-1.192.el6.x86_64
---> Package libselinux.x86_64 0:2.0.94-5.8.el6 will be updated
--> Processing Dependency: libselinux = 2.0.94-5.8.el6 for package: libselinux-utils-2.0.94-5.8.el6.x86_64
--> Processing Dependency: libselinux = 2.0.94-5.8.el6 for package: libselinux-python-2.0.94-5.8.el6.x86_64
---> Package libselinux.x86_64 0:2.0.94-7.el6 will be an update
---> Package libsepol-devel.x86_64 0:2.0.41-4.el6 will be installed
---> Package perl-ExtUtils-ParseXS.x86_64 1:2.2003.0-141.el6_7.1 will be installed
--> Running transaction check
---> Package db4-cxx.x86_64 0:4.7.25-20.el6_7 will be installed
---> Package gdbm.x86_64 0:1.8.0-38.el6 will be updated
---> Package gdbm.x86_64 0:1.8.0-39.el6 will be an update
---> Package glibc.x86_64 0:2.12-1.166.el6_7.7 will be updated
--> Processing Dependency: glibc = 2.12-1.166.el6_7.7 for package: glibc-common-2.12-1.166.el6_7.7.x86_64
---> Package glibc.x86_64 0:2.12-1.192.el6 will be an update
---> Package glibc-headers.x86_64 0:2.12-1.192.el6 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.12-1.192.el6.x86_64
--> Processing Dependency: kernel-headers for package: glibc-headers-2.12-1.192.el6.x86_64
---> Package libselinux-python.x86_64 0:2.0.94-5.8.el6 will be updated
---> Package libselinux-python.x86_64 0:2.0.94-7.el6 will be an update
---> Package libselinux-utils.x86_64 0:2.0.94-5.8.el6 will be updated
---> Package libselinux-utils.x86_64 0:2.0.94-7.el6 will be an update
--> Running transaction check
---> Package glibc-common.x86_64 0:2.12-1.166.el6_7.7 will be updated
---> Package glibc-common.x86_64 0:2.12-1.192.el6 will be an update
---> Package kernel-headers.x86_64 0:2.6.32-642.6.2.el6 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
cloudera-manager-agent x86_64 5.7.0-1.cm570.p0.76.el6 cloudera-manager 7.5 M
Installing for dependencies:
MySQL-python x86_64 1.2.3-0.3.c1.1.el6 base 86 k
libselinux x86_64 2.0.94-7.el6 base 109 k
libselinux-python x86_64 2.0.94-7.el6 base 203 k
libselinux-utils x86_64 2.0.94-7.el6 base 82 k
openssl x86_64 1.0.1e-48.el6_8.3 updates 1.5 M
Transaction Summary
================================================================================
Install 57 Package(s)
Upgrade 8 Package(s)
Total download size: 601 M
Downloading Packages:
Setting up and reading Presto delta metadata
Processing delta metadata
Download delta size: 447 k
Presto reduced the update size by 72% (from 1.5 M to 447 k).
Package(s) data still to download: 600 M
--------------------------------------------------------------------------------
Total 20 MB/s | 600 MB 00:30
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Dependency Updated:
Complete!
END (0)
remote package cloudera-manager-agent installed
Installing cloudera-manager-daemons package...
BEGIN yum list installed cloudera-manager-daemons
Loaded plugins: fastestmirror, presto
Installed Packages
cloudera-manager-daemons.x86_64 5.7.0-1.cm570.p0.76.el6 #cloudera-manager
END (0)
BEGIN echo jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons
jdk oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons
END (0)
BEGIN yum info cloudera-manager-daemons
Loaded plugins: fastestmirror, presto
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Installed Packages
Name : cloudera-manager-daemons
Arch : x86_64
Version : 5.7.0
Release : 1.cm570.p0.76.el6
Size : 861 M
Repo : installed
From repo : cloudera-manager
Summary : Provides daemons for monitoring Hadoop and related tools.
URL : http://www.cloudera.com
License : Proprietary
Description : This package includes daemons for monitoring and managing Hadoop.
END (0)
Version : 5.7.0
Release : 1.cm570.p0.76.el6
BEGIN yum -y install cloudera-manager-daemons
Loaded plugins: fastestmirror, presto
Setting up Install Process
Loading mirror speeds from cached hostfile
* base: mirrors.unifiedlayer.com
* extras: bay.uchicago.edu
* updates: repo1.sea.innoscale.net
Package cloudera-manager-daemons-5.7.0-1.cm570.p0.76.el6.x86_64 already installed and latest version
Nothing to do
END (0)
remote package cloudera-manager-daemons installed
Installing Unlimited Strength Encryption policy files.
Installation not requested. Step will be skipped.
Configuring Cloudera Manager Agent...
BEGIN grep server_host=182.18.170.55 /etc/cloudera-scm-agent/config.ini
END (1)
BEGIN sed -e 's/\(server_host=\).*/\1182.18.170.55/' -i /etc/cloudera-scm-agent/config.ini
END (0)
scm agent configured
Starting Cloudera Manager Agent...
BEGIN /sbin/service cloudera-scm-agent status
cloudera-scm-agent is stopped
END (3)
BEGIN /sbin/service cloudera-scm-agent start
Starting cloudera-scm-agent: [60G[[0;32m OK [0;39m]
END (0)
agent logs:
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/'
>>/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/parcel.py:17: DeprecationWarning: the sets module is deprecated
>> from sets import Set
>>[01/Nov/2016 18:02:16 +0000] 6456 MainThread agent INFO SCM Agent Version: 5.7.0
>>/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.0-py2.6.egg/cmf/parcel.py:17: DeprecationWarning: the sets module is deprecated
>> from sets import Set
>>[01/Nov/2016 18:02:16 +0000] 6456 MainThread agent INFO SCM Agent Version: 5.7.0
END (0)
BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/'
tail: cannot open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No such file or directory
tail: cannot open `/var/log/cloudera-scm-agent//cloudera-scm-agent.log' for reading: No such file or directory
END (0)
end of agent logs.
scm agent started
Installation script completed successfully.
all done
closing logging file descriptor
This is not a ping issue, because the client timeouts it sounds like a firewall issue.
Check from the client that you can reach the registration port on the server, I think it's 7182 (you can use a tool like telnet to test you can reach from the agent host to the server using that port)
If I remember correctly, the default security configuration is amazon is to only allow a few basic ports and firewall the rest.
Are both hosts in the same AWS security group?
I was getting similar error and it got resolved by doing the below:
Installation successfully completed now. Resolution: I did two things 1) : Disabled firewall by doing iptables -P INPUT ACCEPT iptables -P OUTPUT ACCEPT iptables -P FORWARD ACCEPT iptables -F . 2) The second thing is giving internal IP instead of external IP while adding hosts.
I install puppet 2.6.18, test it and it was working okay.
Then I install Apache and Passenger on the Puppet server.
I run on a puppet agent:
puppet agent —test
And I got the error:
"warning: Not using cache on failed catalog
err: Could not retrieve catalog; skipping run"
In the puppet server access_log I have:
"GET /production/catalog/puppet.agent.domain?facts=eNqVV2… &facts_format=b64_zlib_yaml HTTP/1.1" 404 343 "-" "-"
And in the error_log I have:
File does not exist: /usr/share/puppet/rack/puppetmasterd/public/production
I check the file /usr/share/puppet/rack/puppetmasterd/public - is empty.
I just create it as part of the installation.
What I'm missing?
The problem solved.
On the puppet server:
echo 0 > /selinux/enforce
stop and start httpd.
Thanks.