Cloudera manager - hadoop installation failure - hadoop

Try install Cloudera Manager.
Failed on step auto install in the hadoop hosts.
Error:
Installing JDK package...
BEGIN yum info jdk
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: archive.cs.uu.nl
* extras: archive.cs.uu.nl
* updates: mirror.fraunhofer.de
http://archive.cloudera.com/redhat/cdh/3/repodata/repomd.xml: [Errno 4] IOError: <urlopen error (-3, 'Temporary failure in name resolution')>
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: cloudera-cdh3. Please verify its path and try again
END (1)
remote package jdk is not available, giving up
From OS command
yum info jdk
complete success.
In the OS set proxy (export http_proxy=....)

Cloudera SCM fails because it is not able to use yum to download and install JDK.
So far I have seen it always tries to do that.
You can update yum repository on the machines yourself, depending on what version of Linux you are using.
Here is example using RHEL / OEL 5:
# This adds Oracle Yum repo
cd /etc/yum.repos.d/
wget http://public-yum.oracle.com/public-yum-el5.repo
# This adds Fedora EPEL yum repo
yum remove epel-release-5-4
rpm -Uvh http://mirrors.kernel.org/fedora-epel/5/x86_64/epel-release-5-4.noarch.rpm
See if you can install JDK manually.
[Edit:]
Check if you are able to do the following with out issues:
python
>>> import urllib
>>> x = urllib.urlopen('http://archive.cloudera.com/redhat/cdh/3/repodata/repomd.xml')
>>> x.getcode()
200
>>> print x.readlines()

Related

Trying to install epel-release on Fedora 30 -- no match for argument: epel-release

I'm on Fedora 30. I am trying to install "epel-release".
I am following this guide: https://www.phusionpassenger.com/library/install/standalone/install/oss/el7/ -- I am unable to successfully run the command:
$ sudo yum install -y epel-release yum-utils
I get as a result:
No match for argument: epel-release
So, I tried the following commands from this article: https://www.liquidweb.com/kb/enable-epel-repository/
$ cd /tmp
$ wget https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
$ yum install ./epel-release-latest-*.noarch.rpm
No such luck - this is the output:
Error:
Problem: problem with installed package fedora-release-workstation-30-1.noarch
- package epel-release-7-11.noarch conflicts with fedora-release provided by fedora-release-workstation-30-1.noarch
- package epel-release-7-11.noarch conflicts with fedora-release provided by fedora-release-workstation-30-4.noarch
- conflicting requests
I have also tried:
$ sudo dnf install epel-relase
which that didn't work either, here's the results:
No match for argument: epel-release
Error: Unable to find a match
I have come across several different articles basically saying to either use the first command listed or variations of the second command I've tried - all unsuccessful. side note: Is this because Fedora 30 was just "recently" released?
My end goal is to deploy a Ruby on Rails web app internally using Nginx. For that, I am following this guide: https://www.phusionpassenger.com/library/walkthroughs/deploy/ruby/ownserver/nginx/oss/el7/deploy_app.html
Any direction for how to install epel-release would be great as I can't move forward until passenger is installed.
Note that EPEL is not suitable for use in Fedora! Fedora is not Enterprise Linux. EPEL provides "a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS and Scientific Linux (SL), Oracle Linux (OL)". Put simply, Enterprise Linux is a term that refers to Red Hat Enterprise Linux or one of its clones. And Fedora is not a Red Hat clone.
That is why you cannot install the "epel-release" package in Fedora. It simply does not exist. Don't try to use EPEL on Fedora.
As noted before, the Fedora repositories provide most (if not all) of the EPEL packages. Additional software for Fedora is available in the RPMFusion repositories. In their own words, RPMFusion is "an extension of Fedora" that "provides software that the Fedora Project or Red Hat doesn't want to ship." RPMFusion can not be used on Enterprise Linux. You could see RPMFusion as the "EPEL alternative" for Fedora, but be aware that the software collections provided by RPMFusion and EPEL are entirely unrelated and uncomparable.
EPEL is managed from within the Fedora project, and thus part of Red Hat. RPMFusion is an independent organization. You can consider their repositories reliable, but always be cautious when you install software from external sources.
Finally - on a sidenote - on recent Fedora versions, 'dnf' has replaced 'yum'.
Okay, so turns out that this can be simplified to just:
$ sudo dnf install passenger
Crazy that they have an entire tutorial for how to install passenger when it can just be simplified to this one line.
you'll need to install the EPEL (Extra Packages for Enterprise Linux) repository.
The EPEL project is run by the Fedora team.
When you install third-party repositories on Red Hat and CentOS systems.
Install in centos:
sudo yum install yum-plugin-priorities epel-release
When the installation completes, navigate to the /etc/yum.repos.d directory,
and open the CentOS-Base.repo file in your favorite text editor.
After the last line of the base, updates, and extras sections, add the line: priority=1.
After the last line of the centosplus section, add the line:
priority=2.
Save the file and close the editor.
Now, Open the epel.repo file for editing.
After the last line of the epel section,add the line:
priority=10.
After the last line of each remaining section, add the line:
priority=11.
Update the system and then create a list of the installed and available packages by running:
sudo yum upgrade
sudo yum list > yum_list.txt
For RHEL - dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Try with the above command to install epel-release in RHEL 8

Unable to install mesos on centos 6.5

I am trying to install mesos package according to https://open.mesosphere.com/getting-started/install/#slave-setup but, when I run yum install mesos, transaction abort with error message:
Error unpacking rpm package mesos-1.0.1-2.0.93.centos65.x86_64
error: unpacking of archive failed on file /usr/lib/libmesos-1.0.1.so;57c7a348: cpio: read
Failed:
mesos.x86_64 0:1.0.1-2.0.93.centos65
any pointers? or is the packaging of this particular version corrupted?
I tried mesos.x86_64 0:1.0.0-2.0.89.centos65 which seems to be working.
The current mesos 1.x.x RPM installers do not handle upgrades from mesos versions < 1.0 gracefully in CentOS 6.X. A yum update of mesos from 0.28 to 1.1.0 produces the following error:
Running Transaction
Updating : mesos-1.1.0-2.0.107.centos65.x86_64
Error unpacking rpm package mesos-1.1.0-2.0.107.centos65.x86_64
error: unpacking of archive failed on file /usr/include/mesos/slave: cpio: rename
The workaround is to run:
rm -rf /usr/include/mesos/slave
And then re-run yum update (or whatever RPM management command you are using to upgrade mesos).
Source: https://github.com/mesosphere/mesos-deb-packaging/issues/87
[Updated:] A new RPM which fixes this error, 1.0.1-2.0.96, has been generated and is available for download at https://open.mesosphere.com/downloads/mesos/. (Thanks #js84)

Dependency Resolution Error while installing Zabbix 2.4 on Centos 7

I have installed rpm from this site 1- Zabbix 2.4 download page for centos7
And I have been following installation instructions on this site 2- Zabbix.org centos installation instructions
first, I configure zabbix repository
rpm -ivh http://repo.zabbix.com/zabbix/2.4/rhel/6/x86_64/zabbix-release-2.4-1.el6.noarch.‌​rpm
But, then I realized this repository is for /rhel/6. Then I run the command below to change the zabbix repository which is for /rhel/7 , since I use centos 7.
rpm --import http://repo.zabbix.com/RPM-GPG-KEY-ZABBIX
rpm -Uv http://repo.zabbix.com/zabbix/2.4/rhel/7/x86_64/zabbix-release-2.4-1.el7.noarch.rpm
Then, I try to install zabbix
yum install mysql-server zabbix-server-mysql zabbix-web-mysql zabbix-agent zabbix-java-gateway
But I couldn't because of some dependency could not be installed.
--> Finished Dependency Resolution
Error: Package: zabbix-server-mysql-2.4.5-1.el6.x86_64 (zabbix)
Requires: libmysqlclient.so.16()(64bit)
Error: Package: zabbix-server-mysql-2.4.5-1.el6.x86_64 (zabbix)
Requires: libmysqlclient.so.16(libmysqlclient_16)(64bit)
Error: Package: zabbix-server-mysql-2.4.5-1.el6.x86_64 (zabbix)
Requires: libnetsnmp.so.20()(64bit)
Error: Package: iksemel-1.4-2.el6.x86_64 (zabbix-non-supported)
Requires: libgnutls.so.26()(64bit)
Error: Package: iksemel-1.4-2.el6.x86_64 (zabbix-non-supported)
Requires: libgnutls.so.26(GNUTLS_1_4)(64bit)
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
I have searched a bit and I have came accross a lot of people has same problem and you can find some offered solutions to the problem. I have tried to implement the offered solutions but non of them solved the problem.
3.1- Offered solution from centos.org/forum : I could not understand this, I run the commands and result are shown below.
rpm -qR postfix
libmysqlclient.so.18()(64bit)
libmysqlclient.so.18(libmysqlclient_18)(64bit)
rpm -q mysql-libs
package mysql-libs is not installed
3.2- Offered solution from centos.org/forum This problem seems very similar but it does not helped either
3.3- Offered solution from zabbix.com/forum This problem seems exactly same, and a solution is offered. But I could not understand it.
Also, I found that on Zabbix official documentation 4- Zabbix 2.4 manual
Supported for versions: RHEL6, CentOS 6
centos 7 is not listed here, but it contradicts with Zabbix download page, since they provide a link for centos 7. you can check first link.
Please share if you have any idea how to solve this problem.
As #Jan Garaj pointed, the problem was yum try to install el6 packages, although I have changed the zabbix repository which is for rhel/7.
So, I have just cleaned the cache with the commands below and problem is resolved.
yum clean headers
yum clean packages
yum clean metadata
You can find more information about cleaning yum caches on this site:
Centos/clearing yum caches
You can find information about removing a yum repository on tihs site, Just cleaning cache solves this problem, so I did not try to remove yum repository. But, it can be useful if cleaning cache does not help.
serverFault/how to remove yum repo
I had similar problem while installing nginx. For me what helped was continuous release repository CR
Usage:
yum -y install yum-utils
yum-config-manager --enable cr

Warning: No matches found for: kernel-devel

When I'm trying to install kernel-devel from yum source, I got the error:
$ sudo yum search kernel-devel
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: ftp.riken.jp
* epel: ftp.riken.jp
* extras: ftp.riken.jp
* updates: ftp.riken.jp
Warning: No matches found for: kernel-devel
No Matches found
[vagrant#vagrant-centos65 ~]$ uname -r
2.6.32-431.el6.x86_64
[vagrant#vagrant-centos65 ~]$ cat /etc/centos-release
CentOS release 6.6 (Final)
But in my another CentOS 6.4 machine, kernel-devel(2.6.32-358.) can be found and installed normally. So I just doubt that bad things have been done to my os system, or the kernel-devel version 2.4.32-431 do not exist truly.
This problem occurs in my vagrant vm.
you should disable the versionlock plugin.
edit /etc/yum/pluginconf.d/versionlock.conf set enabled = 0, and retry yum install kernel-devel
NOTICE
if you upgrade the kernel to a newer version, when you reload vagrant, it would cause an error
Failed to mount folders in Linux guest. This is usually because
the "vboxsf" file system is not available
you can fix it by running sudo /etc/init.d/vboxadd setup

Mounting Hadoop files system

I have followed the following link to mount HDFS as local file system
http://solutionsatexperts.com/hadoop-fuse-installation-and-configuration-on-centos/
After downloading the hdfs-dfs, they mentioned to install rpm package. As per link, I have switched to root and typed the command
yum install fuse*
But it shows
There are no enabled repos.
Run "yum repolist all" to see the repos you have.
You can enable repos with yum-config-manager --enable <repo>
can any one help me to solve this
I succeed in installing hadoop-hdfs-fuse to mount hdfs as local file system by following this guide from cloudera.
You can add such file to /etc/yum.repos.d/, as reference here :
[cloudera-cdh5]
# Packages for Cloudera's Distribution for Hadoop, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera's Distribution for Hadoop, Version 5
baseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5/
gpgkey=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
gpgcheck=1
Do some adjustment according to your os version.

Resources