Mounting Hadoop files system - hadoop

I have followed the following link to mount HDFS as local file system
http://solutionsatexperts.com/hadoop-fuse-installation-and-configuration-on-centos/
After downloading the hdfs-dfs, they mentioned to install rpm package. As per link, I have switched to root and typed the command
yum install fuse*
But it shows
There are no enabled repos.
Run "yum repolist all" to see the repos you have.
You can enable repos with yum-config-manager --enable <repo>
can any one help me to solve this

I succeed in installing hadoop-hdfs-fuse to mount hdfs as local file system by following this guide from cloudera.
You can add such file to /etc/yum.repos.d/, as reference here :
[cloudera-cdh5]
# Packages for Cloudera's Distribution for Hadoop, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera's Distribution for Hadoop, Version 5
baseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5/
gpgkey=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
gpgcheck=1
Do some adjustment according to your os version.

Related

pgadmin3 install on CentOS7

I am using CentOS7 and PostgreSQL-13. As it is very difficult to work database-related queries in the command line I want to install pgadmin3. Aas it is available on the yum repository and in my CentOS, I do not have any internet connection. So I have installed pgadmin3 with the following installation command only: yum install pgadmin3.
I have seen in some tutorials they modified the sudo /usr/pgadmin4/bin/setup-web.sh file. But I did not find such a file in my CentOS machine after pgadmin3 installation. Now I have no idea how to configure it with my already installed PostgreSQL-13 and httpd and how I can use this. I have not found any documentation regarding this.
PostgreSQL-13 not supported for pgadmin3, you must install pgadmin4

Trying to install epel-release on Fedora 30 -- no match for argument: epel-release

I'm on Fedora 30. I am trying to install "epel-release".
I am following this guide: https://www.phusionpassenger.com/library/install/standalone/install/oss/el7/ -- I am unable to successfully run the command:
$ sudo yum install -y epel-release yum-utils
I get as a result:
No match for argument: epel-release
So, I tried the following commands from this article: https://www.liquidweb.com/kb/enable-epel-repository/
$ cd /tmp
$ wget https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
$ yum install ./epel-release-latest-*.noarch.rpm
No such luck - this is the output:
Error:
Problem: problem with installed package fedora-release-workstation-30-1.noarch
- package epel-release-7-11.noarch conflicts with fedora-release provided by fedora-release-workstation-30-1.noarch
- package epel-release-7-11.noarch conflicts with fedora-release provided by fedora-release-workstation-30-4.noarch
- conflicting requests
I have also tried:
$ sudo dnf install epel-relase
which that didn't work either, here's the results:
No match for argument: epel-release
Error: Unable to find a match
I have come across several different articles basically saying to either use the first command listed or variations of the second command I've tried - all unsuccessful. side note: Is this because Fedora 30 was just "recently" released?
My end goal is to deploy a Ruby on Rails web app internally using Nginx. For that, I am following this guide: https://www.phusionpassenger.com/library/walkthroughs/deploy/ruby/ownserver/nginx/oss/el7/deploy_app.html
Any direction for how to install epel-release would be great as I can't move forward until passenger is installed.
Note that EPEL is not suitable for use in Fedora! Fedora is not Enterprise Linux. EPEL provides "a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS and Scientific Linux (SL), Oracle Linux (OL)". Put simply, Enterprise Linux is a term that refers to Red Hat Enterprise Linux or one of its clones. And Fedora is not a Red Hat clone.
That is why you cannot install the "epel-release" package in Fedora. It simply does not exist. Don't try to use EPEL on Fedora.
As noted before, the Fedora repositories provide most (if not all) of the EPEL packages. Additional software for Fedora is available in the RPMFusion repositories. In their own words, RPMFusion is "an extension of Fedora" that "provides software that the Fedora Project or Red Hat doesn't want to ship." RPMFusion can not be used on Enterprise Linux. You could see RPMFusion as the "EPEL alternative" for Fedora, but be aware that the software collections provided by RPMFusion and EPEL are entirely unrelated and uncomparable.
EPEL is managed from within the Fedora project, and thus part of Red Hat. RPMFusion is an independent organization. You can consider their repositories reliable, but always be cautious when you install software from external sources.
Finally - on a sidenote - on recent Fedora versions, 'dnf' has replaced 'yum'.
Okay, so turns out that this can be simplified to just:
$ sudo dnf install passenger
Crazy that they have an entire tutorial for how to install passenger when it can just be simplified to this one line.
you'll need to install the EPEL (Extra Packages for Enterprise Linux) repository.
The EPEL project is run by the Fedora team.
When you install third-party repositories on Red Hat and CentOS systems.
Install in centos:
sudo yum install yum-plugin-priorities epel-release
When the installation completes, navigate to the /etc/yum.repos.d directory,
and open the CentOS-Base.repo file in your favorite text editor.
After the last line of the base, updates, and extras sections, add the line: priority=1.
After the last line of the centosplus section, add the line:
priority=2.
Save the file and close the editor.
Now, Open the epel.repo file for editing.
After the last line of the epel section,add the line:
priority=10.
After the last line of each remaining section, add the line:
priority=11.
Update the system and then create a list of the installed and available packages by running:
sudo yum upgrade
sudo yum list > yum_list.txt
For RHEL - dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Try with the above command to install epel-release in RHEL 8

Installing specific version of hadoop-client on Ubuntu

I have installed a CDH5(cdh5.15.1 version) cluster on ubuntu nodes and I want to install hadoop-client on one ubuntu host (which is not managed by cloudera).
I added cloudera repo on my ubuntu host but when I run apt-get install hadoop-client , by default it install version 5.16. However I want to install version 5.15.1 version for hadoop-client( which is available in repo).
The problem is I am not able to figure out which version number should I give . The deb package name for hadoop client cdh5.15.1 is:
hadoop-client_2.6.0+cdh5.15.1+2822-1.cdh5.15.1.p0.4~xenial-cdh5.15.1_all.deb
I have to run apt-get install hadoop-client=< version number > so that it picks up and install the specific version.
Please help me to figure out the exact version number.
Thanks in adv. :)
use apt-cache policy hadoop-client to see versions available from your package CDH
EDIT :
use apt-cache madison hadoop-client instead to see all versions available in your packages.
You can also use apt list -a hadoop-client which has the same purprose

Offline Ansible Control Machine installation

I need to install Ansible Control Machine behind a corporate firewall with no internet access. I can't find documentation for an offline install. I have access on my workstation to download anything I want and can copy it to the target machine. I have tried searching online but have not been able to find examples on how to do this. My server is Ubuntu 14.04 but if anyone has documentation for Red Hat or another distro that would also help.
I did a testing on my RH6, so if you have a RH6 with Internet access to download all required installation file, and a RH6 installation ISO. You should be able to achieve this.
Assuming you have a RH6 which has Internet access, let's call it A. And another one doesn't have access: B.
download Ansible and Jinja2 from A, and copy the files to B.
For Ansible: http://docs.ansible.com/ansible/intro_installation.html
Jinja2 is required for Ansible, download it here:
https://pypi.python.org/pypi/Jinja2
Mount the RH6 installation ISO to your RH6 B, then install the required RPM.
In my case, i installed PIP as well:
rpm -ivh python-paramiko-1.7.5-2.1.el6.noarch.rpm libyaml-0.1.3-4.el6_6.x86_64.rpm PyYAML-3.10-3.1.el6.x86_64.rpm perl-TermReadKey-2.30-13.el6.x86_64.rpm perl-Error-0.17015-4.el6.noarch.rpm python-six-1.9.0-2.el6.noarch.rpm
//following required for Git
rpm -ivh --force --nodeps perl-Git-1.7.1-3.el6_4.1.noarch.rpm
rpm -ivh git-1.7.1-3.el6_4.1.x86_64.rpm
Note: i didn't install httplib2 here, you can do it later.
install MarkupSafe (required for Jinja2)
//install MarkupSafe
tar -xvf MarkupSafe-0.23.tar.gz
cd MarkupSafe-0.23/
sudo python setup.py install
install Jinja2
//install Jinjia2
tar -xvf Jinja2-2.8.tar.gz
cd Jinja2-2.8/
sudo python setup.py install
On RH6 B, you should be able to run Ansible now:
tar -zxvf ansible.tar.gz
source ./hacking/env-setup
echo "127.0.0.1" > ~/ansible_hosts
export ANSIBLE_INVENTORY=~/ansible_hosts
ansible --version
I know this is a very old question, but I've found the answer in this blog post and I believe that could help someone out there.
Although this post aproach is on a CentOS/RHEL machine, I believe the procedure is very similar to other distros:
Download the packages (RPM) dependencies
Download the Ansible packages
Upload the downloaded packages to the target machine
Install it using yum localinstall
Or you could also install it from the source.

Ambari install script location(s)

I'm setting up a HDP 2.1 cluster with Apache Ambari. All servers run SLES 11 SP3. The setup fails if I select to install Ganglia because of some dependencies:
Installing package apache2?mod_php* ('/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm apache2?mod_php*')
Problem: apache2-mod_php53-5.3.17-0.27.1.x86_64 conflicts with apache2-mod_php5 provided by apache2-mod_php5-5.2.14-0.7.30.50.1.x86_64
Solution 1: Following actions will be done:
do not install apache2-mod_php5-5.2.14-0.7.30.50.1.x86_64
deinstallation of php5-5.2.14-0.7.30.50.1.x86_64
deinstallation of php5-xmlwriter-5.2.14-0.7.30.50.1.x86_64
[... more PHP 5.2.x packages ...]
Solution 2: do not install apache2-mod_php53-5.3.17-0.27.1.x86_64
Apparently the Regex picks the 5.3 version, a 5.2 version would be available though.
So my question is: Where is the install script stored, that Ambari is running here? I would like to replace the regex with the correct version of the package.
Information about what packages are to be installed is stored in
/var/lib/ambari-server/resources/stacks/HDP/2.0.6/services/GANGLIA/metainfo.xml
Change the value and restart the Ambari Server for the changes to take effect.

Resources