cloudera director client installation - hadoop

I am trying to install apache-spot and Cloudera on AWS following these tutorials:
http://blog.cloudera.com/blog/2018/02/apache-spot-incubating-and-cloudera-on-aws-in-60-minutes/
https://www.cloudera.com/documentation/director/latest/topics/director_get_started_aws_install_dir_server.html#concept_xnb_cwh_jx
But when I run:
sudo apt-get install cloudera-director-client
The Ubuntu terminal gives me:
E: unable to locate package cloudera-director-client
I already ran this code to fix:
$ wget http://archive.cloudera.com/director/ubuntu/precise/amd64/director/cloudera-director.list
$ wget http://archive.cloudera.com/director/ubuntu/precise/amd64/director/archive.key
$ sudo apt-key add archive.key
$ sudo mv cloudera-director.list /etc/apt/sources.list.d
$ sudo apt-get update
Anyone able to help me? Thanks

The cloudera-director.list file that you have installed is likely old. The one in the URL you have listed is for Ubuntu 12.04 (Precise Pangolin). Make sure that you pick the release that matches your OS version.
Cloudera Altus Director 2.x is available for Ubuntu 14.04 (Trusty Tahr) at http://archive.cloudera.com/director/ubuntu/trusty/amd64/director/
Cloudera Altus Director 6.0.0 is available for Ubuntu 16.04 and 14.04 at http://archive.cloudera.com/director6/6.0.0/ubuntu1604/ or http://archive.cloudera.com/director6/6.0.0/ubuntu1404/
Please try installing again with a new cloudera-director.list and archive.key

Related

docker current not installed - bash on ubuntu on windows 10

I've installed docker on bash on ubuntu on windows 10:
sudo apt-get install -y docker
but when i try to use it:
docker -v
it gives me the following error:
The program 'docker' is currently not installed. You can install it by typing:
sudo apt-get install docker
When I try to reinstall it, I get this message:
docker is already the newest version.
UPDATE:
It seems that one of the pre-requisites for installing docker this way: https://docs.docker.com/engine/installation/linux/ubuntulinux/ which works on my dedicated ubuntu machine is:
your kernel must be 3.10 at minimum
Whereas ubuntu on win 10 is 3.4
Is there a way to update this?
Run it as root :
sudo docker -v

How to install bind_member_variable.hpp in Ubuntu 16.04

I just fresh installed Ubuntu 16.04 and my project is not finding bind_member_variable.hpp anymore. In Ubuntu 14.04 it worked fine.
Where is the boost-spirit package in Ubuntu 16.04?
In this case,
apt-get install libboost-dev
If you want to be home free, just install all of boost:
apt-get install libboost-all-dev
Note, I found this by doing
dpkg --search bind_member_variable.hpp
on a system that already had it.

Unable to install latest ejabberd and Erlang version Ubuntu 14.04 LTS

Currently I have Erlang version 5.10.4 and OTP "R16B03".
Now I have to update Erlang from version 6.1 and OTP greater than 17.1 in Ubuntu 14.04 LTS (64 bit) in order to install the latest version of ejabberd (16.02).
For this I have tried instructions at this URL: http://erlang.org/doc/installation_guide/INSTALL.html
but when I am hitting the make command an error is coming:-
Makefile:247: /home/Hemant/otp_src_18.2/make/i686-pc-linux-gnu/otp_ded.mk: No such file or directory
make: *** No rule to make target `/home/Hemant/otp_src_18.2/make/i686-pc-linux-gnu/otp_ded.mk'. Stop.
I tried another way:
$ sudo apt-get install erlang
But I am getting the same version (Erlang 5.10) while I have updated the apt-get.
Now how can I get the latest version of Erlang?
When installing erlang do the following from this link:
wget http://packages.erlang-solutions.com/erlang-solutions_1.0_all.deb
sudo dpkg -i erlang-solutions_1.0_all.deb
Now the repository is added simply install esl-erlang with:
sudo apt-get update
sudo apt-get install esl-erlang
Installing ejabberd follow Mickaƫl's blog post:
git clone git#github.com:processone/ejabberd.git
cd ejabberd
chmod +x autogen.sh
./autogen.sh
./configure
sudo make && make install
Now I do remember getting quite a few compiler errors and all the errors were due to packages not being installed on my system. So when you receive an error from say libexpat then install the package sudo apt-get install libexpat1 and so on for all the following errors.
Good luck!
As your question is more on ejabberd than Erlang itself, you can download ejabberd prepackaged with its own Erlang version from ProcessOne site: https://www.process-one.net/en/ejabberd/downloads
If you want to learn about alternative ways to install ejabberd, you can follow the official documentation: https://docs.ejabberd.im/admin/guide/installation/
You can for example see at bottom of the page instructions to build ejabberd from source if you prefer.
I am trying to check the file in your error but I don't see it in the sources: https://github.com/erlang/otp/tree/OTP-18.2.4/make Can you try to clone it directly from GitHub and then compile? Or...
I recommend you to download Erlang packages specifically precompiled for Ubuntu from Erlang Solutions: https://www.erlang-solutions.com/resources/download.html
I was using them whenever I had to install Erlang on Ubuntu and never had problems. The codename for your Ubuntu would be Trusty Tahr.

How to uninstall all versions of hadoop completely from the system?

I had installed CDH5 with Mvr1 in ubuntu 14.04 LTS (single node) in pseudo-distributed mode using this tutorial
http://www.cloudera.com/content/www/en-us/documentation/enterprise/latest/topics/cdh_qs_mrv1_pseudo.html
I used the command
sudo apt-get install hadoop-0.20-conf-pseudo
to install the package in pseduo distributed mode.
I then tried to uninstall it and migrate to YARN (MvR2). But in doing so, my datanode fails to start up every time. I removed Mvr1 and installed YARN using this tutorial:
http://www.cloudera.com/content/www/en-us/documentation/enterprise/latest/topics/cdh_qs_yarn_pseudo.html.
I used the command
sudo apt-get remove hadoop-0.20-conf-pseudo hadoop-0.20-mapreduce-*
to uninstall Mvr1
and
sudo apt-get install hadoop-conf-pseudo
to install YARN.
Can you suggest me how to remove all versions of hadoop completely from my system and verify that no file remains before I do a fresh installation?
Do a:
sudo dpkg -l | grep hadoop
to see what packages are installed and then go through the list running:
sudo apt-get remove
on anything that pops up. That should remove hadoop completely from your system.

How to mount HDFS on Ubuntu 14.04

So,I can't mount HDFS on Ubuntu 14.04. Mucommander not working, fuse not working, can somebody explain me with images or make me some tutorial. Thanks, best regards.
I successfuly did it today using instructions on Cloudera site
wget http://archive.cloudera.com/cdh5/one-click-install/trusty/amd64/cdh5-repository_1.0_all.deb
sudo dpkg -i cdh5-repository_1.0_all.deb
sudo apt-get update
sudo apt-get install hadoop-hdfs-fuse
sudo mkdir -p <mount_point>
hadoop-fuse-dfs dfs://<name_node_hostname>:<namenode_port> <mount_point>
What OS and version of HDFS do you use?
You have to add the CDH5 repository first (tested on 15.04):
wget http://archive.cloudera.com/cdh5/one-click-install/trusty/amd64/cdh5-repository_1.0_all.deb
sudo dpkg -i cdh5-repository_1.0_all.deb
sudo apt-get update
Then proceed with #AlexDvoretsky's answer.
Alternative instructions for CDH5 repository installation on Ubuntu 16.04: From Cloudera.
sudo wget 'https://archive.cloudera.com/cdh5/debian/wheezy/amd64/cdh/cloudera.list' -O /etc/apt/sources.list.d/cloudera.list
sudo apt-get update
sudo apt-get install hadoop-hdfs-fuse
Then back to #AlexDvoretsky's answer
I developed a python program that uses FUSE to mount HDFS as a standard filesystem, it also works with Kerberos and it works well: https://github.com/EDS-APHP/py-hdfs-mount

Resources