I've managed to get cloudera single node hadoop cluster up and running from this package: http://archive.cloudera.com/cdh5/one-click-install/precise/amd64/cdh5-repository_1.0_all.deb
my colleagues asked me what minor release of cloudera this is installing.. and i am stumped as to which. Is there some info, readme, config or license file that gives this information for cloudera hadoop distros once they are installed ?
Or maybe someone just knows which minor release the above URL will install (if you could provide that info along with a link to a documentation source that would be fantastic.)
thanks in advance
-chris
The one-click install repo currently points to the latest Cloudera version, which is 5.3.0 as of earlier this week.
To check the version you installed, just list the package name. There should be some version number like '5.2.x' appended to the package name. An example command:
dpkg -l | grep 'cloudera'
Related
I have installed a CDH5(cdh5.15.1 version) cluster on ubuntu nodes and I want to install hadoop-client on one ubuntu host (which is not managed by cloudera).
I added cloudera repo on my ubuntu host but when I run apt-get install hadoop-client , by default it install version 5.16. However I want to install version 5.15.1 version for hadoop-client( which is available in repo).
The problem is I am not able to figure out which version number should I give . The deb package name for hadoop client cdh5.15.1 is:
hadoop-client_2.6.0+cdh5.15.1+2822-1.cdh5.15.1.p0.4~xenial-cdh5.15.1_all.deb
I have to run apt-get install hadoop-client=< version number > so that it picks up and install the specific version.
Please help me to figure out the exact version number.
Thanks in adv. :)
use apt-cache policy hadoop-client to see versions available from your package CDH
EDIT :
use apt-cache madison hadoop-client instead to see all versions available in your packages.
You can also use apt list -a hadoop-client which has the same purprose
I failed starting scm-agent services on a single node hadoop cluster on a VM. After a long search, the underscore in hostname was removed, all packages were uninstalled, and re-installation went well.
However, I am now seeing an error:
No CDH version detected. Check Again.
One of the solutions mentioned on other portals was yum info |grep my version which actually is in no direction.
Can someone point out what could have gone wrong?
yum list|grep your version
then yum removed all the prvious versions.
https://community.cloudera.com/t5/Cloudera-Manager-Installation/Cluster-Installation-Detecting-CDH-versions-on-all-hosts/m-p/30090#M5105
When I rpm pxf service in hawq, I got some errors:
error: Failed dependencies:
hadoop >= 2.6.0 is needed by pxf-service-0:3.0.0-root.noarch
hadoop-hdfs >= 2.6.0 is needed by pxf-service-0:3.0.0-root.noarch
What's your advice here ?
Please make sure the PXF rpm OS architecture version matches. For example if the PXF rpm is built for RHEL6 and you are installing on RHEL7 then you may see some dependency issues
Could you please make sure the version of hadoop you are running in the cluster .I guess you might be running a lower version of hadoop .You have to run atleast 2.6 version of hadoop to run the current version of pxf .
The wiki here use the rpm bigtop(hadoop).
https://cwiki.apache.org/confluence/display/HAWQ/Build+Package+and+Install+with+RPM
It means if I install with rpm(HAWQ 2.2.0), the other ways (using binary hadoop without rpm installs like tar) are not support.
If I install hadoop use tar, I must build HAWQ from source code for now.
Please refer to:
https://issues.apache.org/jira/browse/HAWQ-1568
I have installed the latest Jul2015 release, and I would like to use the
latest tools tachograph to determine the progress of query execution.
According to https://www.monetdb.org/Documentation/Manuals/MonetDB/Profiler/tachograph,
Tachograph is available as of Jul2015 release
But I do not know how to install it. My system is ubuntu 14.04.
I have tried to use sudo apt-get install monetdb-tools but failed to
locate the package monetdb-tools.
Any suggestion would be helpful. Thanks.
Tachograph is in monetdb-client-tools. Also, see https://dev.monetdb.org/downloads/deb/ for instructions on how to add the MonetDB repository to your system.
I'm setting up a HDP 2.1 cluster with Apache Ambari. All servers run SLES 11 SP3. The setup fails if I select to install Ganglia because of some dependencies:
Installing package apache2?mod_php* ('/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm apache2?mod_php*')
Problem: apache2-mod_php53-5.3.17-0.27.1.x86_64 conflicts with apache2-mod_php5 provided by apache2-mod_php5-5.2.14-0.7.30.50.1.x86_64
Solution 1: Following actions will be done:
do not install apache2-mod_php5-5.2.14-0.7.30.50.1.x86_64
deinstallation of php5-5.2.14-0.7.30.50.1.x86_64
deinstallation of php5-xmlwriter-5.2.14-0.7.30.50.1.x86_64
[... more PHP 5.2.x packages ...]
Solution 2: do not install apache2-mod_php53-5.3.17-0.27.1.x86_64
Apparently the Regex picks the 5.3 version, a 5.2 version would be available though.
So my question is: Where is the install script stored, that Ambari is running here? I would like to replace the regex with the correct version of the package.
Information about what packages are to be installed is stored in
/var/lib/ambari-server/resources/stacks/HDP/2.0.6/services/GANGLIA/metainfo.xml
Change the value and restart the Ambari Server for the changes to take effect.