The POSIX documentation says that libfuse version 2.9.3 is required. On my EMR 6.2.0 systems, only 2.9.2 is offered.
I have removed the 2.9.2 libfuse and installed the version 3 libfuse. However, Alluxio does not mount fuse as I suppose it is still looking for 2.9.2.
How do I get Alluxio POSIX to run with version 3 libfuse? Or, is there a 2.9.3 libfuse for EMR?
libfuse 2.9.2 supposes to be working with Alluxio Fuse. It's not that much different from 2.9.3. we don't support libfuse 3 yet. https://github.com/Alluxio/alluxio/issues/12758 Supporting libfuse 3 is a nice to have, but we haven't got strong enough reasons/priorities to do the upgrade job.
Related
I have developed a qt application on Ubuntu 16 but for testing I need to run it on redhat 5. But I am using c++11 standard features in my code and gcc (very old version on redhat) does not recognise this. I need to know is it possible to install gcc version (anything above than 5.0) on redhat 5?
I have already searched online but most of the links take me to redhat 7. Please note that I cannot upgrade to rhel 7.
I recently came across Hadoop version, in this I noticed that, both 2.6.5 and 2.7.3 are been developed parallel and simultaneous.If possible someone please give me difference between them.
08 October, 2016: Release 2.6.5 available
A point release for the 2.6 line.
Please see the Hadoop 2.6.5 Release Notes for the list of 79 critical bug fixes and since the previous release 2.6.4.
25 August, 2016: Release 2.7.3 available
A point release for the 2.7 line.
Please see the Hadoop 2.7.3 Release Notes for the list of 221 bug fixes and patches since the previous release 2.7.2.
http://hadoop.apache.org/releases.html explains the difference between the 2.6 and 2.7 releases:
21 April 2015: Release 2.7.0 available
Apache Hadoop 2.7.0 contains a number of significant enhancements. A few of them are noted below.
IMPORTANT notes
This release drops support for JDK6 runtime and works with JDK 7+ only.
So the difference is that 2.7 was introduced for JDK 7+, but 2.6 continues having releases to support JDK6 users.
From that same link you can see that 2.7 is having more bug fixes made per point release than the 2.6 tree.
I have an installed CDH cluster and used hadoop version, but it returns only with Hadoop version. Is there any way to get maybe all installed components version number on a graphical interface? Which command can get for example Spark version number?
Open CM (hostname:portnumber) -> Hosts tab -> Host Inspector to find what version of
CM and CDH is installed across all hosts in the cluster, as well as installed cdh components list with version details
Spark version can checked in using
spark-submit --version
Spark was developed separately from Hadoop-hdfs and Hadoop-mapreduce as a standalone tool which can be be used along with Hadoop, as such most of its interfaces are are different from hadoop.
I'm using CDH 4.7.0 and will be installing Flume to feed HDFS data. I also downloaded Flume v1.4.0 from Apache (the same version that CDH comes with. There seem to be 2 flume-ng-core files between the one that comes with CDH and the one from Apache. There versions are 1.4.0 and 1.4.0-cdh4.7.0. Should I be using 1.4.0-cdh4.7.0 or can I safely use 1.4.0?
Flume 1.4.0 and Flume version 1.4.0-cdh4.7.0 are same but 1.4.0-cdh4.7.0 is compiled and tested with CDH4.7.0 therefore 1.4.0-cdh4.7.0 is risk free to use with CDH4.7.0.
Hence I recommend to use the cdh4.7.0 version of flume along with your CDH4.7.0 version.
As I can see HDP 2.2 needs Centos 6.5 as an operation system, probably because Ambari needs Centos 6.5. My question is if anyone has installed it on Centos 7. Is there any hard dependencies that will not allow me to complete the installation successfully?
Ambari 2.2+ can be installed successfully and works fine on CentOS 7. Then you can install HDP 2.0+.
As far as I'm aware there are no hard dependencies, per se. However Ambari itself looks at the operating system version, and if its CentOS 7, it'll stop the install.
In order to work around that you'd need to edit Ambari's source code.
Just consult the official Installation Guide for a relevant Ambari version
https://cwiki.apache.org/confluence/display/AMBARI/Install+Ambari+2.2.0+from+Public+Repositories
It's an up-to-date source of OS compatibility information.
Here you can see that Centos 7 is officially supported.