I am running Hadoop Ver 1.1.1 and want to install Oozie 3.3.1 while installing I am getting following error
hduseros#MT2012018:/usr/local/oozie-3.3.1$ ./distro/target/oozie-3.3.1-distro/oozie-3.3.1/bin/oozie-setup.sh -hadoop 1.1.1 /usr/local/hadoop -extjs /usr/local/oozie-3.3.1/webapp/src/main/webapp/ext-2.2.zip
setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
Exiting: Unsupported Hadoop version '', supported versions: 0.20.1, 0.20.2, 0.20.104, 0.20.200, 0.23.x and 2.x
I am following this tutorial
http://practicalcloudcomputing.com/post/26337621577/installing-and-running-apache-oozie-3-2-x-and-possibly?543b50f0
Before running this oozie-setup.sh, you need to copy the required jars of hadoop 1.1.1 into libext directory in oozie home. then run the above command.
http://srikanthayalasomayajulu.blogspot.sg/2013/02/apache-oozie-331-installation-on-apache.html
follow this link...hope this should be helpful
Related
I want to pip install pyspark into my python3 virtual environment but the only choice I have is the PyPI version compiled with Hadoop 2.7.4 dependencies. I need a Hadoop 3.x version since 2.7.4 is too old for modern AWS S3 integration.
Does anyone know why there isn't an option to pip install pyspark with Hadoop 3.x support?
Is my only option to build my own pyspark from source?
How do i install hadoop 2.8.0 instead of hadoop 3.1.1 via brew ?
alternatively, how to use brew to install downloded hadoop 2.8.0 from my desktop ?
I am in the process of installing spark in my organization's HDP box. I run yum install spark and it installs Spark 1.4.1. How do I install Spark 2.0? Please help!
Spark 2 is supported (as a technical preview) in HDP 2.5. You can get the specific HDP 2.5 repo added to your yum repo directory and then install the same. Spark 1.6.2 is the version default in HDP 2.5.
wget http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.5.0.0/hdp.repo
sudo cp hdp.repo /etc/yum.repos.d/hdp.repo
sudo yum install spark2-master
or
sudo yum install spark2 (also seems to be doing the same when i tried)
see whats new in HDP 2.5 http://hortonworks.com/products/data-center/hdp/
For full list of repos see https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_release-notes/content/download-links-250.html
If I install Hadoop and Hbase:
brew install hadoop hbase
I get the following versions:
hadoop: 2.6.0
hbase: 0.98.8
But need the versions:
hadoop: 1.1.2
hbase: 0.94.8
How can I install older versions through the Brew?
If you already have hadoop & hbase installed using brew unlink them using:
brew unlink hadoop
brew unlink hbase
Now try and search for a specific version of hadoop and hbase using versions subcommand:
$ brew versions hadoop | grep 1.1.2
1.1.2 git checkout d133e18 /usr/local/Library/Formula/hadoop.rb
$ brew versions hadoop | grep 0.94.8
0.94.8 git checkout 33fdb3e /usr/local/Library/Formula/hbase.rb
Now go to /usr/local/Library and check out (git checkout) the versions you need:
git checkout d133e18 /usr/local/Library/Formula/hadoop.rb
git checkout 33fdb3e /usr/local/Library/Formula/hbase.rb
Finally perform a brew install hadoop hbase to get the versions you want.
Hadoop is already present (and has been working fine for better part of a year)
07:48:30/~:177 $which hadoop
/usr/local/Cellar/hadoop/1.2.1/libexec/bin/hadoop
But attempting to install hbase results in a hadoop dependency error:
07:48:28/~:176 $brew install hbase
==> Installing hbase dependency: hadoop
Warning: Could not link hadoop. Unlinking...
Error: Permission denied - /usr/local/bin/task-controller
Try the following
$ brew upgrade hadoop
$ brew install hbase
After I uninstalled hbase this particular error did not recur: instead the following happened:
https://stackoverflow.com/questions/24288842/running-hbase-on-mac-connection-reset-by-peer