How to install hadoop user environment (HUE) in Raspberry Pi-3? - hadoop

When hue install on Raspberry pi ,get error .
/usr/local/hue-4.1.0/Makefile.sdk:120: recipe for target '/usr/local/hue-
4.1.0/desktop/core/build/cryptography-1.3.1/egg.stamp' failed
make[2]: *** [/usr/local/hue-4.1.0/desktop/core/build/cryptography-
1.3.1/egg.stamp] Error 1
make[2]: Leaving directory '/usr/local/hue-4.1.0/desktop/core'
Makefile:70: recipe for target '.recursive-env-install/core' failed
make[1]: *** [.recursive-env-install/core] Error 2
make[1]: Leaving directory '/usr/local/hue-4.1.0/desktop'
Makefile:73: recipe for target 'desktop' failed
make: *** [desktop] Error 2

I use Jessie as the new openssl libs in Stretch cause compile problems with Hadoop, so specifically this release:
http://downloads.raspberrypi.org/raspbian_lite/images/raspbian_lite-2017-07-05/
You'll need to install the build dependencies, I use these (but they do include all the ones need for hadoop compilation too, so you could slim it down quite a bit)
apt-get install oracle-java8-jdk maven build-essential autoconf automake libtool cmake zlib1g-dev pkg-config libssl-dev libfuse-dev libsnappy-dev libsnappy-java libbz2-dev python-dev libsasl2-dev libxml2-dev libxslt-dev libkrb5-dev libffi-dev libldap2-dev libmysqlclient-dev libsqlite3-dev libgmp3-dev libssl-dev
Then download, unpack and build hue 3.11.0
wget http://gethue.com/downloads/releases/3.11.0/hue-3.11.0.tgz
tar -zxvf hue-3.11.0.tgz
cd hue-3.11.0
make apps
I've tested this with 3.11, 3.12, 4.1 and 4.2 using the same build environment on the Pi-3.
If you are looking to build a full hadoop environment on the pi you might want to look at hadoopi:
https://github.com/andyburgin/hadoopi
The README has all the instructions on building and configuring a bunch of hadoop components in addition to Hue.
Andy

Related

PCRE2 not found in Mac

I have installed pcre2 version 10.37 by downloading the tar file and doing
./configure
make
sudo make install
When I run
pcre2 --version
or
which pcre2
In the terminal, I get command not found.
I am building my project that needs "pcre2" to compile successfully but after running "make" in the project directory I get the following:
ERROR! pcre2 library not found, go get it
from www.pcre.org. Or from packages:
Debian/Ubuntu: apt install libpcre2-dev
Fedora: dnf install pcre2-devel
CentOS/RHEL: yum install pcre2-devel
make: *** [config.status] Error 1
I can find the following files in /usr/local/lib/

make: *** [Makefile:1280: install] Error 1

OS Ubuntu 20.04.3
Python intalation 3.10.2
error: make: *** [Makefile:1280: install] Erro 1 after sudo make install
make: latest version
what should I do?
This is the full set of steps which worked for me. to install
# python3 --version
Python 3.10.4
In Ubuntu 21.10:
$ sudo apt install build-essential
$ sudo apt install libssl-dev libffi-dev libncurses5-dev zlib1g zlib1g-dev libreadline-dev libbz2-dev libsqlite3-dev make gcc
$ cd /to/extracted/folder
$ ./configure
$ make
$ sudo make install
Common errors if you do not follow this process:
Critical dependencies were missing:
[Makefile:1280: install] Erro 1
Ran 'make' before all dependencies were met but it didn't fail to compile (have to install all packages then make clean then make):
pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Collecting <package>
Could not fetch URL https://pypi.python.org/simple/<package>/: There was a problem confirming the ssl certificate: Can't connect to HTTPS URL because the SSL module is not available. - skipping
Could not find a version that satisfies the requirement <package> (from versions: )
No matching distribution found for <package>
You have to install dependencies (libraries) to be able build python from source code:
sudo apt install libssl-dev libffi-dev libncurses5-dev zlib1g zlib1g-dev libreadline-dev libbz2-dev libsqlite3-dev make gcc

`gnutls/gnutls.h: No such file or directory` while installing latest `cups`

I am trying to install the latest version of cups 2.3.3, I was following
https://fossies.org/linux/cups/INSTALL.md
After the make command, I got the foll error.
In file included from cups-private.h:21:0,
from auth.c:17:
http-private.h:70:14: fatal error: gnutls/gnutls.h: No such file or directory
# include <gnutls/gnutls.h>
^~~~~~~~~~~~~~~~~
compilation terminated.
make[1]: *** [../Makedefs:271: auth.o] Error 1
Note that I followed the step
sudo apt-get install autoconf build-essential libavahi-client-dev \
libgnutls28-dev libkrb5-dev libnss-mdns libpam-dev \
libsystemd-dev libusb-1.0-0-dev zlib1g-dev
before going to make.
It seems like you're missing a gnutls related package. Try to search which package you need:
$ apt-file search gnutls/gnutls.h
libgnutls28-dev: /usr/include/gnutls/gnutls.h

rbenv install 2.2.1 BUILD FAILED Ubuntu 16.04

Here is the error log
Downloading ruby-2.2.1.tar.bz2...
-> https://cache.ruby-lang.org/pub/ruby/2.2/ruby-2.2.1.tar.bz2
Installing ruby-2.2.1...
WARNING: ruby-2.2.1 is past its end of life and is now unsupported.
It no longer receives bug fixes or critical security updates.
BUILD FAILED (Ubuntu 16.04 using ruby-build 20181019-2-gd49b8a1)
Inspect or clean up the working tree at /tmp/ruby-build.20181025114001.11061
Results logged to /tmp/ruby-build.20181025114001.11061.log
Last 10 log lines:
make[2]: Leaving directory '/tmp/ruby-build.20181025114001.11061/ruby-2.2.1/ext/objspace'
installing default date_core libraries
installing default nkf libraries
linking shared-object nkf.so
linking shared-object date_core.so
make[2]: Leaving directory '/tmp/ruby-build.20181025114001.11061/ruby-2.2.1/ext/nkf'
make[2]: Leaving directory '/tmp/ruby-build.20181025114001.11061/ruby-2.2.1/ext/date'
make[1]: Leaving directory '/tmp/ruby-build.20181025114001.11061/ruby-2.2.1'
uncommon.mk:189: recipe for target 'build-ext' failed
make: *** [build-ext] Error 2
I'm not sure what to do here. I am new to rbenv. I try to fix this issues searching on google but nothing work also I've try to install apt-get install autoconf bison build-essential libssl-dev libyaml-dev libreadline6 libreadline6-dev zlib1g zlib1g-dev
here is the complete log ruby-build.20181025125952.32167.log

Mesos make check command produces error

I am trying to install mesos using the following commands
$ wget http://www.apache.org/dist/mesos/0.28.2/mesos-0.28.2.tar.gz
$ tar -zxf mesos-0.28.2.tar.gz
instructions for stock Ubuntu 14.04
# Update the packages.
$ sudo apt-get update
# Install a few utility tools.
$ sudo apt-get install -y tar wget git
# Install the latest OpenJDK.
$ sudo apt-get install -y openjdk-7-jdk
# Install autotools (Only necessary if building from git repository).
$ sudo apt-get install -y autoconf libtool
# Install other Mesos dependencies.
$ sudo apt-get -y install build-essential python-dev libcurl4-nss-dev libsasl2-dev libsasl2-modules maven libapr1-dev libsvn-dev
Then the build commands
# Change working directory.
$ cd mesos
# Configure and build.
$ mkdir build
$ cd build
$ ../configure
$ make
# Run test suite.
$ make check
The last command make check produces this error
internal compiler error: killed (program cc1plus) please submit a full bug report,
with preprocessed source if appropriate.
see <file:///usr/share/doc/gcc-4.8/README.Bugs> for instructions.
make[3]: *** [test/mesos_tests-master_tests.o] Error 4
make[3]: Leaving directory '/home/manar/mesos-0.28.2/build/src'
make[2]: *** [check-am] Error 2
make[2]: Leaving directory '/home/manar/mesos-0.28.2/build/src'
make[1]: *** [check] Error 2
make[1]: Leaving directory '/home/manar/mesos-0.28.2/build/src'
make: *** [check-recursive] Error 1
Ubuntu version: 14.04
The reported error message comes from GCC. The reason GCC produced an error message is probably because the box ran out of RAM (compiling Mesos needs ~2GB of RAM). What are the hardware specs on the box?

Resources