Installing Cloudera CDH5 using cloudera manager in ubuntu 12.04 LTS - hadoop

I am trying to install CDH5 using Cloudera Manager in Ubuntu 12.04 LTS (64bit). I was following the steps mentioned in the Cloudera link. I was not able to specify the correct host name for installing the CDH5. I dont have any other entries except for 127.0.0.1 & 127.0.1.1 in the /etc/hosts file.
I am using USB dongle for accessing internet and I dont have any ethernet connection right now. Please let me know whether I need to have an ethernet connection to install CDH5 in my PC.
P.S. I am currently working as a mainframe developer and do not have any linux or open source background. I spent almost 40 hours of time trying to install the CDH5 in my machine so that I can work on the exercises in the Udacity's Introduction to Hadoop Course.My PC runs on a Intel Dual core processor which doesn't support the virtualisation to use VMWARE. Hence I got no other options but to install CDH5 in a dual boot partition of ubuntu. Kindly guide me proceeding further.

if you are using Windows-7 64-bit, then get VMWare Player installed.
get centOS-6.3 32-bit vmware-image. It will be able to run on your 64-bit Windows.
And from cloudera site, download a cdh5.repo file. Install CDH5 from that repos file...its very simple.

Related

How can I run a docker windows container on osx?

I'm running docker for mac and want to start up a windows container. From what I see this should work via a virtual machine. But I'm unclear where to find out how to get it to work? Or does it only work for linux containers? Thanks in advance!
docker build nanoserver/
Sending build context to Docker daemon 2.56kB
Step 1/6 : FROM microsoft/nanoserver:10.0.14393.1480
10.0.14393.1480: Pulling from microsoft/nanoserver
bce2fbc256ea: Pulling fs layer
baa0507b781f: Pulling fs layer
image operating system "windows" cannot be used on this platform
I know I am late to the party but as of 2021, this is the easiest setup to get a windows container running on macOS:
https://github.com/StefanScherer/windows-docker-machine
Install vagrant and virtual box
Clone the repository above and change directory into it
vagrant up --provider virtualbox 2019-box
docker context use 2019-box
I followed this setup and I could use the following windows image
mcr.microsoft.com/windows/servercore:ltsc2019
Please note that the windows version of your host must match the container image. This is mentioned here: https://hub.docker.com/_/microsoft-windows
Windows requires the host OS version to match the container OS
version. If you want to run a container based on a newer Windows
build, make sure you have an equivalent host build.
See this link:
https://forums.docker.com/t/how-do-i-start-a-windows-docker-container-on-my-mac-os-x/12953/2
Text if you can't follow the link:
On OS X, get VirtualBox.
Get Windows Server 2016 Tech Preview 5 ISO167 (free download from Microsoft)
Create WS 2016 TP5 VM in virtualbox
Run this206 in the new VM
Now you can run Windows Containers in the VM. To make the setup a little easier to use, see this: https://forums.docker.com/t/windows-server-2016-tp5-docker-server-remote-management/10315/5317
You could also install Bootcamp on your machine which allows you to dual boot your computer between OS X and Windows 10. You could then use the full power of your hardware dedicated to Windows and docker instead of virtualization.
Additionally, you can make the use of VMWare Fusion for Mac OS or Parallels, which allow you to ALSO access the dual boot windows partition from within the Mac OS for maximum flexibility. During installation make sure you do not create a Virtual Machine drive, but instead access the bootcamp partition directly.

Install HDP 2.2 on CentOS 7

As I can see HDP 2.2 needs Centos 6.5 as an operation system, probably because Ambari needs Centos 6.5. My question is if anyone has installed it on Centos 7. Is there any hard dependencies that will not allow me to complete the installation successfully?
Ambari 2.2+ can be installed successfully and works fine on CentOS 7. Then you can install HDP 2.0+.
As far as I'm aware there are no hard dependencies, per se. However Ambari itself looks at the operating system version, and if its CentOS 7, it'll stop the install.
In order to work around that you'd need to edit Ambari's source code.
Just consult the official Installation Guide for a relevant Ambari version
https://cwiki.apache.org/confluence/display/AMBARI/Install+Ambari+2.2.0+from+Public+Repositories
It's an up-to-date source of OS compatibility information.
Here you can see that Centos 7 is officially supported.

Ubuntu img file with hadoop installed in?

Are there any hadoop in ubuntu img files avalible? I mean a ubuntu system which has hadoop configured in it.
If you want a distribution install, Cloudera has a painless installation process for Ubuntu using Cloudera Manager. Though it only officially supports 12.04, it should also install on 13.x
You can download it here: Cloudera Manager
Cloudera Manager supports the following operating systems:
Red Hat-compatible systems
Red Hat Enterprise Linux and CentOS 5.7, 64-bit
Red Hat Enterprise Linux and CentOS 6.4, 64-bit
Oracle Enterprise Linux 6.4, 64-bit
SLES systems - SUSE Linux Enterprise Server 11, 64-bit. Service Pack 3 or later is required. Also, the SUSE Linux Enterprise Software Development Kit 11 SP1 is required on cluster hosts running the Cloudera Manager Agents (not required on the Cloudera Manager Server host); you can download the SDK here.
Debian systems - Debian 7.0, 6.0 (deprecated), 64-bit
Ubuntu systems - Ubuntu 12.04, 10.04 (deprecated), 64-bit
AFAIK there are neither no "official" ubuntu packages for hadoop nor customized ditributions, but there is a PPA you could use. See https://launchpad.net/~hadoop-ubuntu/+archive/stable for instructions. So at least you can install "semioffical" packages (including updates).

Accessing machine through wifi

I have one computer running ubuntu operating system. It is having a wifi router connected to it. I have other laptop which runs windows 7 operating system.
Is there a way to access the ubuntu machine from windows machine through wifi and vice versa ?
You can use TeamViewer in both windows and linux. It will give you full control of the remote machine but I'm not sure if you can do file transfering...
For file transferring, connecting from windows to linux I would use winSCP, which access files through ssh, so you would have to install an run sshd on your linux box. If you haven't sshd in your ubuntu box, install it by doing $ sudo apt-get install ssh. You can start ssh daemon in ubuntu 11.10 with the command $ sudo service ssh start. From linux (Ubuntu 11.10) to windows (w7), I have successfully got into w7 machines in my local network by exploring the Network section in the left bar of the nautilus explorer. Sometimes, for some folders it would ask me for credentials to log into the remote machine, and file transferring was as simple as doing copy and paste (Ctrl+c, Ctrl+v)
hope to be helpful! good luck!
VNC is good for remote work on both Windows and Linux. You'll need to install VNC on Windows but I believe it comes by default with Ubuntu. You need to configure one to be the server and then you can use a client from the other machine to connect to it and remotely control the server machine.
Here are some resources for VNC in Ubuntu: https://help.ubuntu.com/community/VNC
And I use TightVNC when I'm working on Windows (server and client included in the install).
Install XRDP on Ubuntu.
on windows then run msrtc -v
if over the internet , I say use
https://www.dwservice.net/en/download.html
free and lot better than teamviwer.

Install headless Ubuntu server to VirtualBox on windows

I have recently started using VirtualBox to get my Linux environment rather than fully using Ubuntu. For me this works well. But recently i have realized that in the Ubuntu vm the only thing I use a lot is the terminal, mostly just because I need the Linux environment and not the full desktop.
So I tried installing Ubuntu server into a VM, which worked. But as soon as I reboot the machine, it fails after the system boot logo. After BIOS and where I would log on from the command line I simply get a black screen with a non blinking cursor. So I am never fully able to boot into the vbox.
I read up on the command line version, trying to run it headless and then connecting to it from demote desktop. after starting the vbox I am able to connect to the desktop and see the grub screen but after selecting Ubuntu I get that same non-blinking cursor.
So is this really possible? I tried cygwin but it never really felt adequate to me. I like and am very comfortable with the Ubuntu/Debian command line. How could I (if possible) accomplish this? I want to be bale to start up the VBox and get the full command line for that vbox session. Any ideas?
Ubuntu version: 10.10, VirtualBox v. 4.0.4 r70112 and I am on Windows 7 Ultimate.
You didn't mention the versions of Ubuntu and Virtualbox.
I failed twice to install full Ubuntu 10.10 over the latest VirtualBox 4.0.4 over Ubuntu (problems like those you describe), so I switched to Debian 6.0.
All you require to install Ubuntu headless is to install the server version, which you already did. If you get blank screens, tweak the ioapic settings in both VB and Ubuntu. Another tweak is to switch between IDE and SATA drivers for the main disk (the Grub in my non-virtualized Ubuntu hangs if there's USB media attached at boot time).
If you can run full Ubuntu on a VM, you can try downgrading it by removing the xserver-xorg package, or changing the default runlevel.
If all you want is a Linux consule, you can install Debian 6 without any GUI components.

Resources