How to run hdp3.1? - hadoop

I'm newer in Big data solution developments.
To have a complete environment I decide to install hdp 3.1 docker image.
After installation, I taped this two commands like mentioned in this installation guide: https://www.cloudera.com/tutorials/sandbox-deployment-and-install-guide/3/.html
docker start sandbox-hdf
docker start sandbox-proxy
Now after doing this , I don't know what doing in the next step, I don't found any indication of URL address for starting my real work, I don't fount what are the settings that I must do it before starting. Please, anyone has an experience with hdp 3.1 can help me. Thank you a lot.
https://www.cloudera.com/tutorials/sandbox-deployment-and-install-guide/3/.html

Related

Is it possible to install CDH on a RHEL7 server where Hadoop and few other components are installed seperatly

I have an RHEL7 server in which i am trying to create a common datalake platform for POC and learning purpose. I have setup Hadoop,Hive,Zookeeper,Kafka,Spark,Sqoop separately.
Installing these components separately turns out to be a tricky affair and is taking lot of effort even though this is for an internal purpose and not production specific.
I am now trying to install CDH package in this Server now.
Is it possible to do so? Will it overlap with the current installations?
How can this be achieved.
Note: Reason why we went with separate installation is due to unavailability of internet in the server at that point of time.
Reason why going for CDH now is due to availability of internet for few days after some approvals plus CDH saves lot of time and effort and includes the
components required to setup a datalake.
Can someone please help me out here.
Yes it is feasible to setup CDH without disturbing existing configs with docker. Checkout the below link for setup guide. I have tested this and it works fine even if I have individual tools setup.
https://www.cloudera.com/documentation/enterprise/5-6-x/topics/quickstart_docker_container.html

CouchDB can't set up HTTPS

I am learning to work with CouchDB and I am usually making Ajax calls in order to communicate with my database. I started getting '
Cross-Origin Request blocked
' and as the reason
Access-Control-Allow-Origin
, so I decided to work with CouchDB through HTTPS and not the standard HTTP. For that, I have followed the instructions given on Link to manual.
Problem on Linux:
I first tried to set it up on my laptop where I use Linux. But I couldn't find the Local.ini file where I was supposed to set the paths to the certificates.
After unsuccessfully trying to find a solution for it, I gave up and started from the beginning on my computer, where I use Windows.
Problem on Windows:
So I installed the newest version of CouchDB on my Windows, I have created the certificates, found the Local.ini file, did everything as it is explained in the manual. The problem was that I couldn't restart CouchDB so that the changes would take place. So, after google-ing the problem, I found a possible solution, to stop CouchDB through the Task Manager->Services-> Stop Apache CouchDB. But when I tried to Start it again I get the problem
Windows could not start the Apache CouchDB on Local Computer. For more information, review the System Event Log. If this is a non-Microsoft service, contact the service vendor, and refer to service-specification error code 3.
I would be very happy if someone could help me with my problem(s). I prefer getting a solution for the Linux problem since I work mostly on my laptop, but I will be satisfied if I get it going even on Windows.
Thanks in advance
On Linux, you can add CORS to CouchDB with this package:
https://github.com/pouchdb/add-cors-to-couchdb

Fixing Apache for MacOS Sierra: Reset apachectl

Due to my own idiocracy I have managed to run two versions of Apache on my Mac OS. Since a late update to Sierra my webserver has fallen into decay. I feel it is only a matter of time, until the whole environment breaks down and the OS is doomed for reincarnation.
For now I have managed to get my system side Apache running. However I have found that my "apachectl" command has been replaced with the brew version of apache. Since I am not strong with cmd line I want to ask how I can revert this? For now I am starting system side apache with "/usr/sbin/apachectl start".
If anyone could give me some advice how to keep the two versions from colliding, I would be more than grateful: keep brew apache from autoloading, check for which httpd processes are running and where they are rooted, put brew apache in a dumpster in the middle of the night etc.
I also have brew versions of php installed but I dare not to uninstall due to dependencies... any advide here would be appreciated as well.
IF ANY NEWCOMER READS THIS THREAD: Since I updated my Mac OS to the new Sierra my whole Apache configurations have gone mad. Unfortunately I have followed a very, very bad tutorial a few updates ago (https://www.getgrav.org/blog/macos-sierra-apache-multiple-php-versions) to configure my web development environment. I RECOMMEND EVERYONE TO AVOID THIS TUTORIAL! The blogger writes that his tutorial is only for advanced developers, however the tutorial itself is a total mess: there are no hints for any backup files and the configurations are all in bad style... I would advise anyone to double check on custom configurations in apache and always backup every file you change! For me it is too late and I feel only a hard reset of the system will suffice. Dark days on the horizon...
When you upgraded to the new OS, it does change your default apache config. The good thing is it does save a copy and renames it to httpd.conf~previous also creates a folder under etc/apache2/original for the previous default version. Just copy them back over and you're good to go.
Also you can throw homebrew in the dumpster using their own script
ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/uninstall)"
Hope that helps.

Docker unable to start, new network adapter created on every restart

I am using Docker 1.8.2c, VirtualBox 5.0.4 on Windows 8.1.
I have been successfully been using this configuration for a long period, but then I had to install OpenShift to check its feasibility. This never worked out as there were networking issues with new network adapters being created all the time, and not being able to connect to the internet.
I have uninstalled everything, and reinstalled Docker 1.8.2c and somehow the problem is still persistent and Docker will not even start now.
I have looked around and not found a way to investigate or resolve the problem.
Thanks for your advice.
Cheers
Kris
Try to do an upgrade like Dan Lowe said and if you have error messages can you post them here ?

How to install and run (setup) reddit.com on windows environment?

Reddit.com is providing their code as open source and free.
I want to setup the reddit.com website at my local machine in Windows Environment.
Could anybody please help me or guide me to the best approach.
Also, i have apache (WAMP) installed in my machine.
Kindly somebody help, I have searched everywhere but unable to find the way to setup it in my local environment.
From Reddit blog it is built and runs upon:
Debian, lighttpd, PostgreSQL, Python ...
None of them is an acronym of WAMP.
A good place to start would be:
http://code.reddit.com/
I recommend setting up a Virtual Box with Debian linux and work within it.

Resources