Getting Started with hadoop on windows - hadoop

I am a newbie here. I just love to code and develop own programs...Day before yesterday I got an idea to set Hadoop on windows. I just fetched all the stacks but could not successfully install it. I am attaching screenshots together with my query. My windows version is 8.1 64 bit.

The snapshot that you provided says that the JAVA_HOME is not set correctly, can you make sure that JAVA_HOME is set properly in your system?
Please verify javac and java commands works from your command prompt.
OR can you please provide hadoop-env.cmd content? so that we can find out the root cause?

Related

How do I clear the cache in Pentaho Data Integration

I am trying to run Pentaho Data Integration (ver. 8.3) in my Windows machine and it is not working.
These are the steps I tried to make it work:
Tried rebooting the machine without success.
Also tried to run the Spoon.bat command directly from the directory where Pentaho is located, but it did not work.
Checked if my java installation changed since the last time it worked, it did not, what can be happening?
In a support chat I read someone was able to fix the problem by clearing the cache, but did not explain how to do it, how do I clean the cache?
Have you installed >jdk java 1.8 environment?
And you should open powershell or other terminal to check: java -version
These are the steps to clear the cache in a Windows environment:
Go to C:\Users\youruser.kettle
Look for the file db.cache-* (I have PDI version 8.3, my file is named db.cache-8.3.0.0-371)
Edit the file with any editor (i.e. Notepad) and erase all content
It worked for me!
First, you should run .\data-integration\set-pentaho-env.bat; It will set pdi environment. The most important is the Java HOME, and JAVA Version. PDI 8.3 can only run in JAVA 1.8 and above.

IntelliJ IDEA - No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK?

I am trying to clean maven project using IntelliJ on mac by running below command but getting error. Please suggest what needs to be done to fix this
./mnwn clean package
Error : "No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK?"
Thanks
The issue is not related to IntelliJ IDEA, you should get the same behavior when you run this command in the system Terminal.
To fix the issue install any JDK on your system and make sure the bin subdirectory of the JDK home directory is added to PATH environment. You may also want to set JAVA_HOME environment variable pointing to this JDK installation home directory.
To verify that it works run java -version in the system Terminal. Make sure it prints the correct Java version of the JDK and not a JRE.
I was facing similar error while workspace setup on a new MAC system.
I was initially referring "/Library/Internet Plug-Ins/JavaAppletPlugin.plugin/Contents/Home/bin" as JAVA_HOME path but it was not correct.
The correct JDK path was "/Library/Java/JavaVirtualMachines/jdk1.8.0_331.jdk/Contents/Home". If you JDK with default installation path on MAC then cross check your JAVA_HOME. It might help you to solve your problem.

how to do spark installation process on windows 8 environment

I need to install spark 1.0.0 on my laptop, which has 64 bit OS windows 8, , java(java version "1.7.0_25"). I downloaded "spark-1.0.0-bin-hadoop2". But i don't know how to install spark 1.0.0. I also searched in Google but i can't find it properly. So can you please tell me the installation steps on windows 8 OS and what any other things are needed for this process ?
You just extract the file you downloaded and you're good to go. You can now run bin/spark-shell to start experimenting.
If your cluster environment runs Linux though, I would recommend using Linux for experimentation/development as well. Having a matching environment will avoid a number of issues.
Install Java 7 or later. Set JAVA_HOME and PATH variable as environment variables.
C:\java-version
Download Scala 2.11 or Scala 2.12 and install. Set SCALA_HOME and add %SCALA_HOME%\bin in PATH variable in environment variables.
To test whether Scala is installed or not, run following command in command prompt.
C:\scala -version
Download and extract it to any drive i.e. c:\program files\spark-1.2.1-bin-hadoop2.3.
Set SPARK_HOME and add %SPARK_HOME%\bin in PATH in environment variables
Run following command on command prompt.
C:\program files\spark-1.2.1-bin-hadoop2.3.\bin\spark-shell
Thats it. this is for windows OS.

Problems with startup.bat of apache-tomcat-7.0.54

I downloaded apache-tomcat-7.0.54 of http://tomcat.apache.org/download-70.cgi, the binary distributions 32-bit Windows zip (pgp, md5).
I went to apache-tomcat-7.0.54\bin\startup.bat on my machine; and did two clicks on this file but when I try localhost:8080, Tomcat is not up and doesn´t show errors.
I had installed JDK 1.6 and I have other version of Tomcat 5.5 and when I try \apache-tomcat-5.5.27\bin\startup.bat the tomcat works perfectly
sorry for my english is a little bad. I wait your help, thanks so much.
Try to open "Command Prompt", go do apache folder and try to start up it using prompt. Post results, please.
You could post the log file too.

Node.js - tutorials on getting it to work with Cygwin on a Vista machine

All,
Am trying to get Node.js to work on Vista machine.
I installed Cygwin (as per the Github instructions) which appears to have been installed correctly. However, none of the commands are executing.
Are there any tutorials for the stages after the Cygwin installation?
PROBLEM: When any command is executed, I get 'Bash: command not found' error.
Not even command like 'c:\cygwin\bin' is executing.
When I type 'user' in cygwin command prompt, I get 'ntvdm has encountered an system error. Parameter incorrect'.
I thought the above error may be due to the firewall, disabling the firewall did not have any effect, running the program with admin rights also did not change the results...
Am confused and would love to get some guidance on what steps to go with next on getting Node.js up and running on a Windows Vista machine.
Many thanks,
UPDATE1:
We managed to make a bit more progress. It appears that we had not installed all the relevant files related to Cygwin. Upon re-download and reinstalled, it ran well, however, we have driven into another error. Error we get:
How to compile/install node.js(could not configure a cxx compiler!) (Ubuntu).
We followed the instructions as per the above thread (3rd post from top for Windows machines), however, we are still stuck at the same error.
Any guidance please?
Have you tried just using the Windows self contained binaries? http://node-js.prcn.co.cc/ This way you actually don't need to bother with Cygwin.
At first, i tried it your way too, using Cygwin. After smashing my head for the 10th time against a wall i just stopped trying and found a much cleaner solution.
I'm using VirtualBox running a Debain guest system to locally develop on my Windows 7 machine. Using VirtualBox, you can easily set up shared folders or port forwarding for node apps between your Windows machine and your Debian guest system.
Since you are using a plain Linux-system, all the compiling-pain is blown away.
If you plan to run node.js in production on a windows system: don't. I hardly believe node.js will be ever stable enough on windows-based systems using MINGW/Cygwin...
People seem to run into problems with Cygwin because they think that they are using a Windows machine.
If you install Cygwin, and open a bash shell prompt using the Cygwin icon, you are now in a UNIX environment and everything works the same as it would on UNIX. That includes building node.js.
I think you added some info to the question and I can see your problem. Yes, normally on Cygwin it has been possible to build node.js just as you would on any UNIX system, but that is no longer possible on Windows 7. Before running ./configure you have to:
Close all cygwin apps.
Double-click on C:\Cygwin\bin\ash.exe
Run ./rebaseall and when it completes, run ./perlrebase.
exit from the ash shell window.
At this point Cygwin will be back to normal and you can ./configure and make install.

Resources