how to do spark installation process on windows 8 environment - installation

I need to install spark 1.0.0 on my laptop, which has 64 bit OS windows 8, , java(java version "1.7.0_25"). I downloaded "spark-1.0.0-bin-hadoop2". But i don't know how to install spark 1.0.0. I also searched in Google but i can't find it properly. So can you please tell me the installation steps on windows 8 OS and what any other things are needed for this process ?

You just extract the file you downloaded and you're good to go. You can now run bin/spark-shell to start experimenting.
If your cluster environment runs Linux though, I would recommend using Linux for experimentation/development as well. Having a matching environment will avoid a number of issues.

Install Java 7 or later. Set JAVA_HOME and PATH variable as environment variables.
C:\java-version
Download Scala 2.11 or Scala 2.12 and install. Set SCALA_HOME and add %SCALA_HOME%\bin in PATH variable in environment variables.
To test whether Scala is installed or not, run following command in command prompt.
C:\scala -version
Download and extract it to any drive i.e. c:\program files\spark-1.2.1-bin-hadoop2.3.
Set SPARK_HOME and add %SPARK_HOME%\bin in PATH in environment variables
Run following command on command prompt.
C:\program files\spark-1.2.1-bin-hadoop2.3.\bin\spark-shell
Thats it. this is for windows OS.

Related

Fresh install of Liquibase 3.10 is failing

I have just installed Liquibase 3.10 using the Windows installer on Win10 64-bit. When I run the command "liquibase --help" from the command line, the liquibase.bat file fails with the following error;
="=="" ( was unexpected at this time.
I can see by looking at the batch file the error occurs in the section where it is manipulating the JAVA_HOME environment variable.
On my system, there is no JAVA_HOME environment variable.
I'm not an expert Windows batch file programmer, so I need help with this!
PS. Liquibase is installed in the following path: C:\Program Files\liquibase

Issue with JDK installation

I have install JDK 8 kit.
I have set path variable to jdk bin
D:\Java\jdk1.8.0_181\bin
and home to jdk.
D:\Java\jdk1.8.0_181
I am able to see the version in cmd promt when I give java -version. But when I give javac - version its not able to find the jdk? Can anyone say what could be wrong?
On windows after installation (if no other java's are there) it should work out of the box - if not you should set JAVA_HOME to D:\Java\jdk1.8.0_181 and add JAVA_HOME\bin to the path. If you do so you have to restart any already open commandline - because they will not get the JAVA_HOME/PATH updates (if you did them via the windows system control).
You could test what java -version tells you first - to find out if a runtime environment is still referenced.

Tizen-sdk-for-wearable-setup Installation issue because of JAVA HOME

System Configuration:
OS - Windows 8
System type - 64-bit Operating System , x64-based processor
I have installed java-8 and set JAVA_HOME as
C:\Program Files\Java\jdk1.8.0
I am getting error as below image while Tizen-sdk-for-wearable-setup Installation.
error - Cannot execute Java even if it was installed. Check environment variable or Java version(over 1.6) please.
I tried installing after JDK 7 both 32 bit and 64 bit and setting JAVA_HOME - Program Files path and Program Files (x86) path both also it didn't worked.
I have a another system in which the Issue didn't occurred.
System Configuration :
OS - Windows 7 Enterprise
System Type - 32 bit operating system.
Installed Java - C:\Program Files\Java\jdk1.6.0_45
JAVA_HOME set as - C:\Progra~1\Java\jdk1.6.0_45
Now there may be many chances why installation is not getting in my win-8 64 bit.
64 bit JAVA support is not available.
I am not sure about ~ symbol in JAVA_HOME path but it may be to escape space between Program Files and I have not set java home using this symbol.
In win-8 64 bit I have 2 folders. Program Files and Program Files (x86) , I am not sure whether to use ~ or " " to set JAVA_HOME and for 32 bit java or 64 bit java installed.
May be only java 1.6 is supported right now.
I searched and found similar issues :
I find this link but not able to get why its advised to set the system environment Path Variable to 'c:\windows\system32'.
In this link its advised to use InstallManager.jar via cmd.exe.
I can try each possible assumption till it works but hoping to find a solution with proper reason why I am getting this error.
If any one knows how should I work this out please help.
At last solve the Issue.
Installed jdk1.7.0_51 (I think currently JAVA 8 is not supported).
Set the JAVA_HOME as C:\PROGRA~1\Java\jdk1.7.0_51 (thanks to #Michael comment).
This link: https://answers.madewithmarmalade.com/questions/16878/cant-install-tizen-sdk-on-windows-8-64-bit.html solved for me the problem of Tizen SDK installation:
Change directory to %LOCALAPPDATA%\Temp\tizensdk_TimeStampOfInstallationInvocation
java -jar InstallManager.jar
My system: Windows 7 Ultimate x64. Java's version installed (64 bit):
g:>echo %JAVA_HOME%
c:\Program Files\Java\jdk1.8.0_05
g:>echo %CLASSPATH%
c:\Program Files\Java\jdk1.8.0_05\jre\lib
Added to PATH: c:\Program Files\Java\jdk1.8.0_05\bin\
(Tizen IDE and "Hello World" example run just fine.)
I encountered the same problem and finally I realised that my version of Tizen installer is 64bit but I installed 32bit java in my computer. Then I downloaded 32bit Tizen installer and everything was fine.
I encountered the same problem, and it was solved by placing the Java path in the beginning of the system path ! weird.. but worked :)
You must include, depending on whether you downloaded the x86 or x64 Tizen installer, C:\Program Files (x86)\Java\jre7\bin or C:\Program Files\Java\jre7\bin in the PATH environment system variable. You can't use java 8. See this oracle page for instructions on setting environment variables. I have read some others mention that they put the entry at the very beginning of the PATH variable. I think this would only matter if you also had an entry for java 8, but better safe than sorry.

Glassfish installation JRE not found

I can't install Oracle Glassfish Server 3.1.2.2
When I run the installer (as admin) a dialog box appears saying "extracting files" and then I get the following error box saying I don't have JRE installed.
I have JRE and JDK 1.6 and 1.7 installed (all are 64 bit).
All are in the PATH system variable.
I've tried the program from CMD using the instructions in the error.
The command I use to run is:
OracleGlassfishServer(OGS)-3.1.2.2-windows.exe" -j "c:\Program Files\Java\jdk1.7.0_09\bin
I've also tried with the 1.6 bin.
I am running Win 7 64 bit.
The only thing I haven't thought to try yet was installing a 32bit JRE in the Program Files(x86) directory. Does it make sense that this would require a 32bit JRE?
What else could be the cause?
The Glassfish installation program requires the path to the JRE installation folder to be in the JAVA_HOME environment variable; if the variable is not set the folder can be specified on the command line. In both cases the folder must be the root folder of the JRE, not the bin subfolder.
Unfortunately, I found setting JAVA_HOME to be ineffective for me.
The solution that worked on my server was to run the Glassfish install with the -j option pointing to my JDK.
using command line and pointing to JRE installation directory should work Just fine, the problem with the above command is that you were pointing to bin directory, simply point to the home directory that is "c:\Program Files\Java\jdk1.7.0_09"

How to prevent that java.exe is installed in Windows' system32?

Is there a way to prevent that the Java installation routine (e.g. jdk-7u1-windows-i586.exe) copies java.exe into C:\Windows\system32 directory?
I have to install my software on a client's laptop and I don't want to break other Java applications which are already installed on the machine. In other words I want to install a private JRE which is only used by my software.
By now, I copied an already installed JRE from my computer to the client's machine.
I discovered yesterday that there is a problem with Java versions on Windows, as you know keeping java up to date these days is critical, especially the JRE used by Internet explorer located in the Windows system32 or syswow64 folder.
You can perform a search for java in your C: drive and look at the various executable files it finds to determine if the situation applies on a specific system.
After doing some research I find that when the Java updater runs, it only updates the files installed in the JAVA home , usually located on the program files, but it does NOT update the files located in the windows system folder. As a result and since the system folder is in the default system PATH , the usage of Internet Explorer continues to use an old version of the JAVA files ( java.exe , javaw.exe , javaws.exe )
The solution is to uninstall java using the control panel uninstall programs feature, download most recent version and install again.
Cheers!
Fernando
I recently upgraded to java 8 and discovered this problem as the java version under system32 was still java 7. It stops you even running version as it complains about the registry keys
U:\>java -version
Error: Registry key 'Software\JavaSoft\Java Runtime Environment'\CurrentVersion'
has value '1.8', but '1.7' is required.
Error: could not find java.dll
Error: Could not find Java SE Runtime Environment.
Doing the following pointed me to the culprit:
U:\>where java
C:\Windows\System32\java.exe
C:\Program Files\Java\jdk1.8.0_45\bin\java.exe
I 'solved' this problem by just deleting the java under system32! I'm unsure of what consequences this will have.
You can just provide the JRE you want to use on your software and:
Set the JAVA_HOME variable before you run your application
Point to the correct java.exe file (e.g. ..\jre1.5.0_22\bin\java <your_java_main>)
This can be done in a *.bat file for example.
After running the *.bat file you created, all other java version will be ignored and it won't matter which versions are, or will be, installed on that pc.
I found the newest JDK still doesn't write correct code against registry.
The issue is if a computer doesn't have JRE, JDK doesn't register JRE in registry correctly.
For those install JDK 1.7u72 Just add Software\JavaSoft\Java Runtime Environment as the error message indicate. And add a string entry of CurrentVersion with value 1.7.
And then add Software\JavaSoft\Java Runtime Environment\1.7 and put a JavaHome string entry with value "C:\Program Files\Java\jre7". And JRE will function correctly.
Blame Oracle, if you use Registry, then write correct code, otherwise don't use the Registry!
All you have to do is go to Control Panel -> Programs Uninstall a program. Uninstall the old java updates and keep the newest java update and java development kit update. Your newest java update and java development kit update should have the same number.
Windows 10 Solution
Check Java Version in Console (CMD) with java -version
Check in Console (CMD) with where java, which Java Path's are enlisted.
If it you shows you "C:\Windows\System32" in its output, you will have a problem to get to your %JAVA_HOME%, where your wanted Java version resides.
Meaning, you need to get rid of "java.exe" in "C:\Windows\System32".
Just uninstall the JRE in the Software ("Programs and Features")
Hint: Keep in mind, do NOT the JDK, here in my case "Java SE Development Kit 8 Update (64-bit)"), but the JRE.
One way I would try would be to create a write-only empty file with the name java.exe into the System32 folder.

Resources