Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
I have been testing out the most recent Cloudera CDH4 hadoop-conf-pseudo (i.e. MRv2 or YARN) on a notebook, which has 4 cores, 8GB RAM, and an Intel X25MG2 SSD. The OS is Ubuntu 12.04LTS 64bit. So far so good.
Looking at Setting up hadoop to use S3 as a replacement for HDFS, I would like to do it on my notebook - on this notebook, there is a S3 emulator that my colleagues and I implemented.
Nevertheless, I can't find where I can set the jets3t.properties to change the end point to localhost. I downloaded the hadoop-2.0.1-alpha.tar.gz and searched the source without finding out a clue. There is a similar Q on SO Using s3 as fs.default.name or HDFS?, but I want to use our own lightweight and fast S3 emulation layer, instead of AWS S3, for our experiments.
I would appreciate a hint as to how I can change the end point to a different hostname.
Regards,
--Zack
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 2 years ago.
Improve this question
What is the best way to copy files from one computer to another using ZFS or checksumming?
I have a FreeNAS server with ZFS and a Mac with Mojave and ZFS.
I want to copy a large (4 TB) Time Machine sparsebundle from the server to the ZVOL on the Mac over the network.
I wonder if there is a ZFS-enhanced way to do this, which perhaps includes metadata or checksums.
Apparently ZFS only includes options for copying (send/receive) complete filesystems or volumes, not individual files.
I found the command
cp -z
on an Oracle online manual, but this apparently does not work in the macOS terminal.
Any idea?
There is no way to leverage ZFS for this using any of it's features other than send/receive. Unless you are transferring an whole fs or volume snapshot (full or incremental), ZFS can't help you.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
I have used spark on my local machine using python for analytical puproses.
Recently I've heard the words "spark cluster" and I was wondering what it is exactly?
Is it just Spark running on some cluster of machines ?
And how can it be used on cluster without Hadoop system? Is it possible? Can you please describe?
Apache spark is a distributed computing system. While it can run on a single machine, it is meant to run on a cluster and to take advantage of parallelism possible utilizing the cluster. Spark utilizes much of the Hadoop stack, such as the HDFS file system. However, Spark overlaps considerably with Hadoop distributed computing chain. Hadoop centers around the map reduce programming pattern, while Spark is more general with regard to program design. Also, Spark has features to help increase performance.
For more information, see https://www.xplenty.com/blog/2014/11/apache-spark-vs-hadoop-mapreduce/
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 5 years ago.
Improve this question
I want to start working with Teradata database and for that I need to setup it on my system. After searching a lot I didn't find any setup which I can use to install it on windows machine. The only link I found was http://www.teradata.com/teradata-express-13-0-windows/ this one but there is no download link on this page. I have also found the VMware version to use Teradata on 64-bit windows on this link http://downloads.teradata.com/download/database/teradata-express/vmware but I am not sure how to install this using VMware after downloading the setup.
Please provide some help for installing Teradata on 32 windows or 64 windows using VmWare.
Have you read this article on Teradata's Developer Exchange? It should cover the basics of getting the VMware environment up and running.
http://developer.teradata.com/database/articles/introduction-to-teradata-express-for-vmware-player
You may wish to change the runlevel of SLES to boot to the command line instead of the Gnome desktop to reduce the memory footprint of the VM. You will want to dedicate 4GB of RAM to the VM as well.
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
I have to setup a cluster, on my computer using 5 virtual machines with hadoop. The configuration requires a port number. Can someone enlighten me on this.I am a beginner in it
If your primary objective is to learn Hadoop then it does not matter you learn it on Windows or Linux, because everything is exactly same on both platforms. I have extensively used Hadoop on both platform and found all the commands and processing are identical on Windows and Linux. So here are my suggestions:
Download VMware VMPlayer on your Windows/Linux Machine
Download CDH Virtual Machine for VMware
https://ccp.cloudera.com/display/SUPPORT/Downloads
Access virtual machine in your Windows/Linux box and follow the tutorials exactly they are on Linux.
Same info is shared here:
Hadoop on Windows
Its upto you to choose the port. Normally people use the default ports provided by hadoop. For the default ports, see this. There will be absolutely no harm if you use those ports (unless you have something else running on any of those ports).
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 11 years ago.
Improve this question
How can I launch the entire Windows operating system inside Ubuntu. Something similar to Parralel Desktops. Free, please.
The keyword you're looking for is virtualization. There are MANY tools for hosting virtual machines. Ububtu has information specific to it, so you might start there. Other common options are virtual box, vmware, and xen, among many others. All of these have free options.
I'm doing the opposite (an entire Ubuntu box inside of Windows) via http://www.virtualbox.org/
The same thing will work for your case (Windows inside Ubuntu).