elastic search will not start - macos

I am running mac osx. I installed elasticsearch with "pip install elasticsearch". I cannot start the elasticsearch server. None of the start commands I tried work. For example, "bin/elasticsearch -f" resulted in "No such file or directory". Please help.

What is the version of elasticsearch you are using and from where you have downloaded it?
On my Mac OS I have downloaded the zip file from elasticsearch download website.
Unzipped it on my machine.
and Started the ES using "./bin/elasticsearch -f" command.
Check that you have permission on this files in bin directory.

I solved the problem. Basically using "pip install elasticsearch" only allows you to use elasticsearch directly in python (my theory). So I installed elasticsearch a different way and it worked!
Procedure:
a) brew install elasticsearch
b) elasticsearch -f -D es.config=/usr/local/opt/elasticsearch/config/elasticsearch.yml

For mac if installed using homebrew
Navigates to /usr/local/Cellar/elasticsearch/6.7.0(your version)/libexec/config/elasticsearch.yml
and from below mentioned block
Use a descriptive name for your cluster:
change cluster name as show below
cluster.name: elasticsearch_your_system_name >>> cluster.name:elaticsearch

Related

Aws elastic beanstalk cli setup on Mac

I am trying to install aws elastic beanstalk cli on my mac machine. In the prerequisites it says that Python requires following:
Xcode openssl zlib readline
But, on running the command, I get:
-bash: Xcode: command not found
How am I suppose to install this?
An alternative solution is to run the aws cli inside a docker container. It will eliminate the possible issues which may be caused by the OS/library upgrading in the future.

ElasticSearch - uninstall version 6.4.3, install version 6.4.2 - Linux Ubuntu

We have a 3-node cluster with ElasticSearch 6.4.3 on Ubuntu 16.04. There is nothing existing outside of the fresh install of ES - no indexes, no Kibana, no Beats, no Logstash, etc.
I have been asked to downgrade to version 6.4.2. I have limited Linux experience, but enough to be able to run command line commands and understand the output. Google has lead me to bits and pieces around accomplishing this, but I'd feel a lot less anxiety around it if someone with ES experience may be able to point me to something that's a bit more step-by-step.
I do have this link to download 6.4.2, but one of the things I need to know is which file to download: https://www.elastic.co/downloads/past-releases/elasticsearch-6-4-2
Sure here you go with step by step guide, As I did this for you, using your version.
Using this link https://www.elastic.co/downloads/past-releases/elasticsearch-6-4-2, which you mentioned, download the tar file to your local system.
Use SCP to transfer the .tar file to your ubuntu instance, I used my AWS ubuntu instance.
scp -i ~/your-identity-file ~/Desktop/elasticsearch-6.4.2.tar.gz
ubuntu#aws-ec2-instance-ip:/home/ubuntu
Untar file using tar -xvf elasticsearch-6.4.2.tar.gz command.
Go to config folder like cd elasticsearch-6.4.2/config/ and set the proper values in elasticsearch.config.
Start the elasticsearch from bin folder ./elastic command.
Update:- Based on the chat with OP, Adding official ES link https://www.elastic.co/guide/en/elasticsearch/reference/current/targz.html and https://www.elastic.co/guide/en/elasticsearch/reference/current/install-elasticsearch.html for detailed instruction.

Setting up Kibana on Ubuntu 17.10

I have a lot of log files from JBoss Fuse that I want to visualize in Kibana.
I've installed Elasticsearch and Kibana.
I have also installed the plugin ingest-geoip (bin/elasticsearch-plugin install ingest-geoip).
Now I am trying to install Filebeat.
I've done this OK:
curl -L -O https://artifacts.elastic.co/downloads/beats/filebeat/filebeat-6.2.2-darwin-x86_64.tar.gz
tar xzvf filebeat-6.2.2-darwin-x86_64.tar.gz
cd filebeat-6.2.2-darwin-x86_64/
But when I want to run it I get the following:
sindre#selite:/usr/lib/filebeat$ ./filebeat modules enable system
bash: ./filebeat: cannot execute binary file: Exec format error
NB! This is my first time using Kibana. Please point me in the right direction if I am using it wrong. As I wrote earlier I want to use it for Jboss Fuse Log files.
filebeat-6.2.2-darwin-x86_64
There's your clue. darwin is the name given to the core OS-X unix distribution
https://en.wikipedia.org/wiki/Darwin_(operating_system)
It is extremely unlikely that a compiled darwin binary would be compatible with a linux system.
You really want to be looking at the Linx X86 64 package
If you have running instance of Kibana on your system, you can easily configure it for any underlying operating system(Linux/macOS) with a few provided commands:
visit: Home>>Add data>>System logs
current_url_for_demo: http://localhost:5601/app/kibana#/home/tutorial/systemLogs?_g=()
Visual Explanation:

Issues with manual installation of predictionIO dependencies

I am installing predictionIO from source code. I have downloaded and done the predictionIO installation successfully. I am now trying to install the dependencies (Spark, Elasticsearch, HBase) but I am running into errors for each of them. Below are the issues I am facing when I execute pio status:
1 - Unable to locate a proper Apache Spark installation
2 - It is also unable to find metadata files.
I have not changed any default settings. I'm using windows 8.1. On localhost, I have running IIS. On 127.0.0.1:8888 I run ipython notebook.
Please help on how I can get predictionIO up and running on my machine.
Thanks
If you are on Windows, you can install with Vagrant.
http://docs.prediction.io/community/projects/#vagrant-installation-for-predictionio
I believe the discussion has moved to the google group.
https://groups.google.com/forum/#!searchin/predictionio-user/SAS/predictionio-user/ZamBr1ZaQ3o/fyNkXh3zsv0J
https://groups.google.com/forum/#!searchin/predictionio-user/SAS/predictionio-user/0awaASUR8lE/JkLtPeRrNt4J
This is the relevant thread.
https://groups.google.com/forum/#!searchin/predictionio-user/SAS/predictionio-user/0awaASUR8lE/JkLtPeRrNt4J
Moreover, PredictionIO docs had a few errors. Below are some of them and their corrected versions.
1 - Actual line: PATH=$PATH:/home/yourname/predictionio/bin; export PATH
Corrected Version PATH=$PATH:/home/yourname/PredictionIO/bin; export PATH
2 - Actual Line: $ pio eventserver
Corrected Version: $ pio eventserver --ip 0.0.0.0
3 - Actual Line pio template get PredictionIO/templates-scala-parallel-recommendation MyRecommendation
Corrected Version pio template get PredictionIO/template-scala-parallel-recommendation MyRecommendation

Setting Up Kibana on Mac OS X Mavericks

I am trying to learn about the ELK stack (ElasticSearch, Logstash and Kibana). In an effort to get started, I've been running through the "Getting Started" guide found at http://logstash.net/docs/1.4.0/tutorials/getting-started-with-logstash. I've been following these steps on a Mac OS X Mavericks installation. I did do one thing different, though.
After downloading the Logstash and Elasticsearch tarballs, I copied their contents into the following locations:
Logstash: /Applications/dev/logstash/1.4.0/
Elasticsearch: /Applications/dev/Elasticsearch/1.1.0
I then start Elasticsearch using the following command from a terminal:
sudo /Applications/dev/Elasticsearch/1.1.0/bin/elasticsearch
I then start a new terminal window. In that new terminal window, I start Logstash using the following command:
sudo /Applications/dev/logstash/1.4.0/bin/logstash -e 'input { stdin { } } output { elasticsearch { host => localhost } } '
Logstash appears to start just fine. If I enter 'you know, for logs' as mentioned in the getting started guide, I can see the results using POSTMAN. However, I'm stuck on Kibana.
I've downloaded Kibana using the following command:
git clone https://github.com/elasticsearch/kibana.git kibana
I've placed the downloaded files into /Applications/dev/kibana/3.0.0. I'm now stuck on how to actually bring Kibana up in a web browser. I know that somehow I need to serve these files. I see server stuff in this sample. However, I'm not sure if
There is a recommended web server for Kibana
How to setup a a web site on a Mac OS X machine. If I were on Windows, I'd just use IIS and point it at my directory. I'm sure there's something similar on Mac OS X. However, I'm not sure what that is.
Thank you!
While downloading the packages is perfectly fine, your install can be much easier on OS X if you use homebrew. (http://brew.sh)
Simply run:
brew install elasticsearch
brew install logstash
And if you are missing the proper Java JDK or JRE files, homebrew will tell you where to get them from.
If you are running the OS X Server App (see App Store) and have websites service enabled you can also simply drop the Kibana files into the default website directory:
/Library/Server/Web/Data/Sites/Default/
or a subdirectory like:
/Library/Server/Web/Data/Sites/Default/kibana
Hope this helps!
Kibana 3
Kibana is a html/Js website. So, you only need to prepare a web server for it! For example, an apache server. Mavericks has already install apache server. After you start apache server, put the kibana folder to the apache document root. Then you can visit Kibana by
http://localhost/kibana
Remember to config the the elasticsearch server in config.js.
Update:
Kibana 4 has buildin web server. After you start your Kibana, you can directly visit your page at : http://localhost:5601
I updated to the latest Java Version by downloading JDK Here: http://www.oracle.com/technetwork/java/javase/downloads/index.html
Once Java is installed, I installed via brew:
brew install elasticsearch
brew install logstash
Download the Kibana binary here for mac: http://www.elastic.co/downloads/kibana
Extract and run the bin/kibana executable and point your browser to localhost:5601
No need to download any third party servers.
Cheers!
UPDATE: Instead of step 3) & 4) You can also install kibana via brew: brew install kibana

Resources