Elasticsearch getting data repeatedly - elasticsearch

I search data from MYSQL with elasticsearch but when I restart the elasticsearch, Then search result comes duplicate. What should I do? Can anybody help?

Related

Elasticsearch queries in kibana

I want to log all the queries made to Elasticsearch along with their response bodies in kibana.
Is there a way to do that?
I came to know a way to set. t he slowlogs threshold to 0 and log all the queries i slowlogs and then use filebeat to push those queries to kibana.
Is there any other way to do that
As far as I know, this is not available atleast in basic and free version and even if you set search slowlog threshold to 0ms it will just log the search query and other metadata of search query but wouldn't log the search query response.
It would be better to do this in your application which generated the search query and parse the response, then using filebeat you can send the application logs to Elasticsearch.

Index existing documents on startup

I'm new to elasticsearch and this is a question I've been trying to find an answer to. Basically I have around a thousand documents that I would like elasticsearch to index for me. Do I have to write a bash/python script that would just use CURL to put/post all these documents in my elasticsearch server or can I configure my server so that it would automatically index documents in a specific folder/location on disk when I start it up for the first time?
I far as I know Elasticsearch does not have any option for pulling document to index itself. As you mentioned you need to create a script and push your documents to ES yourself.

Which fields are in my ElasticSearch index?

I ran a conversion program, catmandu, and sent the results to elasticsearch. I'm new to elasticsearch. Do you know how I could find something similar to '.schema' for sqlite3 in elasticsearch? I'd like to know what fields are in there.
After searching around this morning I was unable to find something that would tell me the fields if I did not know them ahead of time.
Thank you for your help.
You use the mapping API to get current mapping for an index. This will show you all of the fields that have been indexed:
curl -XGET "http://localhost:9200/{yourIndex}/_mapping"

Elasticsearch search does not return exact results

I was trying to run elasticsearch on couchdb using river plugin. Unfortunately, the number of hits i have got is the same with the total of actual documents. Say that i have 10000 documents in my couch database, however, it only returns 9340 hits in elasticsearch. Anyone knows why this problem arise? Would you mind to explain it to me please?
Regards,
Jemie Effendy
Look into the bool query. This will return results that MUST have what you've defined in your query. Also look into your mapping, Elasticsearch may be tokenising your data in a way in which you don't expect.

Kibana search with numbers is not fetching data from elastic search

When I search with numbers in Kibana to get the data from elastic search, I am not getting any results.
I have below message stored in elastic search. If I search with 5723243287337 or 234234535, I do not get any results. But if I search with PHOENIX or any other text, I am getting results from elastic search.
13-04-13,ST,FRTTH-01,Rialto,CA,PHOENIX,AZ,85053,2.32,6.22,5723243287337,234234535,SO,1
Is there any known bug or am I missing any configuration. Appreciate any help. Thanks.
When indexing CSV data, it is better to define mappings for each of the fields. Otherwise, ES would try to guess the data type, and then do the indexing, leading to unexpected results. See here for explicit mappings.
Try to add quatation. Elastic search will treat "number" as a string, like other text.

Resources