I have downloaded elastic search on my laptop but whenever I go to bin folder of it and do elasticsearch.bat in Windows, some logs appear but the server don't start or show up on the browser.
Logs are pasted below:
warning: ignoring JAVA_HOME=C:\Program Files\Java\jdk1.8.0_151; using bundled JDK
[2022-09-20T21:53:00,089][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] version[8.4.1], pid[14672], build[zip/2bd229c8e56650b42e40992322a76e7914258f0c/2022-08-26T12:11:43.232597118Z], OS[Windows 10/10.0/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/18.0.2/18.0.2+9-61]
[2022-09-20T21:53:00,099][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] JVM home [G:\elastic stack\elasticsearch-8.4.1\jdk], using bundled JDK [true]
[2022-09-20T21:53:00,100][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=C:\Users\HP\AppData\Local\Temp\elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Xms4053m, -Xmx4053m, -XX:MaxDirectMemorySize=2125463552, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.distribution.type=zip, --module-path=G:\elastic stack\elasticsearch-8.4.1\lib, --add-modules=jdk.net, -Djdk.module.main=org.elasticsearch.server]
[2022-09-20T21:53:13,055][INFO ][c.a.c.i.j.JacksonVersion ] [LAPTOP-8VG1D5TB] Package versions: jackson-annotations=2.13.2, jackson-core=2.13.2, jackson-databind=2.13.2.2, jackson-dataformat-xml=2.13.2, jackson-datatype-jsr310=2.13.2, azure-core=1.27.0, Troubleshooting version conflicts: https://aka.ms/azsdk/java/dependency/troubleshoot
[2022-09-20T21:53:18,911][INFO ][o.e.p.PluginsService ] [LAPTOP-8VG1D5TB] loaded module [x-pack-voting-only-node]
[2022-09-20T21:53:18,912][INFO ][o.e.p.PluginsService ] [LAPTOP-8VG1D5TB] loaded module [x-pack-watcher]
[2022-09-20T21:53:18,913][INFO ][o.e.p.PluginsService ] [LAPTOP-8VG1D5TB] no plugins loaded
[2022-09-20T21:53:29,454][INFO ][o.e.e.NodeEnvironment ] [LAPTOP-8VG1D5TB] using [1] data paths, mounts [[New Volume (G:)]], net usable_space [246.3gb], net total_space [258.4gb], types [NTFS]
[2022-09-20T21:53:29,455][INFO ][o.e.e.NodeEnvironment ] [LAPTOP-8VG1D5TB] heap size [3.9gb], compressed ordinary object pointers [true]
[2022-09-20T21:53:29,737][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] node name [LAPTOP-8VG1D5TB], node ID [cWMr2jqXSdyI_w8NwYQdjw], cluster name [elasticsearch], roles [ingest, data_cold, data, remote_cluster_client, master, data_warm, data_content, transform, data_hot, ml, data_frozen]
[2022-09-20T21:53:41,627][INFO ][o.e.x.s.Security ] [LAPTOP-8VG1D5TB] Security is enabled
[2022-09-20T21:53:42,089][INFO ][o.e.x.s.a.s.FileRolesStore] [LAPTOP-8VG1D5TB] parsed [0] roles from file [G:\elastic stack\elasticsearch-8.4.1\config\roles.yml]
[2022-09-20T21:53:43,195][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [LAPTOP-8VG1D5TB] [controller/744] [Main.cc#123] controller (64 bit): Version 8.4.1 (Build c0373714f3bc4b) Copyright (c) 2022 Elasticsearch BV
[2022-09-20T21:53:44,488][INFO ][o.e.t.n.NettyAllocator ] [LAPTOP-8VG1D5TB] creating NettyAllocator with the following configs: [name=elasticsearch_configured, chunk_size=1mb, suggested_max_allocation_size=1mb, factors={es.unsafe.use_netty_default_chunk_and_page_size=false, g1gc_enabled=true, g1gc_region_size=4mb}]
[2022-09-20T21:53:44,545][INFO ][o.e.i.r.RecoverySettings ] [LAPTOP-8VG1D5TB] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
[2022-09-20T21:53:44,668][INFO ][o.e.d.DiscoveryModule ] [LAPTOP-8VG1D5TB] using discovery type [multi-node] and seed hosts providers [settings]
[2022-09-20T21:53:48,249][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] initialized
[2022-09-20T21:53:48,251][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] starting ...
[2022-09-20T21:53:48,313][INFO ][o.e.x.s.c.f.PersistentCache] [LAPTOP-8VG1D5TB] persistent cache index loaded
[2022-09-20T21:53:48,315][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [LAPTOP-8VG1D5TB] deprecation component started
[2022-09-20T21:53:48,698][INFO ][o.e.t.TransportService ] [LAPTOP-8VG1D5TB] publish_address {127.0.0.1:9300}, bound_addresses {127.0.0.1:9300}, {[::1]:9300}
[2022-09-20T21:53:50,024][WARN ][o.e.c.c.ClusterBootstrapService] [LAPTOP-8VG1D5TB] this node is locked into cluster UUID [jxCXal6sRFuAT73DX5e-0w] but [cluster.initial_master_nodes] is set to [LAPTOP-8VG1D5TB]; remove this setting to avoid possible data loss caused by subsequent cluster bootstrap attempts
[2022-09-20T21:53:50,370][INFO ][o.e.c.s.MasterService ] [LAPTOP-8VG1D5TB] elected-as-master ([1] nodes joined)[_FINISH_ELECTION_, {LAPTOP-8VG1D5TB}{cWMr2jqXSdyI_w8NwYQdjw}{S-HMyyEWTgW7OjvE4XtKJg}{LAPTOP-8VG1D5TB}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw} completing election], term: 2, version: 30, delta: master node changed {previous [], current [{LAPTOP-8VG1D5TB}{cWMr2jqXSdyI_w8NwYQdjw}{S-HMyyEWTgW7OjvE4XtKJg}{LAPTOP-8VG1D5TB}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw}]}
[2022-09-20T21:53:50,574][INFO ][o.e.c.s.ClusterApplierService] [LAPTOP-8VG1D5TB] master node changed {previous [], current [{LAPTOP-8VG1D5TB}{cWMr2jqXSdyI_w8NwYQdjw}{S-HMyyEWTgW7OjvE4XtKJg}{LAPTOP-8VG1D5TB}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw}]}, term: 2, version: 30, reason: Publication{term=2, version=30}
[2022-09-20T21:53:50,667][INFO ][o.e.r.s.FileSettingsService] [LAPTOP-8VG1D5TB] starting file settings watcher ...
[2022-09-20T21:53:50,740][INFO ][o.e.r.s.FileSettingsService] [LAPTOP-8VG1D5TB] file settings service up and running [tid=55]
[2022-09-20T21:53:50,854][INFO ][o.e.h.AbstractHttpServerTransport] [LAPTOP-8VG1D5TB] publish_address {192.168.1.6:9200}, bound_addresses {[::]:9200}
[2022-09-20T21:53:50,857][INFO ][o.e.n.Node ] [LAPTOP-8VG1D5TB] started {LAPTOP-8VG1D5TB}{cWMr2jqXSdyI_w8NwYQdjw}{S-HMyyEWTgW7OjvE4XtKJg}{LAPTOP-8VG1D5TB}{127.0.0.1}{127.0.0.1:9300}{cdfhilmrstw}{xpack.installed=true, ml.allocated_processors=4, ml.max_jvm_size=4253024256, ml.machine_memory=8500776960}
[2022-09-20T21:53:51,059][INFO ][o.e.l.LicenseService ] [LAPTOP-8VG1D5TB] license [b3387b5e-8844-40c0-a4fe-8bb3b74b43d6] mode [basic] - valid
[2022-09-20T21:53:51,062][INFO ][o.e.x.s.a.Realms ] [LAPTOP-8VG1D5TB] license mode is [basic], currently licensed security realms are [reserved/reserved,file/default_file,native/default_native]
[2022-09-20T21:53:51,071][INFO ][o.e.g.GatewayService ] [LAPTOP-8VG1D5TB] recovered [2] indices into cluster_state
[2022-09-20T21:53:51,440][ERROR][o.e.i.g.GeoIpDownloader ] [LAPTOP-8VG1D5TB] exception during geoip databases updateorg.elasticsearch.ElasticsearchException: not all primary shards of [.geoip_databases] index are active
at org.elasticsearch.ingest.geoip#8.4.1/org.elasticsearch.ingest.geoip.GeoIpDownloader.updateDatabases(GeoIpDownloader.java:134)
at org.elasticsearch.ingest.geoip#8.4.1/org.elasticsearch.ingest.geoip.GeoIpDownloader.runDownloader(GeoIpDownloader.java:274)
at org.elasticsearch.ingest.geoip#8.4.1/org.elasticsearch.ingest.geoip.GeoIpDownloaderTaskExecutor.nodeOperation(GeoIpDownloaderTaskExecutor.java:102)
at org.elasticsearch.ingest.geoip#8.4.1/org.elasticsearch.ingest.geoip.GeoIpDownloaderTaskExecutor.nodeOperation(GeoIpDownloaderTaskExecutor.java:48)
at org.elasticsearch.server#8.4.1/org.elasticsearch.persistent.NodePersistentTasksExecutor$1.doRun(NodePersistentTasksExecutor.java:42)
See logs for more details.
[2022-09-20T21:53:52,678][INFO ][o.e.c.r.a.AllocationService] [LAPTOP-8VG1D5TB] current.health="GREEN" message="Cluster health status changed from [RED] to [GREEN] (reason: [shards started [[.security-7][0]]])." previous.health="RED" reason="shards started [[.security-7][0]]"
[2022-09-20T21:53:53,356][INFO ][o.e.i.g.DatabaseNodeService] [LAPTOP-8VG1D5TB] successfully loaded geoip database file [GeoLite2-Country.mmdb]
[2022-09-20T21:53:53,686][INFO ][o.e.i.g.DatabaseNodeService] [LAPTOP-8VG1D5TB] successfully loaded geoip database file [GeoLite2-ASN.mmdb]
[2022-09-20T21:53:59,679][INFO ][o.e.i.g.DatabaseNodeService] [LAPTOP-8VG1D5TB] successfully loaded geoip database file [GeoLite2-City.mmdb]
[2022-09-20T21:56:09,025][WARN ][o.e.x.c.s.t.n.SecurityNetty4Transport] [LAPTOP-8VG1D5TB] received plaintext traffic on an encrypted channel, closing connection Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:63342, profile=default}
Can someone tell where the problem lies and how to resolve this?? I tried with all addresses given in log but everytime got no response on the browswer
Two pictures are attached.
Find the elasticserach.yml configuration file. Change the security authentication, switch from true to false to achieve no-secret login access. Change both of these to false.
Add a new configuration to the file("ingest.geoip.downloader.enabled: false").
Related
I'm trying to implement search-guard-5-5.6.3- in ES 5.6.3 and i have some trouble
while executing
./sgadmin.sh -ts truststore.jks -tspass 90f3cbdb3eabe04f815b -ks CN=sgadmin-keystore.jks -kspass a65d2a4fa62d7ed7a4d5 -cn cluster -h host -p 9200 -nhnv -cd ../sgconfig/
I get
Cannot retrieve cluster state due to: None of the configured nodes are
available: [{#transport#-1}{A1ZqEo4RSsqP3ZRSTXTUOg}{host}{host:9200}]. This is not an error, will keep on trying ...
Root cause: NoNodeAvailableException[None of the configured nodes are available: [{#transport#-1}{A1ZqEo4RSsqP3ZRSTXTUOg}{host}{host:9200}]] (org.elasticsearch.client.transport.NoNodeAvailableException/org.elasticsearch.c lient.transport.NoNodeAvailableException)
* Try running sgadmin.sh with -icl (but no -cl) and -nhnv (If thats works you need to check your clustername as well as hostnames in your SSL certificates)
* Make also sure that your keystore or cert is a client certificate (not a node certificate) and configured properly in elasticsearch.yml
* If this is not working, try running sgadmin.sh with --diagnose and see diagnose trace log file)
* Add --accept-red-cluster to allow sgadmin to operate on a red cluster.
My cluster are correctly started, in ES log it says:
[2017-11-08T15:54:55,354][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] sslTransport protocols [TLSv1.2, TLSv1.1]
[2017-11-08T15:54:55,354][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] sslHTTP protocols [TLSv1.2, TLSv1.1]
[2017-11-08T15:54:55,356][INFO ][o.e.p.PluginsService ] [node_1] loaded module [aggs-matrix-stats]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [ingest-common]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [lang-expression]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [lang-groovy]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [lang-mustache]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [lang-painless]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [parent-join]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [percolator]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [reindex]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [transport-netty3]
[2017-11-08T15:54:55,357][INFO ][o.e.p.PluginsService ] [node_1] loaded module [transport-netty4]
[2017-11-08T15:54:55,363][INFO ][o.e.p.PluginsService ] [node_1] loaded plugin [search-guard-5]
[2017-11-08T15:54:59,119][DEBUG][o.e.a.ActionModule ] Using REST wrapper from plugin com.floragunn.searchguard.SearchGuardPlugin
[2017-11-08T15:54:59,193][INFO ][c.f.s.SearchGuardPlugin ] FLS/DLS valve not bound (noop) due to java.lang.ClassNotFoundException: com.floragunn.searchguard.configuration.DlsFlsValveImpl
[2017-11-08T15:54:59,194][INFO ][c.f.s.SearchGuardPlugin ] Auditlog not available due to java.lang.ClassNotFoundException: com.floragunn.searchguard.auditlog.impl.AuditLogImpl
[2017-11-08T15:54:59,196][INFO ][c.f.s.SearchGuardPlugin ] Privileges interceptor not bound (noop) due to java.lang.ClassNotFoundException: com.floragunn.searchguard.configuration.PrivilegesInterceptorImpl
[2017-11-08T15:54:59,660][INFO ][o.e.d.DiscoveryModule ] [node_1] using discovery type [zen]
[2017-11-08T15:55:00,694][INFO ][o.e.n.Node ] [node_1] initialized
[2017-11-08T15:55:00,695][INFO ][o.e.n.Node ] [node_1] starting ...
[2017-11-08T15:55:01,017][INFO ][o.e.t.TransportService ] [node_1] publish_address {host:9300}, bound_addresses {host:9300}
[2017-11-08T15:55:01,038][INFO ][o.e.b.BootstrapChecks ] [node_1] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2017-11-08T15:55:01,052][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Check if searchguard index exists ...
[2017-11-08T15:55:01,058][DEBUG][o.e.a.a.i.e.i.TransportIndicesExistsAction] [node_1] no known master node, scheduling a retry
[2017-11-08T15:55:04,143][INFO ][o.e.c.s.ClusterService ] [node_1] new_master {node_1}{aN2lbPkJSHWWFTllDhVeNQ}{NYFK1tN7SjC_41uRabKqRw}{mongodb-rec3.ib.fr.cly}{host:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)
[2017-11-08T15:55:04,250][INFO ][c.f.s.h.SearchGuardHttpServerTransport] [node_1] publish_address {host:9200}, bound_addresses {host:9200}
[2017-11-08T15:55:04,251][INFO ][o.e.n.Node ] [node_1] started
[2017-11-08T15:55:04,542][INFO ][o.e.g.GatewayService ] [node_1] recovered [3] indices into cluster_state
[2017-11-08T15:55:05,353][INFO ][o.e.c.r.a.AllocationService] [node_1] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[fs][4]] ...]).
[2017-11-08T15:55:05,465][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Node 'node_1' initialized
But wihle trying to send request http://host:9200 i am getting the following error
[2017-11-08T16:09:10,954][WARN ][c.f.s.h.SearchGuardHttpServerTransport] [node_1] Someone (/host:46422) speaks http plaintext instead of ssl, will close the channel
There are tow different issues here.
First, you try to connect to the HTTP port with sgadmin, but sgadmin uses the transport port. So, instead of:
-p 9200
You need to use the transport port:
-p 9300
You can also omit this setting, since 9300 is the default.
Then, you try to connect to Elasticsearch with http: http://host:9200
But most likely you have HTTPS configured in elasticsearch.yml, that's why the HTTP connection fails, and that's what the error message says:
Someone (/host:46422) speaks http plaintext instead of ssl, will close the channel
So either connect with HTTPS instead of HTTP, or disable HTTPs in elasticsearch.yml (not recommended since insecure):
searchguard.ssl.http.enabled: false
You can also find a troubleshooting article in the docs: http://docs.search-guard.com/latest/troubleshooting-sgadmin
hello all engineering on the world
Im 1 problem to after install ELK stack on docker
my infrastructure:
1- Windows 10 New Creators Update
2- my laptop model: N552VX (8Gig RAM)
3- docker toolbox without prerequisites = sample java machine and more ...
and install sebp/elk on terminal docker with command : $ docker pull sebp/elk
installation successfully and not running --- > An error was pointed out that a number of errors
SEE FULL ERROR == http://textuploader.com/d99r1
Plz check error !
bootstrap checks failed
max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2017-05-12T08:47:16,687][INFO ][o.e.n.Node ] [Zn8_vUw] stopping ...
[2017-05-12T08:47:16,721][INFO ][o.e.n.Node ] [Zn8_vUw] stopped
[2017-05-12T08:47:16,721][INFO ][o.e.n.Node ] [Zn8_vUw] closing ...
[2017-05-12T08:47:16,749][INFO ][o.e.n.Node ] [Zn8_vUw] closed
[2017-05-12T09:36:39,466][INFO ][o.e.n.Node ] [] initializing ...
[2017-05-12T09:36:39,746][INFO ][o.e.e.NodeEnvironment ] [Zn8_vUw] using [1] data paths, mounts [[/var/lib/elasticsearch (c/Users)]], net usable_space [87.9gb], net total_space [118.6gb], spins? [possibly], types [vboxsf]
[2017-05-12T09:36:39,750][INFO ][o.e.e.NodeEnvironment ] [Zn8_vUw] heap size [1.9gb], compressed ordinary object pointers [true]
[2017-05-12T09:36:39,760][INFO ][o.e.n.Node ] node name [Zn8_vUw] derived from node ID [Zn8_vUwXTyGl4E35KOKo5Q]; set [node.name] to override
[2017-05-12T09:36:39,761][INFO ][o.e.n.Node ] version[5.4.0], pid[71], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/4.4.66-boot2docker/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_121/25.121-b13]
[2017-05-12T09:36:42,884][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [aggs-matrix-stats]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [ingest-common]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [lang-expression]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [lang-groovy]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [lang-mustache]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [lang-painless]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [percolator]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [reindex]
[2017-05-12T09:36:42,885][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [transport-netty3]
[2017-05-12T09:36:42,886][INFO ][o.e.p.PluginsService ] [Zn8_vUw] loaded module [transport-netty4]
[2017-05-12T09:36:42,887][INFO ][o.e.p.PluginsService ] [Zn8_vUw] no plugins loaded
[2017-05-12T09:36:50,337][INFO ][o.e.d.DiscoveryModule ] [Zn8_vUw] using discovery type [zen]
[2017-05-12T09:36:52,802][INFO ][o.e.n.Node ] initialized
[2017-05-12T09:36:52,803][INFO ][o.e.n.Node ] [Zn8_vUw] starting ...
[2017-05-12T09:36:53,754][INFO ][o.e.t.TransportService ] [Zn8_vUw] publish_address {172.17.0.2:9300}, bound_addresses {0.0.0.0:9300}
[2017-05-12T09:36:53,792][INFO ][o.e.b.BootstrapChecks ] [Zn8_vUw] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2017-05-12T09:36:53,816][ERROR][o.e.b.Bootstrap ] [Zn8_vUw] node validation exception
bootstrap checks failed
max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2017-05-12T09:36:53,840][INFO ][o.e.n.Node ] [Zn8_vUw] stopping ...
[2017-05-12T09:36:53,932][INFO ][o.e.n.Node ] [Zn8_vUw] stopped
[2017-05-12T09:36:53,932][INFO ][o.e.n.Node ] [Zn8_vUw] closing ...
[2017-05-12T09:36:53,998][INFO ][o.e.n.Node ] [Zn8_vUw] closed
and installing with Guide : http://elk-docker.readthedocs.io/
Will guide me so that I can have a elk stack ?
Try using docker compose
docker-compose.yml
elk:
image: sebp/elk
ports:
- "5601:5601"
- "9200:9200"
- "5044:5044"
environment:
- ELASTICSEARCH_USER=elastic
- ELASTICSEARCH_PASSWORD=s0m3C0mpl3xP#ssw0rd!
- LOGSTASH_USER=elastic
- LOGSTASH_PASSWORD=s0m3C0mpl3xP#ssw0rd!
- KIBANA_USER=kibana
- KIBANA_PASSWORD=s0m3C0mpl3xP#ssw0rd!
$ docker-compose up -d elk
Source : https://medium.com/#gchandra/easy-way-setup-elk-on-docker-10938f3fcf96
As error showing that max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
so you need to increase memory by running below command
vm.max_map_count = 262144
and run it again
ES version 5.2.2 and Discovery GCE 5.2.2
I have a GCE that has an internal and external IP. I installed ES 5.2.2 from source and then installed the Discovery GCE. I changed the network.host to 'gce' and added the project id, zone, etc of the GCE into elasticsearch.yml.
When I tried starting the instance using './bin/elasticsearch', I get the following error.
Bootstrap tests are failing. Also, it has a message as '
Failed to find a usable hardware address from the network interfaces; using random bytes: d7:0c:ef:bf:d0:7b:a6:95'
Any help would be much appreciated.
Also, other generic questions, is it not possible to publish ES at external IP of the GCE? Sorry if this sounds too stupid I'm not a savvy in this area.
[2017-03-11T11:14:56,524][INFO ][o.e.n.Node ] [] initializing ...
[2017-03-11T11:14:56,596][INFO ][o.e.e.NodeEnvironment ] [dQjMwOl] using [1] data paths, mounts [[/ (/dev/sda1)]], net usable_space [9.5gb], net total_space [15.6gb], spins? [possibly], types [ext4]
[2017-03-11T11:14:56,596][INFO ][o.e.e.NodeEnvironment ] [dQjMwOl] heap size [1.9gb], compressed ordinary object pointers [true]
[2017-03-11T11:14:56,603][INFO ][o.e.n.Node ] node name [dQjMwOl] derived from node ID [dQjMwOlrSYy5IxZaBai7WQ]; set [node.name] to override
[2017-03-11T11:14:56,605][INFO ][o.e.n.Node ] version[5.2.2], pid[3989], build[f9d9b74/2017-02-24T17:26:45.835Z], OS[Linux/4.4.21-90-default/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_112/25.112-b15]
[2017-03-11T11:14:57,315][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [aggs-matrix-stats]
[2017-03-11T11:14:57,316][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [ingest-common]
[2017-03-11T11:14:57,316][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [lang-expression]
[2017-03-11T11:14:57,317][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [lang-groovy]
[2017-03-11T11:14:57,317][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [lang-mustache]
[2017-03-11T11:14:57,317][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [lang-painless]
[2017-03-11T11:14:57,317][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [percolator]
[2017-03-11T11:14:57,318][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [reindex]
[2017-03-11T11:14:57,318][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [transport-netty3]
[2017-03-11T11:14:57,318][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded module [transport-netty4]
[2017-03-11T11:14:57,322][INFO ][o.e.p.PluginsService ] [dQjMwOl] loaded plugin [discovery-gce]
[2017-03-11T11:14:59,506][INFO ][o.e.n.Node ] initialized
[2017-03-11T11:14:59,506][INFO ][o.e.n.Node ] [dQjMwOl] starting ...
[2017-03-11T11:14:59,782][WARN ][i.n.u.i.MacAddressUtil ] Failed to find a usable hardware address from the network interfaces; using random bytes: d7:0c:ef:bf:d0:7b:a6:95
[2017-03-11T11:14:59,935][INFO ][o.e.t.TransportService ] [dQjMwOl] publish_address {10.140.0.2:9300}, bound_addresses {10.140.0.2:9300}
[2017-03-11T11:14:59,943][INFO ][o.e.b.BootstrapChecks ] [dQjMwOl] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
ERROR: bootstrap checks failed
max file descriptors [4096] for elasticsearch process is too low, increase to at least [65536]
max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2017-03-11T11:14:59,961][INFO ][o.e.n.Node ] [dQjMwOl] stopping ...
[2017-03-11T11:14:59,975][INFO ][o.e.n.Node ] [dQjMwOl] stopped
[2017-03-11T11:14:59,976][INFO ][o.e.n.Node ] [dQjMwOl] closing ...
[2017-03-11T11:14:59,987][INFO ][o.e.n.Node ] [dQjMwOl] closed
You have to increase the file descriptors as per:
https://www.elastic.co/guide/en/elasticsearch/reference/current/file-descriptors.html
root$ ulimit -n 65536
and the max virtual mem:
https://www.elastic.co/guide/en/elasticsearch/reference/current/vm-max-map-count.html
root$ sysctl vm.max_map_count
vm.max_map_count = 262144
root$ sudo sysctl -w vm.max_map_count=262144
or to make it permanent:
Edit /etc/sysctl.conf, put parameters inside
vm.max_map_count=2621444.
As for the "Failed to find a usable hardware address from the network interfaces", make sure you have api_host setting tied to a transport that is not localhost (127.0.0.1).
elasticsearch version : elasticsearch-5.2.0
elasticsearch-head version : latest version
Start service successfully:
#### node1 ####
deMacBook-Pro:bin yyq$ ./elasticsearch
[2017-02-15T13:08:57,174][INFO ][o.e.n.Node ] [yml-es-node-1] initializing ...
[2017-02-15T13:08:57,303][INFO ][o.e.e.NodeEnvironment ] [yml-es-node-1] using [1] data paths, mounts [[/ (/dev/disk1)]], net usable_space [21.4gb], net total_space [232.6gb], spins? [unknown], types [hfs]
[2017-02-15T13:08:57,304][INFO ][o.e.e.NodeEnvironment ] [yml-es-node-1] heap size [1.9gb], compressed ordinary object pointers [true]
[2017-02-15T13:08:57,355][INFO ][o.e.n.Node ] [yml-es-node-1] node name [yml-es-node-1], node ID [hqVAcDOdRu-LXuAgUEX9oQ]
[2017-02-15T13:08:57,358][INFO ][o.e.n.Node ] [yml-es-node-1] version[5.2.0], pid[93922], build[24e05b9/2017-01-24T19:52:35.800Z], OS[Mac OS X/10.11.6/x86_64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_25/25.25-b02]
[2017-02-15T13:08:58,802][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [aggs-matrix-stats]
[2017-02-15T13:08:58,803][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [ingest-common]
[2017-02-15T13:08:58,803][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [lang-expression]
[2017-02-15T13:08:58,803][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [lang-groovy]
[2017-02-15T13:08:58,803][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [lang-mustache]
[2017-02-15T13:08:58,803][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [lang-painless]
[2017-02-15T13:08:58,803][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [percolator]
[2017-02-15T13:08:58,804][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [reindex]
[2017-02-15T13:08:58,804][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [transport-netty3]
[2017-02-15T13:08:58,804][INFO ][o.e.p.PluginsService ] [yml-es-node-1] loaded module [transport-netty4]
[2017-02-15T13:08:58,805][INFO ][o.e.p.PluginsService ] [yml-es-node-1] no plugins loaded
[2017-02-15T13:09:02,610][INFO ][o.e.n.Node ] [yml-es-node-1] initialized
[2017-02-15T13:09:02,610][INFO ][o.e.n.Node ] [yml-es-node-1] starting ...
[2017-02-15T13:09:02,953][INFO ][o.e.t.TransportService ] [yml-es-node-1] publish_address {127.0.0.1:9300}, bound_addresses {[fe80::1]:9300}, {[::1]:9300}, {127.0.0.1:9300}
[2017-02-15T13:09:06,125][INFO ][o.e.c.s.ClusterService ] [yml-es-node-1] detected_master {yml-es-node-2}{FWhiCkI7TV6hJOlmT_fgQg}{URIaxsK2T0aP7jRRe6TDfg}{127.0.0.1}{127.0.0.1:9301}, added {{yml-es-node-2}{FWhiCkI7TV6hJOlmT_fgQg}{URIaxsK2T0aP7jRRe6TDfg}{127.0.0.1}{127.0.0.1:9301},}, reason: zen-disco-receive(from master [master {yml-es-node-2}{FWhiCkI7TV6hJOlmT_fgQg}{URIaxsK2T0aP7jRRe6TDfg}{127.0.0.1}{127.0.0.1:9301} committed version [385]])
[2017-02-15T13:09:06,175][INFO ][o.e.h.HttpServer ] [yml-es-node-1] publish_address {127.0.0.1:9200}, bound_addresses {[fe80::1]:9200}, {[::1]:9200}, {127.0.0.1:9200}
[2017-02-15T13:09:06,175][INFO ][o.e.n.Node ] [yml-es-node-1] started
#### node2 ####
deMacBook-Pro:bin yyq$ ./elasticsearch
[2017-02-15T10:31:03,936][INFO ][o.e.n.Node ] [yml-es-node-2] initializing ...
[2017-02-15T10:31:04,087][INFO ][o.e.e.NodeEnvironment ] [yml-es-node-2] using [1] data paths, mounts [[/ (/dev/disk1)]], net usable_space [19.3gb], net total_space [232.6gb], spins? [unknown], types [hfs]
[2017-02-15T10:31:04,087][INFO ][o.e.e.NodeEnvironment ] [yml-es-node-2] heap size [1.9gb], compressed ordinary object pointers [true]
[2017-02-15T10:31:04,104][INFO ][o.e.n.Node ] [yml-es-node-2] node name [yml-es-node-2], node ID [FWhiCkI7TV6hJOlmT_fgQg]
[2017-02-15T10:31:04,112][INFO ][o.e.n.Node ] [yml-es-node-2] version[5.2.0], pid[85158], build[24e05b9/2017-01-24T19:52:35.800Z], OS[Mac OS X/10.11.6/x86_64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_25/25.25-b02]
[2017-02-15T10:31:05,830][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [aggs-matrix-stats]
[2017-02-15T10:31:05,830][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [ingest-common]
[2017-02-15T10:31:05,830][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [lang-expression]
[2017-02-15T10:31:05,830][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [lang-groovy]
[2017-02-15T10:31:05,830][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [lang-mustache]
[2017-02-15T10:31:05,830][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [lang-painless]
[2017-02-15T10:31:05,831][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [percolator]
[2017-02-15T10:31:05,831][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [reindex]
[2017-02-15T10:31:05,831][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [transport-netty3]
[2017-02-15T10:31:05,831][INFO ][o.e.p.PluginsService ] [yml-es-node-2] loaded module [transport-netty4]
[2017-02-15T10:31:05,832][INFO ][o.e.p.PluginsService ] [yml-es-node-2] no plugins loaded
[2017-02-15T10:31:09,871][INFO ][o.e.n.Node ] [yml-es-node-2] initialized
[2017-02-15T10:31:09,871][INFO ][o.e.n.Node ] [yml-es-node-2] starting ...
[2017-02-15T10:31:10,171][INFO ][o.e.t.TransportService ] [yml-es-node-2] publish_address {127.0.0.1:9301}, bound_addresses {[fe80::1]:9301}, {[::1]:9301}, {127.0.0.1:9301}
[2017-02-15T10:31:13,327][INFO ][o.e.c.s.ClusterService ] [yml-es-node-2] detected_master {yml-es-node-1}{hqVAcDOdRu-LXuAgUEX9oQ}{VrY6MUvhQNetUmbzcRnKMg}{127.0.0.1}{127.0.0.1:9300}, added {{yml-es-node-1}{hqVAcDOdRu-LXuAgUEX9oQ}{VrY6MUvhQNetUmbzcRnKMg}{127.0.0.1}{127.0.0.1:9300},}, reason: zen-disco-receive(from master [master {yml-es-node-1}{hqVAcDOdRu-LXuAgUEX9oQ}{VrY6MUvhQNetUmbzcRnKMg}{127.0.0.1}{127.0.0.1:9300} committed version [223]])
[2017-02-15T10:31:13,388][INFO ][o.e.h.HttpServer ] [yml-es-node-2] publish_address {127.0.0.1:9201}, bound_addresses {[fe80::1]:9201}, {[::1]:9201}, {127.0.0.1:9201}
[2017-02-15T10:31:13,388][INFO ][o.e.n.Node ] [yml-es-node-2] started
deMacBook-Pro:elasticsearch-head-master yyq$ grunt server
Running "connect:server" (connect) task
Waiting forever...
Started connect web server on http://localhost:9100
When I opened the url:http://localhost:9100 and clicked [connect] button, but I'm unable to connect to elasticsearch.
Could anyone help me?
This is the screenshot
In your elasticsearch.yml configuration, you probably have the following setting:
http.port: 9201
This is also visible in your logs:
[...] publish_address {127.0.0.1:9201}, bound_addresses {[fe80::1]:9201}, {[::1]:9201}, {127.0.0.1:9201}
^
|
your HTTP port
So in your elasticsearch-head interface, you need to connect to localhost:9201 not localhost:9200.
UPDATE
You also need to add http.cors.enabled: true in your elasticsearch.yml configuration and restart your ES server
As mentioned in the previous post, to be able to run the head plugin to check the health status of the ElastiSearch cluster, you need to enable the CORS's environmental variables. One way is to mount the config file for ES as described here. Alternatively, you can define the environmental variables directly in your docker-compose as documented in this GitHub issue. I am adding the code below for completeness, which worked for me:
version: '3'
services:
# search engine
elasticsearch:
image: docker.elastic.co/elasticsearch/elasticsearch-oss:7.0.1
container_name: elasticsearch
environment:
- discovery.type=single-node
- http.port=9200
- http.cors.enabled=true
- http.cors.allow-origin=http://localhost:1358,http://127.0.0.1:1358
- http.cors.allow-headers=X-Requested-With,X-Auth-Token,Content-Type,Content-Length,Authorization
- http.cors.allow-credentials=true
- bootstrap.memory_lock=true
- 'ES_JAVA_OPTS=-Xms512m -Xmx512m'
ports:
- '9200:9200'
- '9300:9300'
# elasticsearch browser
dejavu:
image: appbaseio/dejavu:3.2.3
container_name: dejavu
ports:
- '1358:1358'
links:
- elasticsearch
Note that using - http.cors.allow-origin=* works and it could be handy for certain development setups.
I run:
$ docker run --rm -ti -p 9200:9200 -p 9300:9300 elasticsearch
But I can't start elasticsearch 5.0, here the log:
Unable to find image 'elasticsearch:latest' locally
latest: Pulling from library/elasticsearch
43c265008fae: Already exists
af36d2c7a148: Already exists
2b7b4d10e1c1: Already exists
9f7579daddb2: Already exists
a985511f2468: Already exists
6c2b485fcc3e: Already exists
00b73c83b440: Already exists
a38975861823: Pull complete
b9d0b4aaf934: Pull complete
f5f25bb3de04: Pull complete
93426e1e8953: Pull complete
590c2ab9b639: Pull complete
31bf48850601: Pull complete
21aad7ce70fa: Pull complete
Digest: sha256:29205bca045c8d083f777dfc453f4f1ff3d2c08ea4f529f88795166c58e5607e
Status: Downloaded newer image for elasticsearch:latest
[2016-10-31T20:56:22,023][INFO ][o.e.n.Node ] [] initializing ...
[2016-10-31T20:56:22,129][INFO ][o.e.e.NodeEnvironment ] [N-vpIo0] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda8)]], net usable_space [48.7gb], net total_space [98.3gb], spins? [possibly], types [ext4]
[2016-10-31T20:56:22,130][INFO ][o.e.e.NodeEnvironment ] [N-vpIo0] heap size [1.9gb], compressed ordinary object pointers [true]
[2016-10-31T20:56:22,130][INFO ][o.e.n.Node ] [N-vpIo0] node name [N-vpIo0] derived from node ID; set [node.name] to override
[2016-10-31T20:56:22,132][INFO ][o.e.n.Node ] [N-vpIo0] version[5.0.0], pid[1], build[253032b/2016-10-26T05:11:34.737Z], OS[Linux/3.16.0-4-amd64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_102/25.102-b14]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [aggs-matrix-stats]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [ingest-common]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [lang-expression]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [lang-groovy]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [lang-mustache]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [lang-painless]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [percolator]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [reindex]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [transport-netty3]
[2016-10-31T20:56:22,785][INFO ][o.e.p.PluginsService ] [N-vpIo0] loaded module [transport-netty4]
[2016-10-31T20:56:22,786][INFO ][o.e.p.PluginsService ] [N-vpIo0] no plugins loaded
[2016-10-31T20:56:22,875][WARN ][o.e.d.s.g.GroovyScriptEngineService] [groovy] scripts are deprecated, use [painless] scripts instead
[2016-10-31T20:56:24,241][INFO ][o.e.n.Node ] [N-vpIo0] initialized
[2016-10-31T20:56:24,241][INFO ][o.e.n.Node ] [N-vpIo0] starting ...
[2016-10-31T20:56:24,380][INFO ][o.e.t.TransportService ] [N-vpIo0] publish_address {172.17.0.4:9300}, bound_addresses {[::]:9300}
[2016-10-31T20:56:24,389][INFO ][o.e.b.BootstrapCheck ] [N-vpIo0] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
ERROR: bootstrap checks failed
max virtual memory areas vm.max_map_count [65530] likely too low, increase to at least [262144]
[2016-10-31T20:56:24,400][INFO ][o.e.n.Node ] [N-vpIo0] stopping ...
[2016-10-31T20:56:24,426][INFO ][o.e.n.Node ] [N-vpIo0] stopped
[2016-10-31T20:56:24,426][INFO ][o.e.n.Node ] [N-vpIo0] closing ...
[2016-10-31T20:56:24,433][INFO ][o.e.n.Node ] [N-vpIo0] closed
Please, How can I solve this issue?
As said at the Docker image documentation in Host Setup section:
Note: since 5.0, Elasticsearch only listens on localhost by default,
so this image sets network.host to 0.0.0.0 (given that localhost is
not terribly useful in the Docker context).
As a result, Elasticsearch is more strict about the bootstrap checks
that it performs, especially when checking the value of
vm.max_map_count which is not namespaced and thus must be set to an
acceptable value on the host (as opposed to simply using --sysctl on
docker run).
So you just have to execute this on the host machine:
sysctl -w vm.max_map_count=262144
And you are good to go with the 5.0.0 version
To set this value permanently, update the vm.max_map_count setting in /etc/sysctl.conf. To verify after rebooting, run sysctl vm.max_map_count.
More information here
This is a problem related with virtual memory settings, the following command should works:
sysctl -w vm.max_map_count=262144
More details can be found here https://www.elastic.co/guide/en/elasticsearch/reference/5.0/vm-max-map-count.html