Elasticsearch monitoring settings - elasticsearch

In the monitoring tab of Kibana it is mentioned that Monitoring is currently off
We need to enable xpack.monitoring.collection.enabled setting somewhere.
Where do we need to edit this setting?
I know we can click on this button and enable it automatically but I want to know in which file does it enable this setting.
I have checked kibana.yml, elasticsearch.yml and advanced settings in kibana and i could not find anything related to this.

Here is the Link to the documentation: https://www.elastic.co/guide/en/kibana/current/monitoring-settings-kb.html
xpack.monitoring.collection.enabled is set in your kibana.yml
But there is a ton of other settings. The config file depends on the specific setting.

Related

ElasticSearch 8: is there a "conf.d" folder to change settings without editing elasticsearch.yml?

I'd like to edit a few ElasticSearch 8 settings (for example: network.host), but I don't want to edit /etc/elasticsearch/elasticsearch.yml directly. What I'd like to do is to add my settings to my own file and put it in an hypothetical /etc/elasticsearch/conf.d folder, do be included automatically.
This approach is widespread with multiple other software I use (Nginx, Apache, MySQL, PHP just to name a few).
ElasticSearch already does what i need with /etc/elasticsearch/jvm.options.d, but that folder is just for the the JVM options, not for ES own settings.
What am I missing here?
You can override the config path via env variables:
ES_PATH_CONF=/path/to/my/config ./bin/elasticsearch
https://www.elastic.co/guide/en/elasticsearch/reference/current/settings.html
There is an old discussion about doing what you are asking about but didn't make it this way:
https://github.com/elastic/elasticsearch/issues/11362

Elastic, Is there a way to see live configuration after changing setting?

I change some settings to elastic-apm.
https://www.elastic.co/guide/en/apm/server/current/configuration-process.html
I want to verify if the setting is actually changed. but not sure how to check ..
Is there an endpoint where I can view the current configuration?
The only way to get configuration is to check apm-server.yml in your instance, but if you want to check your agent configuration you can use Agent Configuration API, for more information check https://www.elastic.co/guide/en/apm/server/current/agent-configuration-api.html.

Secure built-in user credentials for Kibana/ElasticSearch

Setup
ElasticSearch v6.8
Context
I'm trying to build a couple of AMI's for ElasticSearch and Kibana using Packer.
I've been reading the official docs and have run into something confusing (for me at least)
I'm setting up the built-in users in ElasticSearch according to this doc. I'm using the auto option as opposed to interactive
bin/elasticsearch-setup-passwords auto
Once this is done I need to modify the kibana.yml file to use the built-in user whilst communicating with ElasticSearch. This doc describes what to do. Essentially you add these two lines:
elasticsearch.username: "kibana"
elasticsearch.password: "kibanapassword"
Questions
How can I automatically read the password output for the built in Kibana user (bin/elasticsearch-setup-passwords auto) so that I can add it to the kibana.yml file?
Is storing the password in plain text in the 'kibana.yml' file secure? I fear it is not... but is there an alternative?
Thanks
For elasticsearch-setup-passwords rather than using auto, look into --batch, so you can define the password and then use that for Kibana.
You probably want to use a keystore for Kibana.

IntelliJ disable usage statistics / data sharing via configuration file

The Option to disable data sharing can be changed at any time by the user:
I want to disable this setting by default for a managed installation of IntelliJ IDEA, ideally via configuration file or registry setting.
How can I do this? I could not find any registry setting or configuration setting so far.
This option is already disabled by default.
The state of the option is stored in the /consentOptions/accepted file under the data directory which is platform specific.
On Windows that would be C:\Users\<user>\AppData\Roaming\JetBrains\consentOptions\accepted.
When the option is enabled, the file will contain something like this:
thrd.plugins:1.0:0:1525589497351;rsch.send.usage.stat:1.1:1:1551998109388
and the following with the option disabled:
thrd.plugins:1.0:0:1525589497351;rsch.send.usage.stat:1.1:0:1551998064076
The format is as follows:
rsch.send.usage.stat:<version>:<enabled>:<timestamp>
You can learn more from the ConsentOptions.java source code.

How to use cloudera management (ui) console to edit hadoop-metrics.properties?

I am trying to monitor Hbase using Ganglia. How to use cloudera management console to edit dfs.server property in the hadoop-metrics.properties?
According to
http://wiki.apache.org/hadoop/GangliaMetrics I need to change:
dfs.servers=#GANGLIA#:8649
But I am not able to see the option to modify dfs.server value on the management console of cloudera.
How should I proceed?
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
hbase.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
ugi.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
dfs.period=10
mapred.period=10
hbase.period=10
jvm.period=10
rpc.period=10
ugi.period=10
dfs.fileName=/tmp/metrics/dfs.log
mapred.fileName=/tmp/metrics/dfs.log
hbase.fileName=/tmp/metrics/hbase.log
jvm.fileName=/tmp/metrics/jvm.log
rpc.fileName=/tmp/metrics/rpc.log
ugi.fileName=/tmp/metrics/ugi.lo
I don't think the Cloudera management console has ability to edit hadoop-metrics.properties configuration through UI instead, you just need to edit this configuration manually. In Hadoop hadoop-metrics.properties configuration settings contains settings for the metrics contexts "dfs", "mapred", and "jvm" so you can edit the "dfs" section as below:
First stop the HDFS service.
Visit conf/hadoop-metrics.properties add the changed you need for GangliaMetrics:
dfs.servers=#GANGLIA#:8649
Restart the HDFS service

Resources