I am trying to monitor Hbase using Ganglia. How to use cloudera management console to edit dfs.server property in the hadoop-metrics.properties?
According to
http://wiki.apache.org/hadoop/GangliaMetrics I need to change:
dfs.servers=#GANGLIA#:8649
But I am not able to see the option to modify dfs.server value on the management console of cloudera.
How should I proceed?
dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
hbase.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
rpc.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
ugi.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
dfs.period=10
mapred.period=10
hbase.period=10
jvm.period=10
rpc.period=10
ugi.period=10
dfs.fileName=/tmp/metrics/dfs.log
mapred.fileName=/tmp/metrics/dfs.log
hbase.fileName=/tmp/metrics/hbase.log
jvm.fileName=/tmp/metrics/jvm.log
rpc.fileName=/tmp/metrics/rpc.log
ugi.fileName=/tmp/metrics/ugi.lo
I don't think the Cloudera management console has ability to edit hadoop-metrics.properties configuration through UI instead, you just need to edit this configuration manually. In Hadoop hadoop-metrics.properties configuration settings contains settings for the metrics contexts "dfs", "mapred", and "jvm" so you can edit the "dfs" section as below:
First stop the HDFS service.
Visit conf/hadoop-metrics.properties add the changed you need for GangliaMetrics:
dfs.servers=#GANGLIA#:8649
Restart the HDFS service
Related
I want to disable the Database Replication from the replica cluster in MarkLogic 8 using ML-Gradle. After updating the configurations, I also want to re-enable it.
There are tasks for enabling and disabling flexrep in ML Gradle. But I couldn't found any such thing for Database Replication. How can this be done?
ml-gradle uses the Management API to handle configuration changes. Database Replication is controlled by sending a PUT command to /manage/v2/databases/[id-or-name]/properties. Update your ml-config/databases/content-database.json file (example that does not include that property) to include database-replication, including replication-enabled: true.
To see what that object should look like, you can send a GET request to the properties endpoint.
You can create your own command to set replication-enabled - see https://github.com/rjrudin/ml-gradle/wiki/Writing-your-own-management-task
I'll also add a ticket for making official commands - e.g. mlEnableReplication and mlDisableReplication, with those defaulting to the content database, and allowing for any database to be specified.
I would like to update data source properties in IBM Websphere 8.5.5.0 using a script. Generally these properties are updated manually using admin console, but I would like to do it automatically. For this I need to know the .properties or .xml file or *.* in which data source configurations are stored.
Can anyone help me with this please.
If you already know how to update the configurations in the admin console, you could use the built-in command assistance to see what underlying wsadmin command was run by the update.
http://www.ibm.com/developerworks/websphere/library/techarticles/0812_rhodes/0812_rhodes.html
Generate a command using the console The first method is the most
basic use of command assistance. You launch the administrative
console, perform an action, and access the command assistance panel,
which displays the wsadmin command for that action.
DataSource configuration is stored in an xml file, but should not be edited directly by users.
If you want to use a script, use wsadmin to modify the properties you need.
See this doc for full information on modifying datasource properties using wsadmin:
Configuring new data source custom properties using wsadmin
Every time i try to use the Hadoop Resource Manager web interface (http://resource-manger.host:8088/cluster/) i show up logged in as dr.who.
My question, how can I login as another user? In this case i want to login as myself and have a higher lever of privileges than dr.who.
The user infomation is got from HttpServletRequest#getRemoteUser().
1. If you deployed an insecure cluster, the simplest way to pass the username to server is by url parameter. For example, http://localhost:8088/cluster?user.name=babu
2. If you deployed a secure cluster, you probably use Kerberos authentication. You can use kinit to get a kerberos tgt, then configure the browser to negotiate. (network.negotiate-auth.trusted-uris for firefox, and --auth-server-whitelist for chromium. I'm sure there's lots of answers about this)
For more information, you can check hadoop official documentation.(https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/HttpAuthentication.html)
You should set the access control list by changing the default configuration of:
yarn.resourcemanager.zk-acl
from
world:anyone:rwcda
to something else,which is Cluster-specific
The ACLs the ResourceManager uses for the znode structure to store the internal state.
Does anybody know about a GUI for Config Admin of Knopflerfish? What I want to achieve is dynamic configuration management without editting configuration files manually. Is that possible at all? Here OSGI blog I read that
To set Config Admin data, take a look at the Felix Webconsole, Felix FileInstall, or the Knopflerfish environment. They all support a range of (G)UIs to create configuration records.
But I could not find any GUI for Knopflerfish :(
I don't know if you're still interested in this topic, anyway I hope I can help you.
What I tried so far are the possibility to change the ConfigAdmin data via:
Felix FileInstall (download the bundle from http://felix.apache.org/downloads.cgi) and add it to your init.xargs list of bundles to install and start. Then every modification you make in the pair "properties = value" of the file myBundle.cfg is notified to bundles registered as ManagedService with pid = myBundle. EXPLANATION ADDED FOR COMPLETENESS BUT THIS IS NOT A GUI TOOL!
Knopflerfish Console: from here you can enter the "configuration" submenu with "enter configuration", then "list" to see the available configurations with relative pids and "edit pids_name" if you want to change a configuration dynamically. To change a property value use "set property_name value"
Felix WebConsole: following this guide you can install the webConsole which allows you to access the properties of your ManagedService via web console at the port 8080 on the localhost (with default configuration). Here how you can see the interface of ConfigAdmin via Felix WebConsole.
I hope it helped to you or omeone else reading in th future.
Andrea
I'm looking to start Spring XD in distributed mode (more specifically deploying it with BOSH). How does the admin component communicate to the module container?
If it's via TCP/HTTP, surely I'll have to tell the admin component where all the containers are? If it's via Redis, I would've thought that I'll need to tell the containers where the Redis instance is?
Update
I've tried running xd-admin and Redis on one box, and xd-container on another with redis.properties updated to point to the admin box. The container starts without reporting any exceptions.
Running the example stream submission curl -d "time | log" http://{admin IP}:8080/streams/ticktock yields no output to either console, and not output to the logs.
If you are using the xd-container script, then the redis.properties is expected to be under "XD_HOME/config" where XD_HOME points the base directory where you have bin, config, lib & modules of xd.
Communication between the Admin and Container runtime components is via the messaging bus, which by default is Redis.
Make sure the environment variable XD_HOME is set as per the documentation; if it is not you will see a logging message that suggests the properties file has been loaded correctly when it has not:
13/06/24 09:20:35 INFO support.PropertySourcesPlaceholderConfigurer: Loading properties file from URL [file:../config/redis.properties]