Storm nimbus incorrectly bind to localhost - apache-storm

Below is my config file:
storm.zookeeper.servers:
- "10.13.0.91"
- "10.13.0.93"
- "10.13.0.104"
nimbus.seeds: ["10.13.0.91", "10.13.0.93", "10.13.0.104"]
storm.local.dir: "/data1/storm/state"
storm.log.dir: "/data1/storm/log"
nimbus.childopts: "-Xmx2048m -XX:MaxPermSize=1024m -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -verbose:gc -Xloggc:/data1/storm/log/gc-storm-nimbus.log"
worker.childopts: "-Xmx2048m -XX:MaxPermSize=1024m -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -verbose:gc -Xloggc:/data1/storm/log/gc-storm-worker-%ID%.log"
supervisor.childopts: "-Xmx512m -XX:MaxPermSize=512m -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -verbose:gc -Xloggc:/data1/storm/log/gc-storm-supervisor.log"
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
client.jartransformer.class: "org.apache.storm.hack.StormShadeTransformer"
When I run bin/storm nimbus on 10.13.0.91, I can see the nimbus progress bind to 10.13.0.91.
However, when I run the same command with same configuration
tcp 0 0 :::6627 :::* LISTEN 54981/java
tcp 0 0 ::ffff:127.0.0.1:6627 ::ffff:127.0.0.1:34507 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:46929 ::ffff:10.13.0.91:6627 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:53760 ::ffff:10.13.0.93:2181 ESTABLISHED 54981/java
tcp 0 0 ::ffff:127.0.0.1:34495 ::ffff:127.0.0.1:6627 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:46944 ::ffff:10.13.0.91:6627 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:20261 ::ffff:10.13.0.91:2181 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:20175 ::ffff:10.13.0.91:2181 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:26995 ::ffff:10.13.0.104:2181 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:46949 ::ffff:10.13.0.91:6627 ESTABLISHED 54981/java
tcp 0 0 ::ffff:10.13.0.93:26994 ::ffff:10.13.0.104:2181 ESTABLISHED 54981/java
tcp 0 0 ::ffff:127.0.0.1:6627 ::ffff:127.0.0.1:34495 ESTABLISHED 54981/java
tcp 0 0 ::ffff:127.0.0.1:34507 ::ffff:127.0.0.1:6627 ESTABLISHED 54981/java
Searched a long time on google but nothing help. Does any one meet the same issue before?

add this line in storm.yaml
storm.local.hostname: "your-host-name"
and put your-host-name in /etc/hosts and restart storm-nimbus

Related

how to open jelastic firewall for vps http and https?

i have a vps on a jelastic hoster to run a node js application with nginx reverese proxy.
that's running smooth without the jelastic firewall.
if i activate the firewall and setting up rules for http and https, the website is blocked. how can i open the firewall, that users can browse my application?
here is a image of my firewall rules
iptables -nvL prints also:
0 0 ACCEPT tcp -- * * 0.0.0.0/0 0.0.0.0/0 tcp dpt:80
0 0 ACCEPT udp -- * * 0.0.0.0/0 0.0.0.0/0 udp dpt:80
0 0 ACCEPT tcp -- * * 0.0.0.0/0 0.0.0.0/0 tcp dpt:443
0 0 ACCEPT udp -- * * 0.0.0.0/0 0.0.0.0/0 udp dpt:443
netsta -nlapt prints:
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN 250/systemd-resolve
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 447/sshd: /usr/sbin
tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 6754/nginx: master
tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN 1/init
tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 6754/nginx: master
tcp 0 0 185.131.52.12:22 222.186.42.7:50138 ESTABLISHED 16531/sshd: root [p
tcp 0 0 10.101.3.228:33424 10.101.3.160:27017 ESTABLISHED 7030/node /home/loo
tcp 0 0 10.101.3.228:60798 10.101.3.160:27017 ESTABLISHED 6639/node /home/loo
tcp 0 0 10.101.3.228:32988 10.101.3.160:27017 ESTABLISHED 7030/node /home/loo
tcp 0 0 10.101.3.228:32980 10.101.3.160:27017 ESTABLISHED 7030/node /home/loo
tcp 0 0 10.101.3.228:22 10.101.1.120:44842 ESTABLISHED 15298/sshd: root#pt
tcp 0 0 10.101.3.228:32986 10.101.3.160:27017 ESTABLISHED 7030/node /home/loo
tcp 0 0 10.101.3.228:32990 10.101.3.160:27017 ESTABLISHED 7030/node /home/loo
tcp 0 0 10.101.3.228:22 10.101.1.107:33800 ESTABLISHED 16425/sshd: root#pt
tcp 0 0 10.101.3.228:59584 10.101.3.160:27017 ESTABLISHED 6639/node /home/loo
tcp 0 0 10.101.3.228:59578 10.101.3.160:27017 ESTABLISHED 6639/node /home/loo
tcp6 0 0 :::22 :::* LISTEN 447/sshd: /usr/sbin
tcp6 0 0 :::443 :::* LISTEN 6754/nginx: master
tcp6 0 0 :::4000 :::* LISTEN 7030/node /home/loo
tcp6 0 0 :::111 :::* LISTEN 1/init
tcp6 0 0 :::80 :::* LISTEN 6754/nginx: master
tcp6 0 0 :::8080 :::* LISTEN 6639/node /home/loo
After getting more information from my hoster, i know the answer.
So i must disable the UFW and must install the CSF Firewall.
Here is the documentation about that:
https://cloudjiffy.com/portal/knowledgebase/324/Ubuntu-with-CSF-Firewall.html

Resource Manager web UI not working

I have pasted the configurations below
yarn-site.xml
<configuration><!-- Site specific YARN configuration properties --><property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value></property><property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value></property><property>
<name>yarn.resourcemanager.resource-tracker.address</name> <value>idea-ind-cie1:8026</value></property><property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>idea-ind-cie1:8031</value></property><property>
<name>yarn.resourcemanager.address</name>
<value>idea-ind-cie1:8041</value></property><property>
<name>yarn.resourcemanager.webapp.address</name>
<value>0.0.0.0:8088</value></property></configuration>
Output of netstat -tupln
tcp 0 0 0.0.0.0:50070 0.0.0.0:* LISTEN 15678/java
tcp 0 0 0.0.0.0:9083 0.0.0.0:* LISTEN 9743/java
tcp 0 0 0.0.0.0:35773 0.0.0.0:* LISTEN 15678/java
tcp 0 0 0.0.0.0:56165 0.0.0.0:* LISTEN 15929/java
tcp 0 0 172.24.191.223:54310 0.0.0.0:* LISTEN 15678/java
tcp 0 0 0.0.0.0:50090 0.0.0.0:* LISTEN 15929/java
tcp 0 0 ::ffff:172.24.191.223:6066 :::* LISTEN 19284/java
tcp 0 0 ::ffff:172.24.191.223:8089 :::* LISTEN 30300/java
tcp 0 0 ::ffff:172.24.191.223:8026 :::* LISTEN 30300/java
tcp 0 0 ::ffff:172.24.191.223:8031 :::* LISTEN 30300/java
tcp 0 0 :::8033 :::* LISTEN 30300/java
tcp 0 0 ::ffff:172.24.191.223:7077 :::* LISTEN 19284/java
tcp 0 0 :::9000 :::* LISTEN 19284/java
tcp 0 0 ::ffff:172.24.191.223:8041 :::* LISTEN 30300/java
Log file of Resource Manager
2018-04-18 19:22:43,662 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8088
2018-04-18 19:22:45,503 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup#0.0.0.0:8088
2018-04-18 19:22:45,504 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app cluster started at 8088

AWS site down after instance reboot

I have run the below command to change the timezone in server.
sudo ln -sf /usr/share/zoneinfo/Asia/Kolkata /etc/localtime
sudo reboot
before running this command I have try to create /etc/sysconfig/clock file adding a zone="Asia/Kolkata" in it but I am getting error while saving the file as "permission denied"
So I run the above command.but after rebooting instance when I try to open my site mcook.co.in it shows me error "No data received".
I have check my public ip changed or not but its not changed as I am using Elastic IP.
I am not much familiar with AWS but after rebooting instance this issues are occurs.
netstate -ntlp
output :
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:10000 0.0.0.0:* LISTEN -
tcp 0 0 172.31.33.144:53 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:25 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:953 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:20000 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:993 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:995 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6379 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:587 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:110 0.0.0.0:* LISTEN -
tcp 0 0 0.0.0.0:143 0.0.0.0:* LISTEN -
tcp6 0 0 :::80 :::* LISTEN -
tcp6 0 0 :::53 :::* LISTEN -
tcp6 0 0 :::22 :::* LISTEN -
tcp6 0 0 :::25 :::* LISTEN -
tcp6 0 0 :::443 :::* LISTEN -
tcp6 0 0 :::993 :::* LISTEN -
tcp6 0 0 :::995 :::* LISTEN -
tcp6 0 0 :::587 :::* LISTEN -
tcp6 0 0 :::110 :::* LISTEN -
tcp6 0 0 :::143 :::* LISTEN -

Cassandra is forcing to open CQL native port on ipv6 interface

I'm trying to connect to one of nodes of running instance of Cassandra servers. Nodetool shows that they synchronized well.
[root#cassandra1 ~]# /opt/dsc-cassandra-2.1.8/bin/nodetool status
Datacenter: datacenter1
=======================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
-- Address Load Tokens Owns (effective) Host ID Rack
UN 10.0.17.20 100.4 KB 256 100.0% rack1
UN 10.0.17.24 249.39 KB 256 100.0% rack1
When I run netstst -tulnap I can see following settings
tcp 0 0 127.0.0.1:44907 0.0.0.0:* LISTEN 4428/java
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 756/sshd
tcp 0 0 10.0.17.20:7000 0.0.0.0:* LISTEN 4428/java
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 842/master
tcp 0 0 127.0.0.1:7199 0.0.0.0:* LISTEN 4428/java
tcp 0 0 127.0.0.1:199 0.0.0.0:* LISTEN 744/snmpd
tcp 0 0 127.0.0.1:9160 0.0.0.0:* LISTEN 4428/java
tcp 0 0 10.0.17.20:7000 10.0.17.24:46314 ESTABLISHED 4428/java
tcp 0 0 10.0.17.20:43083 10.0.17.24:7000 ESTABLISHED 4428/java
tcp 0 0 10.0.17.20:22 10.0.17.50:53665 ESTABLISHED 4662/sshd
tcp 0 0 ::ffff:127.0.0.1:9042 :::* LISTEN 4428/java
tcp 0 0 :::22 :::* LISTEN 756/sshd
tcp 0 0 ::ffff:127.0.0.1:34705 ::ffff:127.0.0.1:44907 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:43039 ::ffff:127.0.0.1:7199 TIME_WAIT -
What tells that 7199 port used to syncing between nodes works in ipv4, ssh on ipv4/6 and the port I'm insterested in is only listening on ipv6 interface.
To enforce using ipv4, even when it is not nesecary I set flag listen_interface_prefer_ipf6: false
listen_address: 10.0.17.20
listen_interface_prefer_ipv6: false
org.apache.cassandra.auth.AllowAllInternodeAuthenticator
start_native_transport: true
native_transport_port: 9042
I don't know how to force Cassandra service to open 9042 port on ipv4.

hdfs connection failure

I know this question has been discussed many time, but none of the solutions worked for me. I am still getting this error.
hadoop version is 2.0.2-alpha
$ jps
24107 NameNode
24314 DataNode
25299 Jps
24720 NodeManager
24520 ResourceManager
$ hdfs dfs ... any command gives me this error
<command>: Call from jeet/192.168.1.26 to jeet:9000 failed on connection exception: java.net.ConnectException: Connectionrefused;
tcp 0 0 192.168.1.26:9620 0.0.0.0:* LISTEN 24520/java
tcp 0 0 0.0.0.0:58932 0.0.0.0:* LISTEN 24720/java
tcp 0 0 0.0.0.0:21 0.0.0.0:* LISTEN 26020/vsftpd
tcp 0 0 127.0.1.1:53 0.0.0.0:* LISTEN 1610/dnsmasq
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 614/sshd
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 713/cupsd
tcp 0 0 0.0.0.0:8088 0.0.0.0:* LISTEN 24520/java
tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 24314/java
tcp 0 0 192.168.1.26:9210 0.0.0.0:* LISTEN 24107/java
tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 24314/java
tcp 0 0 192.168.1.26:9600 0.0.0.0:* LISTEN 24520/java
tcp 0 0 0.0.0.0:8033 0.0.0.0:* LISTEN 24520/java
tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 24314/java
tcp 0 0 192.168.1.26:9220 0.0.0.0:* LISTEN 24107/java
tcp 0 0 0.0.0.0:8040 0.0.0.0:* LISTEN 24720/java
tcp 0 0 192.168.1.26:9610 0.0.0.0:* LISTEN 24520/java
tcp 0 0 0.0.0.0:8042 0.0.0.0:* LISTEN 24720/java
tcp 0 0 0.0.0.0:8080 0.0.0.0:* LISTEN 24720/java
tcp 0 0 192.168.1.26:9200 0.0.0.0:* LISTEN 24107/java
tcp6 0 0 :::22 :::* LISTEN 614/sshd
tcp6 0 0 :::23 :::* LISTEN 11765/xinetd
--------------------- core-site.xml
<property>
<name>fs.default.name</name>
<value>hdfs://jeet:9000</value>
<description>
The name of the default file system. Either the
literal string "local" or a host:port for NDFS.
</description>
<final>true</final>
</property>
<property>
<name>fs.trash.interval</name>
<value>360</value>
<description>Number of minutes between trash checkpoints.
If zero, the trash feature is disabled.
</description>
</property>
<property>
<name>hadoop.security.groups.cache.secs</name>
<value>14400</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/app/hadoop/tmp</value>
<description>
Temporary directories.
</description>
</property>

Resources