Has anyone installed logstash-input-jmx (or any other "community" plugin for Logstash) in RHEL?
How did you manage the Ruby/gem dependencies?
After installing a recent version of Ruby, RubyGems, and Rails, the development/runtime gem dependencies have to be resolved, but attempting to install any of the gems mentioned in here, would lead to endless missing dependencies ...
Are there any packaged versions of Logstash JMX plugin around?
Thanks,
Babak.
Welcome to the house of fun. What I did was, which may be out of your scope but it might help....
$logstash_location/bin/logstash-plugin list
(as you might expect this shows what can be installed to your instance)
$logstash_location/bin/logstash-plugin install logstash-input-jmx
The plugin itself should resolve its own dependencies. I was having all sort of problems in Docker, but I had to build my Logstash tarball external to the machine. Make sure connectivity is ok too. It's a service, not local to your machine.
This post clearly describes the steps required to install a "community" logstash plugin, and can be used to install jmx plugin on RHEL. I've tried it on RHEL 7.3.
The main thing to consider is that in RHEL 7.3 the logstash can be found under /usr/share/logstash/ rather than /opt/logstash
Related
I am trying to install ambari 2.7.5 on centos 7. I am following the instructions given on this link. When I run the build command for maven I get the following error:
I have installed maven 3.6.3 . And I could not find maven 3.1.0 in apache downloads. So how to resolve this error?
#VK for Ambari-web you have to edit some files and set your versions. If you are having hard time with npm/node version make sure they match the posted versions I gave. In centos7 I am using the epel repository. Sounds like you already got current maven so good to go there.
Also this post is pretty much a duplicate of:
Building Ambari 2.7.5 on CentOS 7 from source, Worked 2 weeks ago, now fails
Its also discussed here:
Ambari 2.7.5 installation failure on CentOS 7
And a jira with another bower file sample:
https://issues.apache.org/jira/browse/AMBARI-25519
I have tried searching on various internet forums about the offline installation of Logstash plugins, but haven't found the solution that we can implement.
What I want to achieve is:
Install the following two logstash plugins:
logstash-filter-mutate-master
logstash-filter-aggregate-master
My Limitations Are:
At my company, there is strictly no Internet connectivity on Linux servers. Therefore, I need a solution where I could download some off-the-shelf package on my Windows machine, and then unpack it on the Linux machine, which would install the plugins I require.
I have looked at the Logstash documentation, which advises on how to install plugins offline, but that also needs a 'Staging' server which has logstash source-code and has Internet connectivity - the latter is non-existent in my organisation.
I would greatly appreciate if you could advise how to approach this. At present, when I try to install the 'mutate' plugin, here's the error I see:
$ bin/logstash-plugin install --local --no-verify
Installing...
Plugin not found, aborting
ERROR: Installation Aborted, message: Could not find gem 'ci_reporter_rspec (>= 0) java' in any of the gem sources listed in your Gemfile or installed on this machine.
Thank you.
If you want to install a logstash plugin in offline.
First way ;
You must change gemfile in logstash directory. As an example, download plugin source in somewhere of your logstash directory then modify gemfile in logstash directory with plugin name and path.
gem "logstash-input-example-plugin", :path => "./plugins/logstash-input-example-plugin"
After that just run the below command
bin/logstash-plugin install --no-verify
You can follow this link :
https://www.tutorialspoint.com/logstash/logstash_plugins.htm
Second way; using with gem file of the plugin. As an example;
bin/logstash-plugin install /path/to/logstash-output-kafka-1.0.0.gem
You can follow this link :
https://www.elastic.co/guide/en/logstash/current/working-with-plugins.html
There is a nasty bug in Docker 1.9.x that is causing java
processes to hang and frankly hang up the entire container
instance, spinning 100% CPU.
I currently have docker 1.9.1 installed because that is all that
the docker install tool will install. There is no opportunity during
the install process to select any other version.
This is completely preventing me from building a cordova
build container. In my internet research I have found many
others who are encountering the same problem.
I've done some research and seen that others are reporting this
problem does not occur with Docker 1.8.3.
I've searched in vain for some hints on how to install older versions
of docker on OS-X. I tried replacing the boot2docker.iso in ~/.docker/machine/machines/default with the 1.8.3 version downloaded
from here: https://github.com/boot2docker/boot2docker/releases/tag/v1.8.3 but that fails miserably. I am guessing that there are other things about my default machine (which had been created with 1.9.1) that are incompatible with it.
If anybody has hints as to how I could create a new machine or modify
the existing machine to work with 1.8.3 I would very much appreciate
it.
Alternatively, let me know if there is some other installation method that would allow me to specify which version of docker to install.
I figured out that what I needed to do is to find an older version of DockerToolbox and that would install the version of docker that I wanted.
I went to the github repository for DockerToolbox:
https://github.com/docker/toolbox/releases?after=v1.9.
and there I found a link to the 1.8.3 binary:
https://github.com/docker/toolbox/releases/download/v1.8.3/DockerToolbox-1.8.3.pkg
I still had to uninstall my previous installation of docker so I followed the uninstall instructions on this page:
https://medium.com/#itseranga/install-old-version-of-docker-osx-c92ebd5f15f7#.5qh1z0ino
Once I had uninstalled and reinstalled via the legacy DockerToolbox, I managed to build the cordova container:
https://github.com/oren/docker-cordova
without incident.
I've been using the following:
https://get.docker.com/builds/$(uname -s)/$(uname -m)/docker-.tgz
See https://github.com/docker/for-mac/issues/1120.
If you happen to know the build number (e.g. 14937) -- not the git commit you see when running docker --version or docker version -- you can form the URL:
https://download.docker.com/mac/{{ beta | stable}}/{{ version }}.{{ build number }}/Docker.dmg
# example:
https://download.docker.com/mac/stable/1.12.6.14937/Docker.dmg
I want to install Logstash for NodeJs on windows 7, but I am not able to find proper steps for the same.
Can any one please help!
There is the option of node-logstash if you want a node.js alternative to Logstash. This isn't something I'm using myself (I'm using nxlog in Windows instead) but it looks like a decent alternative to the standard JRuby Logstash if you need to forward logs from Windows.
Instructions from the readme are below:
Installation
Install NodeJS, version >= 0.10, or io.js.
Install build tools
Debian based system: apt-get install build-essential
Centos system: yum install gcc gcc-c++ make
Install zmq dev libraries: This is required to build the node zeromq module.
Debian based system: apt-get install libzmq1. Under recent releases, this package is present in default repositories. On ubuntu lucid, use this ppa. On debian squeeze, use backports.
Centos 6: yum install zeromq zeromq-devel. Before, you have to add the rpm zeromq repo : curl http://download.opensuse.org/repositories/home:/fengshuo:/zeromq/CentOS_CentOS-6/home:fengshuo:zeromq.repo > /etc/yum.repos.d/zeromq.repo
Clone repository: git clone git://github.com/bpaquet/node-logstash.git && cd node-logstash
Install dependencies: npm install.
The executable is in bin/node-logstash-agent
You have scripts in dists folder to build packages. Actually, only debian is supported.
As per the comment, logstash has nothing to do with nodejs.
What you're looking to do is install Logstash on Windows, something that you can find out about by using google, there will be loads of guides out there describing how to do this.
You would then need to configure logstash to look in the right location for the log files it needs to process, and then set up filters to handle nodejs style logs (which as far as I understand aren't very well standardised). You then need to configure an output (logstash is essentially a unix pipe on steroids and needs somewhere to save the logs it has processed). Elasticsearch is the most common thing to save logs to.
Personally, in my environment, I would install logstash on a CentOS server, as it's a well established process, and ship the logs from your Windows 7 machine to the logstash server using either logstash forwarder or nxlog. That way you can have logs coming in from a number of different sources and you can still reboot your Windows machine every few days as required by Windows update without your logstash server going down.
How to easily package software that uses multiple gems into a debian installable packages?
You have a couple options
1) package your application as a gem using jeweler
By making it a gem, you can specify dependencies in the gemspec, so when it is installed
rubygems will automatically attempt to install the needed gems.
This is probably the easiest thing
2) run an apt-server and package your app for it. There are some instructions on running an
apt server on the ubuntu help pages.
Packaging your app is somewhat complicated looking, but boils down to:
writing install/uninstall etc scripts
writing config files
Get started with this doc on the ibm developerworks