HDP sanbox: yum install is throwing 403 error - hadoop

I am trying to setup HDP sandbox and work on a big data project.But when trying to do yum install, I am getting below error
http://s3.amazonaws.com/dev.hortonworks.com/ambari/centos6/2.x/BUILDS/2.4.0.0-1225/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 403 Forbidden"
Trying other mirror.
To address this issue please refer to the below knowledge base article
https://access.redhat.com/solutions/69319
If above article doesn't help to resolve this issue please open a ticket with Red Hat Support.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: AMBARI.2.4.0.0-2.x. Please verify its path and try again
I tried below instructions:
in /etc/yum.repos.d/sandbox.repo, updated the enabled=0
yum clean all
yum update
But yum update gives me this error.I cannot even install any python related libraries to proceed with my work.Can someone give me solution for this error.
Thanks!!

I had the same problem, and in order to solve it, I backed up the repositories:
ambari.repo
HDP.repo
HDP-UTILS.repo
then I removed them from the /yum.repos.d folder.
Then I ran the following command:
yum clean all
After that the yum update worked, and I managed to install the things I needed.
** What I noticed, is that whenever I tried to use any YUM command, it gave preference to these repositories that I mentioned.

Related

Error: unable to locate package libpam-google-authenticator

I'm having trouble setting up 2 factor authentication in Ubuntu Server 18.04.
I'm following this tutorial: http://www.ubuntuboss.com/how-to-set-up-2-factor-authentication-in-ubuntu-server-18-04/
But on the first step when I try to install the package I get the package not found error as seen in the title.
sudo apt-get install libpam-google-authenticator
I have looked around to see if the package has been updated and goes by a different name and I am sure I have the most recent version of the package manager.
Has the package changed or is there anyway around this problem.
Had the same problem. Turned out it's because Ubuntu Server doesn't include the Universe Repository.
Add this line
sudo add-apt-repository universe
Then run the command again and it will install.
I found a way round this issue,
/tmp$ wget http://launchpadlibrarian.net/326531917/libpam-google-authenticator_20170702-1_amd64.deb
I was able to manually install it via this link and installed the missing dependencies the same way and was able to finish the tutorial as normal.

Centos: yum install ffmpeg fails?

I'm trying to install ffmpeg on my server.
The problem is that when i run the following command:
yum install ffmpeg
I get the following error:
http://apt.sw.be/redhat/el6/en/x86_64/dag/repodata/repomd.xml: [Errno 14] PYCURL ERROR 6 - "Couldn't resolve host 'apt.sw.be'"
Trying other mirror.
Error: Cannot retrieve repository metadata (repomd.xml) for repository: dag. Please verify its path and try again
I have this is in etc/yum.repos.d/CentOS-Base.repo
[dag]
name=Dag RPM Repository for Centos
baseurl=http://apt.sw.be/redhat/el$releasever/en/$basearch/dag
enabled=1
I know the issue is the http://apt.sw.be as they are down...
I cannot find an alternative mirrors for it... could someone please let me know if there are any working mirrors for this?
Dag/rpmforge is dead. Just download a static binary of ffmpeg or compile ffmpeg instead of using an old, outdated repository.
Extract it from the archive file and move it to /usr/local/bin if you want it available to all users, or just ~/bin if you don't have superuser/root.

Unable to install Search Guard plugin for Elasticsearch-5.x

Due to the restrictions, I was not allowed to install any packages from internet. So, This command is not useful for me inorder to install search-guard.
bin/elasticsearch-plugin install -b com.floragunn:search-guard-ssl:<version>
However, I am able to install Search Guard successfully on a different network by running the above command.
Because of this reason, I tried installing Search Guard from tar.gz or zip file by the below command as per documentation.
/usr/share/elasticsearch# bin/elasticsearch-plugin install file:///home/xxxx/xxxx/search-guard-5-5.2.0-10-sgadmin-standalone.zip
This one is failing with the below error.
-> Downloading file:///home/xxx/xxxx/search-guard-5-5.2.0-10- sgadmin-standalone.zip
[=================================================] 100%  
ERROR: `elasticsearch` directory is missing in the plugin zip
I downloaded zip/tar.gz from this maven repository of search gaurd.
Is anyone also facing the same issue. If not, kindly help in solving this one.
Download this file from maven to /home/xxxx:
https://oss.sonatype.org/content/repositories/releases/com/floragunn/search-guard-5/5.2.0-11/search-guard-5-5.2.0-11.zip
Install it:
bin/elasticsearch-plugin install -b file:///home/xxxx/search-guard-5-5.2.0-11.zip
Other releases are available here: https://oss.sonatype.org/content/repositories/releases/com/floragunn/

Elasticsearch : Marvel and Sense Plugin Installation does not work

I have tried the online and offline instructions for installing marvel and sense, but nothing works. I have ES 2.2.1 and Kibana 4.4.2
I tried
plugin install marvel-agent
but i get
Installing marvel-agent...
Trying https://download.elastic.co/elasticsearch/release/org/elasticsearch/plugin/marvel-agent/2.2.0/marvel-agent-2.2.0.zip ...
ERROR: failed to download out of all possible locations..., use --verbose to get detailed information
same error for
bin/plugin install license
bin/kibana plugin --install elasticsearch/marvel/latest
so then i tried downloading the files and follow instructions on
https://www.elastic.co/guide/en/marvel/current/installing-marvel.html#offline-installation
i tried
plugin install file:///C:/Users/xyz/ElasticSearch/zips/marvel-agent-2.2.0.zip
but i get
-> Installing from file:/C:/Users/xyz/ElasticSearch/zips/marvel-agent-2.2.0.zip...
Trying file:/C:/Users/xyz/ElasticSearch/zips/marvel-agent-2.2.0.zip ...
Downloading ..DONE
Verifying file:/C:/Users/xyz/ElasticSearch/zips/marvel-agent-2.2.0.zip checksums if available ...
NOTE: Unable to verify checksum for downloaded plugin (unable to find .sha1 or .md5 file to verify)
same for
plugin install file:///C:/Users/xyz/ElasticSearch/zips/license-2.2.0.zip
and finally for
kibana plugin --install marvel --url file:///C:/Users/xyz/ElasticSearch/zips/marvel-2.2.0.tar.gz
i get
Installing marvel
Attempting to transfer from file:///C:/Users/xyz/ElasticSearch/zips/marvel-2.2.0.tar.gz
Error: ENOTFOUND
Plugin installation was unsuccessful due to error "No valid url specified."
Please point out what i am doing wrong.
For me, the last installation instruction required a different format for the url.
file://c:/Temp/ElasticSearch/marvel-2.2.1.tar.gz. Basically, remove one of the forward slashes.
download the Sense tar file from the following link: https://download.elasticsearch.org/elastic/sense/sense-latest.tar.gz
open cmd form kibana\bin location
then you can install Sense using the following command:
kibana plugin -i sense -u file:PATH_TO_SENSE_TAR_FILE

Dependency Resolution Error while installing Zabbix 2.4 on Centos 7

I have installed rpm from this site 1- Zabbix 2.4 download page for centos7
And I have been following installation instructions on this site 2- Zabbix.org centos installation instructions
first, I configure zabbix repository
rpm -ivh http://repo.zabbix.com/zabbix/2.4/rhel/6/x86_64/zabbix-release-2.4-1.el6.noarch.‌​rpm
But, then I realized this repository is for /rhel/6. Then I run the command below to change the zabbix repository which is for /rhel/7 , since I use centos 7.
rpm --import http://repo.zabbix.com/RPM-GPG-KEY-ZABBIX
rpm -Uv http://repo.zabbix.com/zabbix/2.4/rhel/7/x86_64/zabbix-release-2.4-1.el7.noarch.rpm
Then, I try to install zabbix
yum install mysql-server zabbix-server-mysql zabbix-web-mysql zabbix-agent zabbix-java-gateway
But I couldn't because of some dependency could not be installed.
--> Finished Dependency Resolution
Error: Package: zabbix-server-mysql-2.4.5-1.el6.x86_64 (zabbix)
Requires: libmysqlclient.so.16()(64bit)
Error: Package: zabbix-server-mysql-2.4.5-1.el6.x86_64 (zabbix)
Requires: libmysqlclient.so.16(libmysqlclient_16)(64bit)
Error: Package: zabbix-server-mysql-2.4.5-1.el6.x86_64 (zabbix)
Requires: libnetsnmp.so.20()(64bit)
Error: Package: iksemel-1.4-2.el6.x86_64 (zabbix-non-supported)
Requires: libgnutls.so.26()(64bit)
Error: Package: iksemel-1.4-2.el6.x86_64 (zabbix-non-supported)
Requires: libgnutls.so.26(GNUTLS_1_4)(64bit)
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
I have searched a bit and I have came accross a lot of people has same problem and you can find some offered solutions to the problem. I have tried to implement the offered solutions but non of them solved the problem.
3.1- Offered solution from centos.org/forum : I could not understand this, I run the commands and result are shown below.
rpm -qR postfix
libmysqlclient.so.18()(64bit)
libmysqlclient.so.18(libmysqlclient_18)(64bit)
rpm -q mysql-libs
package mysql-libs is not installed
3.2- Offered solution from centos.org/forum This problem seems very similar but it does not helped either
3.3- Offered solution from zabbix.com/forum This problem seems exactly same, and a solution is offered. But I could not understand it.
Also, I found that on Zabbix official documentation 4- Zabbix 2.4 manual
Supported for versions: RHEL6, CentOS 6
centos 7 is not listed here, but it contradicts with Zabbix download page, since they provide a link for centos 7. you can check first link.
Please share if you have any idea how to solve this problem.
As #Jan Garaj pointed, the problem was yum try to install el6 packages, although I have changed the zabbix repository which is for rhel/7.
So, I have just cleaned the cache with the commands below and problem is resolved.
yum clean headers
yum clean packages
yum clean metadata
You can find more information about cleaning yum caches on this site:
Centos/clearing yum caches
You can find information about removing a yum repository on tihs site, Just cleaning cache solves this problem, so I did not try to remove yum repository. But, it can be useful if cleaning cache does not help.
serverFault/how to remove yum repo
I had similar problem while installing nginx. For me what helped was continuous release repository CR
Usage:
yum -y install yum-utils
yum-config-manager --enable cr

Resources