While installing Cloudera managaer 5 - cloudera-manager

]# cat 2.install-oracle-j2sdk1.7.log
Loaded plugins: fastestmirror
Setting up Install Process
Loading mirror speeds from cached hostfile
Error: Cannot find a valid baseurl for repo: base
Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=6&arch=x86_64&repo=os error was
14: PYCURL ERROR 7 - "Failed to connect to 2a01:c0:2:4:0:acff:fe1e:1e52: Network is unreachable"

Did you create cloudera repo files in /etc/yum.repos.d/
Check network settings (If you are under proxy, configure proxy server details)
For more details How to install CDH, check below link
http://bigdata-tips.blogspot.in/2016/03/cdh-552-installation-on-rhelcent-os-71.html

Related

How to configure azure-cli behind a corporate proxy on Windows

I'm using Windows 10 behind a corporate proxy and az --version outputs the following:
azure-cli 2.5.1
command-modules-nspkg 2.0.3
core 2.5.1
nspkg 3.0.4
telemetry 1.0.4
...
Unable to check if your CLI is up-to-date. Check your internet connection.
Furthermore, az extension list-available throws:
Unable to get extension index.
Please ensure you have network connection. Error detail: HTTPSConnectionPool(host='aka.ms', port=443): Max retries exceeded with url: /azure-cli-extension-index-v1 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 403 Forbidden',)))
How to configure azure-cli for the corporate proxy?
Download local proxy configuration from http://wpad/wpad.dat
At the beginning of the wpad.dat file there is a line similar to CWSProxy="PROXY proxy.corporation.com:8082";
Enter the proxy server to environment variable HTTPS_PROXY, e.g. in bash: export HTTPS_PROXY="proxy.corporation.com:8082"
Now az extension list-available connects. However, for some reason, az --version is still giving Unable to check if your CLI is up-to-date. Check your internet connection. You can now anyway install extensions such as az extension add --name azure-devops.
From https://learn.microsoft.com/en-us/cli/azure/install-azure-cli-windows?view=azure-cli-latest&tabs=azure-cli#proxy-blocks-connection
For Windows 10, you could check the proxy settings in the Settings > Network & Internet > Proxy pane. Contact your system administrator for the required settings, or for situations where your machine may be configuration-managed or require advanced setup.

EC2 yum 404 error

I'm using an instance of Amazon EC2, Redhat.
Since I updated yum last time, it doesn't work any more, always get error messages of 404 not found, for example:
failure: repodata/repomd.xml from rhui-REGION-rhel-server-releases: [Errno 256] No more mirrors to try.
https://rhui2-cds01.us-east-2.aws.ce.redhat.com/pulp/repos//content/dist/rhel/rhui/server/7/%24releasever/x86_64/os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
https://rhui2-cds02.us-east-2.aws.ce.redhat.com/pulp/repos//content/dist/rhel/rhui/server/7/%24releasever/x86_64/os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Anyone knows the solution?
According to redhat https://access.redhat.com/articles/1320623
Typical Cause This issue generally occurs if client system is able to
communicate with given server but could not find or access the
requested package on the server.
Resolution This issue can occur due to corruption of local client
cache, try to clear cache on client system:
Try
rm -fr /var/cache/yum/*
yum clean all
then
yum update

sbt 0.13 on Windows - Cannot Access Repositories

I've gone through almost everything related to installing sbt on Window on stackoverflow (there are quite a few people having the same problem with me). However, the answer seems unclear/unreproducible on my machine.
Here is what I did:
Download sbt-0.13.13 on this site
Install it successfully and set the PATH
Try sbt version to see if it is installed successfully. Error
returned (as at the end of this post)
A few things we should know:
I already have JDK
I don't use Proxy on my computer (tested with netsh winhttp show
proxy)
Someone said it is because sbt doesn't support ASCII character - but
the solution wasn't clear
problems summary
WARNINGS
module not found: org.fusesource.jansi#jansi;1.11
local: tried
C:\Users\buidu\.ivy2\local\org.fusesource.jansi\jansi\1.11\ivys\ivy.xml
-- artifact org.fusesource.jansi#jansi;1.11!jansi.jar:
C:\Users\buidu\.ivy2\local\org.fusesource.jansi\jansi\1.11\jars\jansi.jar
==== Maven Central: tried
https://repo1.maven.org/maven2/org/fusesource/jansi/jansi/1.11/jansi-1.11.pom
-- artifact org.fusesource.jansi#jansi;1.11!jansi.jar:
https://repo1.maven.org/maven2/org/fusesource/jansi/jansi/1.11/jansi-1.11.jar
==== typesafe-ivy-releases: tried
https://repo.typesafe.com/typesafe/ivy-releases/org.fusesource.jansi/jansi/1.11/ivys/ivy.xml
==== sbt-ivy-snapshots: tried
https://repo.scala-sbt.org/scalasbt/ivy-snapshots/org.fusesource.jansi/jansi/1.11/ivys/ivy.xml
UNRESOLVED DEPENDENCIES
org.fusesource.jansi#jansi;1.11: not found
Server access Error: Permission denied: connect url=https://repo1.maven.org/maven2/org/fusesource/jansi/jansi/1.11/jansi-1.11.pom
Server access Error: Permission denied: connect url=https://repo1.maven.org/maven2/org/fusesource/jansi/jansi/1.11/jansi-1.11.jar
Server access Error: Permission denied: connect url=https://repo.typesafe.com/typesafe/ivy-releases/org.fusesource.jansi/jansi/1.11/ivys/ivy.xml
Server access Error: Permission denied: connect url=https://repo.scala-sbt.org/scalasbt/ivy-snapshots/org.fusesource.jansi/jansi/1.11/ivys/ivy.xml
You could try to configure the use of IPV4 (not IPV6), as described in the accepted answer for this question:
Error while importing sbt project , Server Access error, unresolved dependencies
setx _JAVA_OPTIONS -Djava.net.preferIPv4Stack=true
I was struggling with the same for a week. The only thing, that helped, was to uninstall sbt from the default location (c:\Program Files(x86)\sbt) and reinstall it to some location without spaces (I've installed it to d:\sbt).
Did you try taking a look in your sbt repositories file (likely to be c:\users\.sbt\repositories, and specifying http:// instead of https:// ?

Yum install Hadoop not found error CENTOS

I am trying to set up the hadoop environment following the instructions listed in the book Hadoop For Dummies on a virtual machine.
One of step indicates the following code -
yum install hadoop\* mahout\* oozie\* hbase\* pig\* hive\* zookeeper\* hue\*
When I run that I get the following error -
[root#localhost Desktop]# yum install hadoop\*
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
* base: centos.mirror.crucial.com.au
* extras: centos.mirror.crucial.com.au
* updates: centos.mirror.nsw.au.glovine.com.au
base | 3.7 kB 00:00
extras | 3.4 kB 00:00
updates | 3.4 kB 00:00
Setting up Install Process
No package hadoop* available.
Error: Nothing to do
Among all hadoop, zookeeper and hue I got the error saying the package not found. I looked into those mirror sites and I do see that hadoop is not present. Is there any way to force the mirror to some other location?
Edit -
As pointed out below I did try the command to get the repo with the following command -
wget -O /etc/yum.repos.d/bigtop.repo http://archive.apache.org/dist/bigtop/bigtop-1.0.0/repos/centos6/bigtop.repo
which is throwing following Connection Refused error -
[root#localhost Desktop]# wget -O /etc/yum.repos.d/bigtop.repo http://www.apache.org/dist/bigtop/bigtop-1.0.0/repos/centos6/bigtop.repo
--2015-12-30 05:03:09-- http://www.apache.org/dist/bigtop/bigtop-1.0.0/repos/centos6/bigtop.repo
Resolving www.apache.org... 88.198.26.2, 140.211.11.105, 2a01:4f8:130:2192::2
Connecting to www.apache.org|88.198.26.2|:80... failed: Connection refused.
Connecting to www.apache.org|140.211.11.105|:80... failed: Connection refused.
Connecting to www.apache.org|2a01:4f8:130:2192::2|:80... failed: Network is unreachable.
Likewise I did try CDH one-click install as pointed out by user1862493 and I am getting the following error
[root#localhost Desktop]# wget https://archive.cloudera.com/cdh5/one-click-install/redhat/6/x86_64/cloudera-cdh-5-0.x86_64.rpm
--2015-12-30 05:07:49-- https://archive.cloudera.com/cdh5/one-click-install/redhat/6/x86_64/cloudera-cdh-5-0.x86_64.rpm
Resolving archive.cloudera.com... 23.235.41.167
Connecting to archive.cloudera.com|23.235.41.167|:443... failed: Connection refused.
yum update worked fine and so is internet within the VM, any help?
You need to add the repository first.
wget https://archive.cloudera.com/cdh5/one-click-install/redhat/6/x86_64/cloudera-cdh-5-0.x86_64.rpm
yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm
yum clean all
Then try to install hadoop components.
Ref http://www.cloudera.com/content/www/en-us/documentation/enterprise/latest/topics/cdh_ig_cdh5_install.html#topic_4_4_1_unique_2__p_31_unique_2

Illegal Argument Exception: Unable to access BASE URL: httpHDP Installation

I'm trying to install HDP2.3 with ambari. I had already installed ambari client and server. In three nodes. When I'm selecting stack - I'm getting unable to access BASE URL error. Please see below error image.
Also in server logs, I can see the Error as:
Resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install hdp-select' returned 1. Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-2.3. Please verify its path and try again
How can I resolve this issue?
for me maintaining the Internet-Proxy solved the issue.
Link
Kind regards,
Roman

Resources