This is the error that I am getting when I am trying to install oozie.
Hadoop - 2.5.1
Maven - 3.2.3
Oozie - 4.0.0
I am trying to install this in Virtualbox. I have edited the pom.xml file as well. Is their a problem with the version of Hadoop and oozie?
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main .................................. SUCCESS [ 3.086 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 25.084 s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.0 .............. SUCCESS [ 1.705 s]
[INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-4.0.0 ....... SUCCESS [ 0.238 s]
[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.0 Test ......... SUCCESS [ 0.517 s]
[INFO] Apache Oozie Hadoop 2.2.0.oozie-4.0.0 .............. SUCCESS [01:41 min]
[INFO] Apache Oozie Hadoop 2.2.0.oozie-4.0.0 Test ......... SUCCESS [ 35.359 s]
[INFO] Apache Oozie Hadoop Distcp 2.2.0.oozie-4.0.0 ....... SUCCESS [ 3.244 s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.0 ............. SUCCESS [ 5.024 s]
[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.0 Test ........ SUCCESS [ 0.432 s]
[INFO] Apache Oozie Hadoop Distcp 0.23.5.oozie-4.0.0 ...... SUCCESS [ 0.275 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 3.906 s]
[INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.0 .............. SUCCESS [ 0.763 s]
[INFO] Apache Oozie Hbase Libs ............................ SUCCESS [ 1.121 s]
[INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.0 ............ SUCCESS [ 5.821 s]
[INFO] Apache Oozie HCatalog 0.6.0.oozie-4.0.0 ............ SUCCESS [ 26.194 s]
[INFO] Apache Oozie HCatalog Libs ......................... SUCCESS [ 1.084 s]
[INFO] Apache Oozie Share Lib Oozie ....................... FAILURE [ 10.767 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SKIPPED
[INFO] Apache Oozie Core .................................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:53 min
[INFO] Finished at: 2014-10-30T08:29:55+05:30
[INFO] Final Memory: 43M/105M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-sharelib-oozie: Could not resolve dependencies for project org.apache.oozie:oozie-sharelib-oozie:jar:4.0.0: The following artifacts could not be resolved: org.apache.oozie:oozie-hadoop:jar:2.5.0.oozie-4.0.0, org.apache.oozie:oozie-hadoop-test:jar:2.5.0.oozie-4.0.0: Could not find artifact org.apache.oozie:oozie-hadoop:jar:2.5.0.oozie-4.0.0 in central (http://repo1.maven.org/maven2) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :oozie-sharelib-oozie
I too faced this error while building oozie 4.0.1 in Hadoop 2.5.1. For this build, I have only changed hadoop versions in <OOZIE_BUILD_HOME>/pom.xml
Then I changed the hadoop versions in the below folders and my error is resolved.
<OOZIE_HOME>/hadooplibs/hadoop-2/pom.xml
<OOZIE_HOME>/hadooplibs/hadoop-distcp-2/pom.xml
<OOZIE_HOME>/hadooplibs/hadoop-test-2/pom.xml
+1 on dependencies issue. Try running the following before mvn at the oozie root.
find . -name pom.xml | xargs sed -ri 's/(2.2.0\-SNAPSHOT)/2.5.1/'
Related
I want to use Oozie for automating Spark Jobs. I'm trying to build Oozie using Maven 3.3.9. I have modified pom.xml file for hadoop 2.7.1, java 1.7, hbase 1.2.0, oozie 4.3.0, I got the error described below during ./mkdistro.sh Maven build command. It sounds like it is related to hbase credentials class. what modifications I have to do to pass this error?
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) # oozie-core ---
[INFO] Compiling 517 source files to /usr/lib/oozie/oozie-4.3.0/core/target/classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[28,45] error: package org.apache.hadoop.hbase.security.token does not exist
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[29,45] error: package org.apache.hadoop.hbase.security.token does not exist
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[83,14] error: cannot find symbol
[ERROR] class HbaseCredentials
/usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[84,48] error: cannot find symbol
[ERROR] class HbaseCredentials
/usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[85,29] error: cannot find symbol
[ERROR] class AuthenticationTokenIdentifier
/usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[86,27] error: cannot find symbol
[INFO] 6 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main .................................. SUCCESS [ 2.452 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0 ........... SUCCESS [ 4.780 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0 .......... SUCCESS [ 0.151 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0 Test ....... SUCCESS [ 0.698 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 0.082 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 19.330 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 4.273 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 4.933 s]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [ 1.104 s]
[INFO] Apache Oozie Core .................................. FAILURE [ 11.598 s]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 52.026 s
[INFO] Finished at: 2018-07-25T11:42:47+03:00
[INFO] Final Memory: 127M/797M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:compile (default-compile) on project oozie-core: Compilation failure: Compilation failure:
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[28,45] error: package org.apache.hadoop.hbase.security.token does not exist
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[29,45] error: package org.apache.hadoop.hbase.security.token does not exist
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[83,14] error: cannot find symbol
[ERROR] class HbaseCredentials
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[84,48] error: cannot find symbol
[ERROR] class HbaseCredentials
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[85,29] error: cannot find symbol
[ERROR] class AuthenticationTokenIdentifier
[ERROR] /usr/lib/oozie/oozie-4.3.0/core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java:[86,27] error: cannot find symbol
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[Run command] export MAVEN_OPTS="-Xmx1536m -XX:MaxPermSize=512m" &&
mvn clean install
[Error message] Running org.apache.atlas.web.adapters.TestEntityREST
Tests run: 11, Failures: 1, Errors: 0, Skipped: 8, Time elapsed:
13.995 sec <<< FAILURE! - in org.apache.atlas.web.adapters.TestEntityREST enter code here
cleanup(org.apache.atlas.web.adapters.TestEntityREST) Time elapsed:
0.217 sec <<< FAILURE!
java.lang.NullPointerException: null at org.apache.atlas.RequestContext.clear(RequestContext.java:97) at
org.apache.atlas.web.adapters.TestEntityREST.cleanup(TestEntityREST.java:80)
...
[INFO]
------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Atlas Server Build
Tools .................... SUCCESS [ 1.489 s] [INFO] apache-atlas
....................................... SUCCESS [ 8.805 s] [INFO]
Apache Atlas Integration ........................... SUCCESS [
42.642 s] [INFO] Apache Atlas Common ................................ SUCCESS [ 14.276 s] [INFO] Apache
Atlas Typesystem ............................ SUCCESS [01:15 min]
[INFO] Apache Atlas Client ................................ SUCCESS
[ 17.168 s] [INFO] Apache Atlas Server API
............................ SUCCESS [ 8.440 s] [INFO] Apache Atlas
Notification .......................... SUCCESS [ 38.640 s] [INFO]
Apache Atlas Graph Database Projects ............... SUCCESS [
0.553 s] [INFO] Apache Atlas Graph Database API .................... SUCCESS [ 5.432 s] [INFO] Graph Database Common Code
......................... SUCCESS [ 5.636 s] [INFO] Shaded version
of Apache hbase client .............. SUCCESS [ 10.728 s] [INFO]
Apache Atlas Titan 0.5.4 Graph DB Impl ............. SUCCESS [01:58
min] [INFO] Apache Atlas Graph Database Implementation Dependencies
SUCCESS [ 0.846 s] [INFO] Shaded version of Apache hbase server
.............. SUCCESS [ 23.850 s] [INFO] Apache Atlas Repository
............................ SUCCESS [13:25 min] [INFO] Apache Atlas
Authorization ......................... SUCCESS [ 13.707 s] [INFO]
Apache Atlas Business Catalog ...................... SUCCESS [
31.334 s] [INFO] Apache Atlas UI .................................... SUCCESS [01:11 min] [INFO]
Apache Atlas Web Application ....................... FAILURE [04:29
min] [INFO] Apache Atlas Documentation .........................
SKIPPED [INFO] Apache Atlas FileSystem Model ......................
SKIPPED [INFO] Apache Atlas Plugin Classloader ....................
SKIPPED [INFO] Apache Atlas Hive Bridge Shim ......................
SKIPPED [INFO] Apache Atlas Hive Bridge ...........................
SKIPPED [INFO] Apache Atlas Falcon Bridge Shim ....................
SKIPPED [INFO] Apache Atlas Falcon Bridge .........................
SKIPPED [INFO] Apache Atlas Sqoop Bridge Shim .....................
SKIPPED [INFO] Apache Atlas Sqoop Bridge ..........................
SKIPPED [INFO] Apache Atlas Storm Bridge Shim .....................
SKIPPED [INFO] Apache Atlas Storm Bridge ..........................
SKIPPED [INFO] Apache Atlas Distribution ..........................
SKIPPED [INFO]
------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO]
------------------------------------------------------------------------ [INFO] Total time: 26:06 min [INFO] Finished at:
2017-02-09T01:20:53+09:00 [INFO] Final Memory: 165M/1437M [INFO]
------------------------------------------------------------------------ [ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test
(default-test) on project atlas-webapp: There are test failures.
[ERROR] [ERROR] Please refer to
/Users/dongkillee/dev/bin/atlas/webapp/target/surefire-reports for
the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To
see the full stack trace of the errors, re-run Maven with the -e
switch. [ERROR] Re-run Maven using the -X switch to enable full
debug logging. [ERROR] [ERROR] For more information about the
errors and possible solutions, please read the following articles:
[ERROR] [Help 1]
```
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] [ERROR] After correcting the problems, you can resume the
build with the command [ERROR] mvn -rf :atlas-webapp
This is testcase error. Use following command. It will create your build successfully.
export MAVEN_OPTS="-Xmx1536m -XX:MaxPermSize=512m" && mvn clean install -DskipTests
I have explained the complete solution, here. briefly, cause it uses some test cases in maven plugins in pom.xml file, we need to add -DskipTests argument when building the Apache Atlas from scratch.
Do the following items to run the project without any error:
git clone https://github.com/apache/atlas
mvn clean install -DskipTests
mvn clean package -Pdist -DskipTests
I am running in pseudo-hadoop mode. with following components
- Hadoop v2.7.0
- Java 1.8+
- Oozie 4.2.0
- OS - Fedora 22 VM
- Maven 3.3
I am having no knowledge about Java or Maven and I am completely new to this world of Build with Maven. I was exploring Oozie and wanted to build it , but every time I try to build it , it fails with the below error. I have search blogs and known blogs (people have mentioned gauravkohli blog, but that doesn't help me either) without much help. Can anyone help me out here?
Secondly, though I have followed a few blogs where they have mentioned that only hadoop version needs to be changed, even then I think I need to change the Hbase and other component versions as they are much higher versions than the ones mentioned in ooze Distro, if any inputs on this also would be of great insights.
[INFO]-------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] Apache Oozie Main ..............................SUCCESS [ 1.995 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS [ 15.697 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS [ 1.059 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS [ 0.357 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS [ 0.080 s]
[INFO] Apache Oozie Client ............................SUCCESS [ 10.525 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS [ 8.120 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS [ 4.637 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS [ 1.528 s]
[INFO] Apache Oozie Core ..............................FAILURE [ 5.388 s]
[INFO] Apache Oozie Share Lib Streaming ...................SKIPPED
[INFO] Apache Oozie Share Lib Pig .........................SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ......................SKIPPED
[INFO] Apache Oozie Share Lib Sqoop .......................SKIPPED
[INFO] Apache Oozie Examples ..............................SKIPPED
[INFO] Apache Oozie Share Lib Spark .......................SKIPPED
[INFO] Apache Oozie Share Lib .............................SKIPPED
[INFO] Apache Oozie Docs ..................................SKIPPED
[INFO] Apache Oozie WebApp ............................... SKIPPED
[INFO] Apache Oozie Tools ................................ SKIPPED
[INFO] Apache Oozie MiniOozie .............................SKIPPED
[INFO] Apache Oozie Distro ................................SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests ..............SKIPPED
[INFO]------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]-------------------------------------------------------------
[INFO] Total time: 51.047 s
[INFO] Finished at: 2015-10-11T12:44:19+11:00
[INFO] Final Memory: 96M/230M
[INFO]-------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-remote-resources-plugin:1.5:process (default) on project
oozie-core: Error resolving project artifact: Could not transfer artifact
org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to
Codehaus repository (http://repository.codehaus.org/):
repository.codehaus.org: unknown error for project org.pentaho:pentaho-
aggdesigner-algorithm:jar:5.1.5-jhyde: Unknown host
repository.codehaus.org: unknown error -> [Help 1]
[ERROR]To see the full stack trace of the errors, re-run Maven-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/disp
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
**[edit]Edited: Vishant : 12-Oct-2015**
After doing some research and editing the pom.xml file. I enadbled the
REPO1 and Cloudera repositories, but then I stumbled upon the below
error. I went ahead and checked the REPO1 repository
** DOES NOT have hbase 1.1.2 jars.**
[INFO] ----------------------------------------------------------------
[INFO] Building Apache Oozie Core 4.2.0
[INFO]-----------------------------------------------------------------
[INFO] ----------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main ..............................SUCCESS[2.334 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS[4.010 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS[0.341 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS[0.688 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS[0.066 s]
[INFO] Apache Oozie Client ............................SUCCESS[10.832 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS[4.394 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS[5.641 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS[1.550 s]
[INFO] Apache Oozie Core ..............................FAILURE[0.508 s]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] -------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] -------------------------------------------------------------
[INFO] Total time: 32.115 s
[INFO] Finished at: 2015-10-12T11:03:04+11:00
[INFO] Final Memory: 100M/239M
[INFO] -------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-core: Could not resolve
dependencies for project org.apache.oozie:oozie-core:jar:4.2.0: Failure
to find org.apache.hbase:hbase:jar:1.1.2 in http://repo1.maven.org/maven2
was cached in the local repository, resolution will not be reattempted
until the update interval of central has elapsed or updates are forced
->[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN
/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
How should I proceed with this? How can I add the jars to my local repository and proceed?
It is because Codehaus.org no longer hosts maven repos. You can read more at https://www.codehaus.org/mechanics/maven/
In your pom.xml change the url of Codehaus repository to -> https://repository-master.mulesoft.org/nexus/content/groups/public/
<repository>
<id>Codehaus repository</id>
<url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
My Apologies as I did NOT have privileges to reply to my own question before!!
ANSWER:
I have solved the error. Follow the below steps, but the codehaus stuff doesn't work at all
Step 1. Download the jar file Hbase Jar
Step 2. Edit the pom.xml to point to the jar file,
<dependency>
<groupID>org.apache.hbase</groupID>
<artifactID>hbase</artifactID>
<version>${hbase.version}</version>
<scope>system</scope>
<system>system/path/to/jar/file/myjar.jar</system>
</dependency>
Step 3. Add the Hbase file to the MAVEN repository
mvn install:install-file -Dfile=<path-to-file> -DgroupId=<group-id> \ -DartifactId=<artifact-id> -Dversion=<version> -Dpackaging=<packaging>
EDITED 13-Jan-2016
I added the hbase-common-1.1.2.jar file, as my verison of hbase was 1.1.2. Please add the hbase-common file as per your version of hbase.
I resolve all problems with this pom.xml as below link
oozie-4.2 pom.xml
You can see I change some configuration,including change Codehas respository url
and some others.
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-tools</artifactId>
<version>1.2.1</version>
<!--<version>${distcp.version}</version>-->
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
<version>1.2.1</version>
<!--<version>${hadoop.auth.version}</version>-->
You can try this pom.xml to bulid.
I am new in maven
when I build ,I got this message
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Ambari Main ........................................ SUCCESS [ 2.187 s]
[INFO] Apache Ambari Project POM .......................... SUCCESS [ 0.038 s]
[INFO] Ambari Web ......................................... SUCCESS [ 0.526 s]
[INFO] Ambari Views ....................................... SUCCESS [ 0.248 s]
[INFO] Ambari Admin View .................................. SUCCESS [04:34 min]
[INFO] ambari-metrics ..................................... SUCCESS [ 26.287 s]
[INFO] Ambari Metrics Common .............................. SUCCESS [ 8.582 s]
[INFO] Ambari Metrics Hadoop Sink ......................... SUCCESS [01:07 min]
[INFO] Ambari Metrics Flume Sink .......................... SUCCESS [ 47.242 s]
[INFO] Ambari Metrics Kafka Sink .......................... SUCCESS [ 35.241 s]
[INFO] Ambari Metrics Storm Sink .......................... SUCCESS [02:29 min]
[INFO] Ambari Metrics Collector ........................... FAILURE [02:44 min]
[INFO] Ambari Metrics Monitor ............................. SKIPPED
[INFO] Ambari Metrics Assembly ............................ SKIPPED
[INFO] Ambari Server ...................................... SKIPPED
[INFO] Ambari Agent ....................................... SKIPPED
[INFO] Ambari Client ...................................... SKIPPED
[INFO] Ambari Python Client ............................... SKIPPED
[INFO] Ambari Groovy Client ............................... SKIPPED
[INFO] Ambari Shell ....................................... SKIPPED
[INFO] Ambari Python Shell ................................ SKIPPED
[INFO] Ambari Groovy Shell ................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 12:57 min
[INFO] Finished at: 2015-08-24T09:36:27+08:00
[INFO] Final Memory: 41M/320M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project ambari-metrics-timelineservice: Could not resolve dependencies for project org.apache.ambari:ambari-metrics-timelineservice:jar:2.0.0-SNAPSHOT: Could not find artifact org.apache.ambari:ambari-metrics-common:jar:2.0.0-SNAPSHOT in apache-hadoop (http://repo.hortonworks.com/content/groups/public/) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :ambari-metrics-timelineservice
I have question with this: [ERROR] mvn <goals> -rf :ambari-metrics-timelineservice
what is the <goals> means???
I type mvn <goals> -rf :ambari-metrics-timelineservice in command
it said no directory named goals
Please guide me
You have to substitute <goals> with the actual goals you have called. E.g., if you executed the maven build with mvn clean install, then clean install are the goals, which means, the complete command would be mvn clean install -rf :ambari-metrics-timelineservice.
I tried to compile Spark 1.3.1 using the following flags
mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.6.0 \
-Dscala-2.11 \
-Phive -Phive-0.13.1 -Phive-thriftserver \
-DskipTests clean package
The compilation failed with the following the error.
Any suggestions?
Thanks
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [01:08 min]
[INFO] Spark Project Core ................................. SUCCESS [02:38 min]
[INFO] Spark Project Bagel ................................ SUCCES [ 17.700 s]
[INFO] Spark Project GraphX ............................... SUCCESS [ 35.732 s]
[INFO] Spark Project ML Library ........................... SUCCESS [01:11 min]
[INFO] Spark Project Tools ................................ SUCCESS [ 6.718 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 6.837 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 3.534 s]
[INFO] Spark Project Streaming ............................ SUCCESS [ 43.771 s]
[INFO] Spark Project Catalyst ............................. SUCCESS [ 48.411 s]
[INFO] Spark Project SQL .................................. SUCCESS [ 56.046 s]
[INFO] Spark Project Hive ................................. SUCCESS `enter code here`[01:01 min]
[INFO] Spark Project Assembly ............................. FAILURE [ 6.365 s]
[INFO] Spark Project External Twitter ..................... SKIPPED
[INFO] Spark Project External Flume ....................... SKIPPED
[INFO] Spark Project External Flume Sink .................. SKIPPED
[INFO] Spark Project External MQTT ........................ SKIPPED
[INFO] Spark Project External ZeroMQ ...................... SKIPPED
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Project REPL ................................. SKIPPED
[INFO] Spark Project YARN ................................. SKIPPED
[INFO] Spark Project YARN Shuffle Service ................. SKIPPED
[INFO] Spark Project Hive Thrift Server ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:45 min
[INFO] Finished at: 2015-05-15T11:25:53-06:00
[INFO] Final Memory: 77M/1176M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project spark-assembly_2.10: Could not resolve dependencies for project org.apache.spark:spark-assembly_2.10:pom:1.3.1: Could not find artifact org.apache.spark:spark-hive-thriftserver_2.11:jar:1.3.1 in central (https://repo1.maven.org/maven2) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project spark-assembly_2.10: Could not resolve dependencies for project org.apache.spark:spark-assembly_2.10:pom:1.3.1: Could not find artifact org.apache.spark:spark-hive-thriftserver_2.11:jar:1.3.1 in central (https://repo1.maven.org/maven2)
Seems no dependency of spark-hive-thriftserver_2.11 exists In maven repository, I also search it manually in maven repo and find nothing. I think thrift server is not ready for scala2.11 for now.