Building Hadoop cannot access org.mortbay.component.AbstractLifeCycle error or class file for org.mortbay.component.AbstractLifeCycle not found

Here is a snippet of the error message I got.


[ERROR] /home/dc/bigtop-0.6.0/build/hadoop/rpm/BUILD/hadoop-2.0.5-alpha-src/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[86,13] cannot access org.mortbay.component.AbstractLifeCycle
class file for org.mortbay.component.AbstractLifeCycle not found
    server = new Server(0);
[ERROR] /home/dc/bigtop-0.6.0/build/hadoop/rpm/BUILD/hadoop-2.0.5-alpha-src/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[96,29] cannot access org.mortbay.component.LifeCycle
class file for org.mortbay.component.LifeCycle not found
    server.getConnectors()[0].setHost(host);
[ERROR] /home/dc/bigtop-0.6.0/build/hadoop/rpm/BUILD/hadoop-2.0.5-alpha-src/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[98,10] cannot find symbol
symbol  : method start()
location: class org.mortbay.jetty.Server
[ERROR] /home/dc/bigtop-0.6.0/build/hadoop/rpm/BUILD/hadoop-2.0.5-alpha-src/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java:[104,12] cannot find symbol
symbol  : method stop()
location: class org.mortbay.jetty.Server

There are a bunch of web posts on this error. A large percentage of the web posts instruct the user to delete the m2 repo. This won't work. Here is an example of a post.

There is a patch which fixes this problem. The author of the patch adds a maven dependency called jetty-util. 

Let's figure out why this is correct. 

You can look at the contents of jetty jars. The pom for this class hadoop-2.0.5-alpha-src/hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/client/AuthenticatorTestCase.java is under the hadoop-auth directory. 

This error is because it can't find org.jetty.components where the Lifecycle and AbstractLifecycle classes are. 

There is one dependency for jetty in the pom.xml file which is: 

      >groupid<org.mortbay.jetty

      jetty

      test

Fortunately there is a website which shows the classes for maven jetty artifacts which correspond to jars. This is much easier than having to track down the jars, expanding them to look for classes or tracking down the source and looking for packages. 

http://grepcode.com/project/repo1.maven.org/maven2/org.mortbay.jetty/jetty/ shows the Jetty versions for the jetty artifact. Click on version 6.0.26 and you can see there is no org.mortbay.component package where org/mortbay/component/AbstractLifeCycle.java should be. 

Change the url to jetty-util to 

http://grepcode.com/project/repo1.maven.org/maven2/org.mortbay.jetty/jetty-util/ and click under 6.0.26 and you can see there is a org.mortbay.component package

Add this dependency to the pom.xml file under hadoop-2.0.6-alpha-src/hadoop-common-project/hadoop-auth/pom.xml

     

      org.mortbay.jetty

      jetty-util

      test
     

which you can also do by downloading the patch text file and running the patch command. If you are using bigtop to build, make the change to the source code, tar and gz the source code, place it under dl, delete the hadoop directory under build/ and run >make rpm again to see the error go away.