Sunday, April 21, 2013

Hadoop build error Protocol Buffer symbol not found location: package com.google.protobuf


Error message when building Apache Bigtop
target/compile-proto.sh: line 17: protoc: command not found


There are 2 parts to the Google Protocol Buffer package
1) the protoc compiler which requires a separate download and ./configure, make, sudo make install process

2) the protocol buffer jars which are stored in a maven repo somewhere.

These versions have to match. Read the pom.xml for the failing component, in this case hadoop-common and you see it looks for protobuf version 2.4.1. Download this version, compile and install. The compiler version has to match the jar version....

or else you get error messages which are useless in trying to track down the problem....

Bigtop build requires snappy, protobuf, ant, apache-forrest, jdk-1.5, jdk-1.6, maven.

After installing protobuf 2.4.1 you may need to update xxx and run ldconfig to look for the protobuf libs in /usr/lib64

Add include /usr/lib64/ to /etc/ld.so.conf and run
sudo ldconfig -v to verify /usr/lib64 is on the library path

ldconfig -n /usr/lib64



6 comments:

  1. Hadoop is creating more opportunities to every one. And thanks for sharing best information about hadoop in this blog.
    Hadoop Training in hyderabad

    ReplyDelete
  2. Your posts is really helpful for me.Thanks for your wonderful post. I am very happy to read your post. It is really very helpful for us and I have gathered some important information from this blog.

    Hadoop Training in Chennai

    ReplyDelete
  3. Thanks for sharing this informative blog. If anyone wants to get Big Data Training in Chennai visit fita academy located at Chennai, which offers best Hadoop Training in Chennai with years of experienced professionals.

    ReplyDelete
  4. Cloud Computing Training

    I have read your blog and i got a very useful and knowledgeable information from your blog.its really a very nice article.You have done a great job . If anyone want to get real time Cloud Computing Course in Chennai, Please visit FITA academy located at Chennai Velachery which offer best Cloud Computing Training in Chennai.

    ReplyDelete