Differences between revisions 13 and 14
Revision 13 as of 2010-04-09 20:34:12
Size: 3962
Editor: socks2
Comment:
Revision 14 as of 2010-04-28 01:01:20
Size: 4319
Editor: nat-dip6
Comment:
Deletions are marked like this. Additions are marked like this.
Line 55: Line 55:
==== Download jars and generate code ====
To download the required jars and generate code in src-gen, run 'ant jar' in trunk dir.
Line 56: Line 59:
 * run 'ant eclipse-files' in trunk/ dir.
 * Refresh the project in eclipse
You are all set now!

The 'ant eclipse-files' target does not exist in revisions before r938733, and you have to follow the steps below -

Install Eclipse

Eclipse is an open source development community. If you have not already done so, download and install Eclipse on your development machine. For more information, see Eclipse and Eclipse IDE for Java Developers.

Download and Install the Eclipse Plugins

For Pig, you need the JavaCC plugin and theSubclipse Subversion plugin.

To download and install the plugins:

  1. Open Eclipse
  2. Select Help > Software Updates... > Available Software

  3. Add the two plugin sites by pressing Add Site... Button
  4. http://eclipse-javacc.sourceforge.net

  5. http://subclipse.tigris.org/update_1.4.x

  6. Select the plugins that appear under these sites
  7. Press Install - and follow the prompts to download and install the plugins

Add the Pig Trunk Repository

To add the Pig trunk repository:

  1. Open Eclipse
  2. Select file > New > Other...

  3. Choose SVN, Repository Location > Next

  4. Under the General tab:
  5. URL: http://svn.apache.org/repos/asf/hadoop/pig/trunk

  6. Use a custom label: Pig
  7. Click Finish

To view the results:

  • Window > Open Perspective > Other... > SVN Repository Exploring

  • Window > Show View > SVN Repositories

Create a Java Project

First, create a directory on your development machine (for example "mypig") and checkout the Pig source from SVN: http://svn.apache.org/repos/asf/hadoop/pig/trunk

Note: Windows users need to download and install TortoiseSVN (http://tortoiseSVN.tigris.org/)

To create a Java project:

  1. Open Eclipse
  2. Select file > New > Other ...

  3. Select Java Project
  4. On the New Java Project dialog:
  5. Project name: PigProject

  6. Select: Create project from existing source
  7. Directory: browse to the "mypig" directory on your development machine and select the Trunk directory
  8. Click Next
  9. Click Finish

To view the results:

  • Window > Open Perspective > Java

  • Window > Show View > see the various options ...

Download jars and generate code

To download the required jars and generate code in src-gen, run 'ant jar' in trunk dir.

Update the Build Configuration

  • run 'ant eclipse-files' in trunk/ dir.
  • Refresh the project in eclipse

You are all set now!

The 'ant eclipse-files' target does not exist in revisions before r938733, and you have to follow the steps below -

After the Java project is created, update the build configuration.

To update the build configuration:

  1. Open Eclipse
  2. Select Window > Open Perspective > Java (to open the MyPig project)

  3. Select Project > Properties

  4. For the Java Build Path, check the settings as shown below.

Source

lib-src/bzip2
lib-src/shock
src -> Make sure nothing is excluded
src-gen -> To get this do "ant clean jar" externally which will create this dir (refresh in eclipse to see it)
test -> Make sure nothing is excluded

The default output folder should be bin.

Libraries

lib/hadoopXXX.jar
lib/hbaseXXX-test.jar
lib/hbaseXXX.jar
lib/Pig/zookeeper-hbase-xxx.jar
build/ivy/lib/Pig/javacc.jar
build/ivy/lib/Pig/jline-XXX.jar
build/ivy/lib/Pig/jsch-xxx.jar
build/ivy/lib/Pig/junit-xxx.jar

NOTE:

  1. For pig sources checked out from Apache before revision r771273, replace "build/ivy/lib/Pig" with "lib". Revision r771273 and above in apache svn use ivy to resolve dependencies need to build pig.
  2. If you are building piggybank you will need few extra jars. You can find all of those in build/ivy/lib/Pig/ once you run jar target of ant successfully.

Order and Export

Should have be the following order:

test
lib-src/bzip2
lib-src/shock
src-gen
src
JRE System Library
all the jars from the "Libraries" tab

Troubleshooting

  • Build problems: Check if eclipse is using JDK version 1.6, pig needs it (Under Preferences/Java/Compiler).

Tips

  • To build using eclipse , open the ant window (Windows/Show View/Ant) , then drag and drop build.xml under your project to this window. Double click on jar in that will build pig.jar, on test will run unit tests.

Eclipse_Environment (last edited 2011-08-26 18:42:53 by host1)