Hadoop on Mac OS X
From NeoWiki
(Difference between revisions)
m |
|||
| Line 9: | Line 9: | ||
# Run the Hadoop job JAR file on your development machine, for testing and debugging | # Run the Hadoop job JAR file on your development machine, for testing and debugging | ||
# Run the Hadoop job JAR file on the CAC Hadoop cluster, for production | # Run the Hadoop job JAR file on the CAC Hadoop cluster, for production | ||
| + | |||
| + | |||
| + | ==References== | ||
| + | {{reflist|2}} | ||
Revision as of 02:42, 17 November 2009
From http://www.infosci.cornell.edu/hadoop/mac.html
This guide is written to help Cornell students using Mac OS X 10.5 with setting up a development environment for working with Hadoop [1] and running Hadoop jobs on the Cornell Center for Advanced Computing (CAC) Hadoop cluster. This guide will walk you through compiling and running a simple example Hadoop job. More information is available at the official Hadoop Map-Reduce Tutorial.
The overall process of developing a Hadoop job is as follows:
- Install Hadoop on your development machine (personal or lab computer)
- Compile the Hadoop job, create a JAR file
- Run the Hadoop job JAR file on your development machine, for testing and debugging
- Run the Hadoop job JAR file on the CAC Hadoop cluster, for production
References
1 | references-column-count references-column-count-2 }} }} }}" {{#if: | style="-moz-column-width:{{{colwidth}}}; column-width:{{{colwidth}}};" | {{#if: 2| style="-moz-column-count:2; column-count:2;" }} }}>