The WebMapReduce frontend requires the following:
A webserver (e.g., Apache 2) running PHP 5+, including the following PHP extensions:
cURL (with OpenSSL support)
LDAPor PAM (depending on which authentication option you choose)
The first three extensions need to be compiled into the PHP core, but they may already be present on your installation. PAM comes as an installable module. You can find out what extensions are present on your PHP installation using
phpinfo()
as described
here.
OpenSSL command-line suite
Apache 2 is the officially supported webserver for WebMapReduce; however, any PHP-capable server should work.
The WebMapReduce backend requires the following:
Hadoop 0.20.x
A POSIX-compatible OS (e.g., Linux, Mac OS X, BSD, Solaris) or support layer (e.g., Cygwin)
Java SE 6 or above
Recommended: OpenSSL command-line suite
Recommended: sudo
or an equivalent system that allows unprivileged users to execute commands under other (unprivileged) accounts. (Some OSs have this support built in.)
Additional components may be required to support writing jobs in specific languages. For example, C++ requires GCC and GNU make, while Java requires the JDK. Interpreted languages (Python, Java, Scheme, etc.) require their interpreters to be installed on all Hadoop nodes.