[Mageia-discuss] Support of Mageia in BigTop

Bruno Mahe bruno.mahe at laposte.net
Sun Aug 14 02:52:34 CEST 2011


Hi all,

I don't know how many fans of hadoop there are around here, but I
recently added support for Mageia in BigTop. This is not yet checked in
and in a release, but it means anyone can now build or install packages
for the following projects (descriptions taken from their respective
website):
* Hadoop. Project to develop open-source software for reliable,
scalable, distributed computing. http://hadoop.apache.org/
* Flume. A distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of log data.
https://cwiki.apache.org/confluence/display/FLUME/Index
* HBase. An open-source, distributed, versioned, column-oriented store
modeled after Google' Bigtable. http://hbase.apache.org/
* Hive. A data warehouse infrastructure built on top of Apache Hadoop.
http://hive.apache.org/
* Oozie. An open-source workflow/coordination service to manage data
processing jobs for Apache Hadoop. http://yahoo.github.com/oozie/
* Pig. A platform for analyzing large data sets that consists of a
high-level language for expressing data analysis programs, coupled with
infrastructure for evaluating these programs. http://pig.apache.org/
* Sqoop. A tool designed for efficiently transferring bulk data between
Hadoop and structured datastores such as relational
databases.https://cwiki.apache.org/confluence/display/SQOOP/Home
* Whirr. A set of libraries for running cloud services.
http://incubator.apache.org/whirr/
* Zookeeper. An open-source server which enables highly reliable
distributed coordination. http://zookeeper.apache.org/

And on top of that, there is Bigtop which is a project for the
development of packaging and tests of the Hadoop ecosystem


So in effect this brings an entire full fledged open source distributed
computing platform to Mageia.
I am a little bit hesitant about providing a repository yet, but don't
hesitate to give it a try and send some feedback so this can be
improved. If needed I can still send a url to my repository but I don't
guarantee anything :)
If you are also interested in using one of these projects, don't
hesitate to let me know so I can estimate the effort to put in
maintaining a working Mageia version.

Thanks,
Bruno

Note: Big thanks to dmorgan for his invaluable maven 3 efforts. It has
made my work much easier.


More information about the Mageia-discuss mailing list