[Mageia-discuss] Support of Mageia in BigTop

Colin Guthrie mageia at colin.guthr.ie
Tue Aug 23 15:18:08 CEST 2011


'Twas brillig, and Bruno Mahe at 14/08/11 01:52 did gyre and gimble:
> Hi all,
> 
> I don't know how many fans of hadoop there are around here, but I
> recently added support for Mageia in BigTop. This is not yet checked in
> and in a release, but it means anyone can now build or install packages
> for the following projects (descriptions taken from their respective
> website):
> * Hadoop. Project to develop open-source software for reliable,
> scalable, distributed computing. http://hadoop.apache.org/
> * Flume. A distributed, reliable, and available service for efficiently
> collecting, aggregating, and moving large amounts of log data.
> https://cwiki.apache.org/confluence/display/FLUME/Index
> * HBase. An open-source, distributed, versioned, column-oriented store
> modeled after Google' Bigtable. http://hbase.apache.org/
> * Hive. A data warehouse infrastructure built on top of Apache Hadoop.
> http://hive.apache.org/
> * Oozie. An open-source workflow/coordination service to manage data
> processing jobs for Apache Hadoop. http://yahoo.github.com/oozie/
> * Pig. A platform for analyzing large data sets that consists of a
> high-level language for expressing data analysis programs, coupled with
> infrastructure for evaluating these programs. http://pig.apache.org/
> * Sqoop. A tool designed for efficiently transferring bulk data between
> Hadoop and structured datastores such as relational
> databases.https://cwiki.apache.org/confluence/display/SQOOP/Home
> * Whirr. A set of libraries for running cloud services.
> http://incubator.apache.org/whirr/
> * Zookeeper. An open-source server which enables highly reliable
> distributed coordination. http://zookeeper.apache.org/
> 
> And on top of that, there is Bigtop which is a project for the
> development of packaging and tests of the Hadoop ecosystem
> 
> 
> So in effect this brings an entire full fledged open source distributed
> computing platform to Mageia.
> I am a little bit hesitant about providing a repository yet, but don't
> hesitate to give it a try and send some feedback so this can be
> improved. If needed I can still send a url to my repository but I don't
> guarantee anything :)
> If you are also interested in using one of these projects, don't
> hesitate to let me know so I can estimate the effort to put in
> maintaining a working Mageia version.
> 
> Thanks,
> Bruno
> 
> Note: Big thanks to dmorgan for his invaluable maven 3 efforts. It has
> made my work much easier.


Good work! I'll probably be looking into these systems at some point and
it's nice to know they will be easily available on Mageia :D

Col


-- 

Colin Guthrie
mageia(at)colin.guthr.ie
http://colin.guthr.ie/

Day Job:
  Tribalogic Limited [http://www.tribalogic.net/]
Open Source:
  Mageia Contributor [http://www.mageia.org/]
  PulseAudio Hacker [http://www.pulseaudio.org/]
  Trac Hacker [http://trac.edgewall.org/]



More information about the Mageia-discuss mailing list