100 billion-triple reasoning also impresses the scalable computing crowd

The WebPIE team has been announced as the winners of the 3rd IEEE International Scalable Computing Challenge (SCALE 2010)!

The objective of the Scalable Computing Challenge, sponsored by the IEEE Computer Society Technical Committee on Scalable Computing (TCSC), is “to highlight and showcase real-world problem solving using computing that scales”.  SCALE 2010 was organised as part of CCGRID 2010, the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

The competition involved submitting a paper, giving a presentation, doing a demo, and showing the thing at the demo/poster market.

Together with Niels Drost (from the VUA’s High Performance Distributed Computing group lead by Prof. Henri Bal), LarKC tream-member Jacopo Urbani presented WebPIE, the very large scale Hadoop based inference engine, running on 64 machines of the the DAS-3 compute cluster.  A live visualisation showed the RDF graph growing before the eyes of the audience as WebPIE was racing through its inferences.

For LarKC, winning this price in a strong field of international and top-ranking finalists is all the more important because it shows that our results are not only relevant to the Semantic Web community, but that also the people who are native to scalable computing appreciate the results from the LarKC project.

For more info on WebPIE, see the earlier blog entries here and here.  A recent blog entry explains how to run WebPIE on your own datasets, using the Amazon Elastic Computing Cloud service.

Tags: Distributed computing, hadoop

This entry was posted on Saturday, May 22nd, 2010 at 11:19 pm and is filed under Commodity Resources, HPC, Cloud Computing, Semantic Infrastructure, Uncategorized. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.