Recent News in the CCL


CCTools Release 2.4.6

We are pleased to announce release 2.4.6 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here:

http://www.cse.nd.edu/~ccl/software/download.shtml

This version rolls up a number of minor bug fixes in Parrot and Chirp. Thanks to Ismail Ataturk, Karen Hollingsworth, Nathan Regola, Yushu Yao, for their contributions.

Friday, October 31, 2008 - Permalink



Abstractions at CCA08

Prof. Thain gave a talk titled "Programming Distributed Systems with High Level Abstractions" at the Cloud Computing and Applications Workshop held at the University of Chicago on October 23.

Sunday, October 26, 2008 - Permalink



ENAVis at LISA 2008

Qi Liao will present a paper on ENAVis, a dynamic visualization of user, program, and network data collected by the Lockdown enterprise system management tool.

Thursday, October 23, 2008 - Permalink



Abstractions for Data Mining at ICDM

Chris Moretti and Karsten Steinhauser recently had a paper Scaling Up Classifiers to Cloud Computers accepted at the International Conference on Data Mining in Pisa, Italy. This paper describes a high level abstractions for running stanrdard data mining algorithms on systems of hundreds of CPUs.

Wednesday, October 22, 2008 - Permalink



CCTools 2.4.4 Released

We are pleased to announce release 2.4.4 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here:

http://www.cse.nd.edu/~ccl/software/download.shtml

A recent version of the patched Red Hat kernel installed by up2date inhibits access to the special file /proc/X/mem, which caused previous versions of Parrot to stop functioning with the error "Permission denied."

This release works around that bug in the kernel.

Monday, August 25, 2008 - Permalink



Troubleshooting at Grid 2008

David Cieslak will present a paper titled Troubleshooting Thousands of Jobs on Production Computing Grids Using Data Mining Techniques at Grid 2008 in Japan. This work demonstrates techniques for drawing conclusions such as "Your jobs fail on Linux 2.4 with less than 16GB RAM" from complex workloads of thousands of jobs.

Wednesday, June 25, 2008 - Permalink



Datalab at HPDC 2008

Brandon Rich presented a poster on DataLab: Active Storage for Data Drive Scientific Computing at High Performance Distributed Computing in Boston. DataLab is a system for robustly performing large data parallel workloads on hundreds of active storage nodes, using distributed transaction concepts to create a robust system.

Wednesday, June 25, 2008 - Permalink



CCTools 2.4.3 Released

We are pleased to announce release 2.4.3 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here.

Major items in this release:

  1. New documentation for the Chirp APIs
  2. Improvements to the Chirp server:
    • New support for streaming I/O and server-side FIFOs
    • New support for complex path names using RFC 2396 encoding.
    • New P right that allows a user only to put new files.
  3. Improvements to the Chirp clients:
    • Strided I/O routines for array access.
    • Client interfaces for streaming I/O.
    • Improvement to the build flags that make it easier for other programs to compile against Chirp.
  4. Miscellaneous bug fixes:
    • Fixed case where server improperly returns "permission denied" instead of "file not found".es in the server.

Wednesday, June 11, 2008 - Permalink



NSF Summer REU Grant

The CCL has received a grant from the National Science Foundation which will support two undergraduates in summer 2008 to participate in the construction of a novel repository for biometric data.

Researchers at Notre Dame have collected tens of thousands of such images and videos, and design new algorithms for identifying and matching people based upon these measurements. Answering these questions is very computation and data intensive. A large scale study of a new matching algorithm could take many CPU years to complete. To attack these problems in a reasonable amount of time, we must enlist hundreds of CPUs to work on different portions of the problem. While we have demonstrated the practicality of this idea with some custom programming, the overall system is not (yet) easy to use for end researchers. To solve this problem, the participants in this program will construct a well-organized repository of biometric data, connect it to our campus distributed computing system, and create an interface that makes it easy to specify and execute large biometric jobs.

  • CCL REU Program
  • Distributed Computing for Biometrics
  • Sunday, June 01, 2008 - Permalink



    CCL to Participate in Google/IBM Cluster Pilot

    In the 2008-2009 school year, junior and senior students in the CSE department will have the opportunity to learn techniques for large scale computing on clusters used by large internet service providers. Google and IBM have announced the 2008 Academic Cluster Initiative, which will provide a 1000-node machine for use by university students around the country. Students in Professor Douglas Thain's distributed systems and operating systems classes will learn how to write large data intensive programs in languages such as Map-Reduce on this cluster.

    Tuesday, May 20, 2008 - Permalink



    Papers at IPDPS 2008

    At IPDPS 2008 in Miami, Chris Moretti presented All-Pairs: An Abstraction for Data Intensive Cloud Computing, and Kyle Wheeler presented QThreads: An API for Programming with millions of Lightweight Threads.

    Tuesday, April 01, 2008 - Permalink



    Parrot Flies at Fermilab

    Parrot and the GROW filesystem are in production use at Fermi National Laboratory. The CDF experiment exploits the open Science Grid to run a large number of monte carlo simulations. Because the simulation code is highly complex and not practical to install at all sites, Parrot and the GROW filesystem are used to access the software on demand from Fermilab. More details here.

    Tuesday, January 01, 2008 - Permalink


    Recent News
    CCTools Release 2.4.6 - We are pleased to announce release 2.4.6 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here: ...more

    Abstractions at CCA08 - Prof. Thain gave a talk titled "Programming Distributed Systems with High Level Abstractions" at the Cloud Computing and Applications Workshop held ...more

    ENAVis at LISA 2008 - Qi Liao will present a paper on ENAVis, a dynamic visualization of user, program, and network data collected by the Lockdown enterprise system managem...more

    Abstractions for Data Mining at ICDM - Chris Moretti and Karsten Steinhauser recently had a paper Scaling Up Classifiers to Cloud Computers accepted at the International Conference on Dat...more

    CCTools 2.4.4 Released - We are pleased to announce release 2.4.4 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here: ...more

    Troubleshooting at Grid 2008 - David Cieslak will present a paper titled Troubleshooting Thousands of Jobs on Production Computing Grids Using Data Mining Techniques at Grid 2008 in...more

    See More News

    Cooperative Computing Lab - CSE Department - Notre Dame