| The Cooperative Computing Lab | |
Research | |
| Projects | Papers |
| People | Jobs |
| Events | REU |
| News | Blog |
Software | |
| Chirp | Downloads |
| Parrot | Manuals |
| FTSH | API |
| AllocFS | How-To |
| Datalab | Mailing List |
Operations Visual Status Storage Pool Condor Pool Hadoop Cluster Cert Authority
| |
Recent News in the CCL
CCTools Release 2.4.6
We are pleased to announce release 2.4.6 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here:http://www.cse.nd.edu/~ccl/software/download.shtml
This version rolls up a number of minor bug fixes in Parrot and Chirp. Thanks to Ismail Ataturk, Karen Hollingsworth, Nathan Regola, Yushu Yao, for their contributions.
Friday, October 31, 2008 - Permalink
Abstractions at CCA08
Prof. Thain gave a talk titled "Programming Distributed Systems with High Level Abstractions" at the Cloud Computing and Applications Workshop held at the University of Chicago on October 23.Sunday, October 26, 2008 - Permalink
ENAVis at LISA 2008
Qi Liao will present a paper on ENAVis, a dynamic visualization of user, program, and network data collected by the Lockdown enterprise system management tool.Thursday, October 23, 2008 - Permalink
Abstractions for Data Mining at ICDM
Chris Moretti and Karsten Steinhauser recently had a paper Scaling Up Classifiers to Cloud Computers accepted at the International Conference on Data Mining in Pisa, Italy. This paper describes a high level abstractions for running stanrdard data mining algorithms on systems of hundreds of CPUs.Wednesday, October 22, 2008 - Permalink
CCTools 2.4.4 Released
We are pleased to announce release 2.4.4 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here:http://www.cse.nd.edu/~ccl/software/download.shtml
A recent version of the patched Red Hat kernel installed by up2date inhibits access to the special file /proc/X/mem, which caused previous versions of Parrot to stop functioning with the error "Permission denied."
This release works around that bug in the kernel.
Monday, August 25, 2008 - Permalink
Troubleshooting at Grid 2008
David Cieslak will present a paper titled Troubleshooting Thousands of Jobs on Production Computing Grids Using Data Mining Techniques at Grid 2008 in Japan. This work demonstrates techniques for drawing conclusions such as "Your jobs fail on Linux 2.4 with less than 16GB RAM" from complex workloads of thousands of jobs.Wednesday, June 25, 2008 - Permalink
Datalab at HPDC 2008
Brandon Rich presented a poster on DataLab: Active Storage for Data Drive Scientific Computing at High Performance Distributed Computing in Boston. DataLab is a system for robustly performing large data parallel workloads on hundreds of active storage nodes, using distributed transaction concepts to create a robust system.Wednesday, June 25, 2008 - Permalink
CCTools 2.4.3 Released
We are pleased to announce release 2.4.3 of the Cooperative Computing Tools, including Parrot, Chirp, and other tools which may be downloaded here.Major items in this release:
- New documentation for the Chirp APIs
- Improvements to the Chirp server:
- New support for streaming I/O and server-side FIFOs
- New support for complex path names using RFC 2396 encoding.
- New P right that allows a user only to put new files.
- Improvements to the Chirp clients:
- Strided I/O routines for array access.
- Client interfaces for streaming I/O.
- Improvement to the build flags that make it easier for other programs to compile against Chirp.
- Miscellaneous bug fixes:
- Fixed case where server improperly returns "permission denied" instead of "file not found".es in the server.
Wednesday, June 11, 2008 - Permalink
NSF Summer REU Grant
The CCL has received a grant from the National Science Foundation which will support two undergraduates in summer 2008 to participate in the construction of a novel repository for biometric data.Researchers at Notre Dame have collected tens of thousands of such images and videos, and design new algorithms for identifying and matching people based upon these measurements. Answering these questions is very computation and data intensive. A large scale study of a new matching algorithm could take many CPU years to complete. To attack these problems in a reasonable amount of time, we must enlist hundreds of CPUs to work on different portions of the problem. While we have demonstrated the practicality of this idea with some custom programming, the overall system is not (yet) easy to use for end researchers. To solve this problem, the participants in this program will construct a well-organized repository of biometric data, connect it to our campus distributed computing system, and create an interface that makes it easy to specify and execute large biometric jobs.
Sunday, June 01, 2008 - Permalink
CCL to Participate in Google/IBM Cluster Pilot
In the 2008-2009 school year, junior and senior students in the CSE department will have the opportunity to learn techniques for large scale computing on clusters used by large internet service providers. Google and IBM have announced the 2008 Academic Cluster Initiative, which will provide a 1000-node machine for use by university students around the country. Students in Professor Douglas Thain's distributed systems and operating systems classes will learn how to write large data intensive programs in languages such as Map-Reduce on this cluster.Tuesday, May 20, 2008 - Permalink
Papers at IPDPS 2008
At IPDPS 2008 in Miami, Chris Moretti presented All-Pairs: An Abstraction for Data Intensive Cloud Computing, and Kyle Wheeler presented QThreads: An API for Programming with millions of Lightweight Threads.Tuesday, April 01, 2008 - Permalink
Parrot Flies at Fermilab
Parrot and the GROW filesystem are in production use at Fermi National Laboratory. The CDF experiment exploits the open Science Grid to run a large number of monte carlo simulations. Because the simulation code is highly complex and not practical to install at all sites, Parrot and the GROW filesystem are used to access the software on demand from Fermilab. More details here.Tuesday, January 01, 2008 - Permalink
Recent News
See More News