Click here to receive your FREE subscription to Campus Technology
News
Carnegie Mellon To Engage Yahoo! Open Source Supercomputing Project
11/13/2007
Carnegie Mellon University will become the first higher education institution to work with Yahoo!'s M45, a new project announced yesterday by the Internet firm designed to advance distributed computing research and software development. The program, which leverages the Apache Software Foundation's open-source Hadoop, will allow researchers to test software running on a Yahoo!-provided 4,000-processor supercomputer.According to Yahoo!, its M45 project differs from other supercomputing projects in that it's focused exclusively on "pushing the boundaries of large-scale systems software research." For the program, Yahoo! will make available to researchers a 4,000-processor computing cluster capable of performing 27 teraFLOPS and sporting 3 TB of memory and 1.5 petabytes of storage. It will run the latest version of Hadoop (to which Yahoo! is one of the principal contributors) and other open-source software, including, according to Yahoo!, the Pig parallel programming language.
“Hadoop has become an important computing environment for data-intensive applications and Yahoo! is playing a leading role in its development. We are excited about collaborating with Yahoo! on systems software research, helping to advance the state of the art, and creating new research possibilities in this critical area,” said Randall E. Bryant, dean of the School of Computer Science at Carnegie Mellon, in a statement released yesterday. “We look forward to working with Yahoo! and jointly contributing back to the open source community.”
Carnegie Mellon, for its part, will be the first institution to use the system. CMU professors Garth Gibson and Greg Ganger will "instrument the system and evaluate its performance," according to Yahoo! "Simultaneously, Carnegie Mellon computer science professors Jamie Callan and Christos Faloutsos, academic leaders in text and Web mining, will solve challenging information retrieval and large-scale graph problems on the cluster. Carnegie Mellon faculty members Alexei Efros, Noah Smith, and Stephan Vogel will also use the cluster to tackle large-scale computer graphics, natural language processing, and machine translation problems, respectively."
CMU is also involved in Google/IBM's parallel computing initiative, a pilot academic program also centered around Hadoop and a large-scale processor cluster.
Yahoo! said it plans to make M45 available to other institutions for research in the future.
Read More:
About the author: Dave Nagel is the executive editor for 1105 Media's educational technology online publications and electronic newsletters. He can be reached at dnagel@1105media.com.
Have any additional questions? Want to share your story? Want to pass along a news tip? Contact Dave Nagel, executive editor, at dnagel@1105media.com.
Cite this Site
copy text (above) for proper citation
Recommended Reading
- Utah Rolls Out Online Document Proofreading
The University of Utah has acquired a site license of CyProof's ErrNET for online document proofreading. ErrNET runs on CyProof's servers and is accessed through the user's Web browser. To check a document, users upload their files to the Web site, the cost is calculated, payment is requested, the document is processed, and the results are presented for download. The service works with PDF files.
- Payment Standard for Web Apps Goes Live
A new payment card industry (PCI) standard for Web application firewalls and source code went into effect July 1. PCI Industry Data Security standard 6.6 gives merchants a framework to ensure that the point-of-sale information uploaded into browser-based applications is sound from "top to bottom," the organization's literature said.
- U Texas San Antonio To Deploy Wireless Outdoor Emergency Notifications
The University of Texas at San Antonio has selected Cooper Notification's Wireless Audio Visual Emergency System (WAVES) Mass Notification System (MNS) for its outdoor campus emergency notification system. Through WAVES campus public safety departments can broadcast targeted voice alerts via "Giant Voice" to students, faculty, staff, and visitors.
- Moraine Valley CC Revamps Administrative Systems
Moraine Valley Community College in Illinois has selected Datatel Colleague and ActiveCampus Portal software to replace a legacy administration system. A committee consisting of campus-wide representatives chose Datatel after an 18-month evaluation of administrative software systems.
- Project Wonderland: Good Avatars Make Good Neighbors
Sun Microsystems's Project Darkstar and the Wonderland Toolkit for building 3D spaces show why virtual reality is better for education than video conferencing. And Project Wonderland has announced its first education space.
- Sun, Stanford Working To Archive History
In May in San Francisco, experts from leading universities, libraries, and research institutions around the world met as part of an ongoing effort to address a pressing issue: archiving the world's history, right up to today.
