Skip to main content.

Computing with HTCondor™

Our goal is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources. Guided by both the technological and sociological challenges of such a computing environment, the Center for High Throughput Computing at UW-Madison has been building the open source HTCondor distributed computing software (pronounced "aitch-tee-condor") and related technologies to enable scientists and engineers to increase their computing throughput.

Note: The HTCondor software was known as 'Condor' from 1988 until its name changed in 2012. If you are looking for Phoenix Software International's software development and library management system for z/VSE or z/OS, click here.

Save the date:
HTCondor Week

May 17-20, 2016
Madison, Wisconsin, USA

Latest News [RSS]

HTCondor helps LIGO confirm last unproven Albert Einstein theory

March 8, 2016

This Morgridge Institute news article explains the rich back-story of HTCondor's role behind the recent announcement that scientists from the Laser Interferometer Gravitational-Wave Observatory (LIGO) unlocked the final door to Einstein's Theory of Relativity. More than 700 LIGO scientists have used HTCondor to run complex data analysis workflows, accumulating 50 million core-hours in the past six months alone.
ATLAS and BNL Bring Amazon EC2 Online

March 2, 2016

This Open Science Grid news article discusses how a pilot project at the RHIC/ATLAS Computing Facility (RACF) at Brookhaven National Laboratory has used HTCondor-G to incorporate virtual machines from Amazon's Amazon’s Elastic Compute Cloud (EC2) spot market into a scientific computation platform. The ATLAS experiment is moving towards using commercial clouds for computation as budget constraints make maintaining dedicated data centers more difficult.
OSG computational power helps solve 30-year old protein puzzle

March 2, 2016

This Open Science Grid news article discusses how the Baker Lab at the University of Washington has used HTCondor and the OSG to successfully simulate the cylindrical TIM-barrel (triosephosphate isomerase-barrel) protein fold, which has been a challenge for nearly 30 years. TIM-barrel protein folds occur widely in enzymes, meaning that understanding them is important for applications such as the development of new vaccines. The Baker Lab performed about 2.4 million core hours of computation on the OSG in 2015.
HTCondor helps to find gravitational waves

February 22, 2016

This Open Science Grid news article discusses the role of HTCondor, Pegasus and the Open Science Grid in the recently-announced discovery of gravitational waves by the Laser Interferometer Gravitational-Wave Observatory (LIGO). LIGO used a single HTCondor-based system to run computations across LIGO Data Grid, OSG and Extreme Science and Engineering Discovery Environment (XSEDE)-based resources, and consumed 3,956,910 compute hours on OSG.
HTCondor 8.5.2 released!

February 18, 2016

The HTCondor team is pleased to announce the release of HTCondor 8.5.2. This development series release contains new features that are under development. This release contains all of the bug fixes from the 8.4.4 stable release. Enhancements in the release include: condor_q now defaults to showing only the current user's jobs; condor_q -batch produces a single line report for a batch of jobs; Docker Universe jobs now report and update memory and network usage; immutable and protected job attributes; improved performance when querying a HTCondor daemon's location; Added the ability to set ClassAd attributes within the DAG file; DAGMan now provides event timestamps in dagman.out. Further details can be found in the Version History. HTCondor 8.5.2 binaries and source code are available from our Downloads page.
HTCondor 8.4.4 released!

February 2, 2016

The HTCondor team is pleased to announce the release of HTCondor 8.4.4. A stable series release contains significant bug fixes. Highlights of this release are: fixed a bug that could cause the collector to crash when DNS lookup fails; fixed a bug that caused Condor-C jobs with short lease durations to fail; fixed bugs that affected EC2 grid universe jobs; fixed a bug that prevented startup if a prior version shared port file exists; fixed a bug that could cause the condor_shadow to hang on Windows; a few other bug fixes, consult the version history. Further details can be found in the Version History. HTCondor 8.4.4 binaries and source code are available from our Downloads page.
Registration open for Barcelona Workshop for HTCondor / ARC CE

January 28, 2016

*REGISTRATION IS NOW OPEN* (until 22nd Feb.)!! The workshop fee is 80 EUROS (VAT included), which covers the lunches and all coffee breaks along the event. The list of recommended hotels, instructions for fee payment, and how to get to the venue is available in the workshop homepage.
Re-release of RPMs for HTCondor 8.4.3 and 8.5.1

January 8, 2016

The HTCondor team is re-releasing the RPMs for 8.4.3 and 8.5.1. A recent change to correct problems with Standard Universe in the RPM packaging resulted in unoptimized binaries to be packaged. The new RPMs have optimized binaries.

Software

Community

Research and Development