Computing with HTCondor™
Our goal is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources. Guided by both the technological and sociological challenges of such a computing environment, the Center for High Throughput Computing at UW-Madison has been building the open source HTCondor distributed computing software (pronounced "aitch-tee-condor") and related technologies to enable scientists and engineers to increase their computing throughput.
Note: The HTCondor software was known as 'Condor' from 1988 until its name changed in 2012.
If you are looking for Phoenix Software International's software development and library management system for z/VSE or z/OS, click here.
Latest News ![[RSS]](images/rssicon.gif)
HTCondor helps LIGO confirm last unproven Albert Einstein theory March 8, 2016
This
Morgridge Institute news article
explains the rich back-story of HTCondor's role behind the recent announcement that
scientists from the Laser Interferometer Gravitational-Wave Observatory (LIGO) unlocked the final
door to Einstein's Theory of Relativity. More than 700 LIGO scientists have used HTCondor
to run complex data analysis workflows, accumulating 50 million core-hours
in the past six months alone.
ATLAS and BNL Bring Amazon EC2 Online March 2, 2016
This
Open Science Grid news article
discusses how a pilot project at the RHIC/ATLAS Computing Facility
(RACF) at Brookhaven National Laboratory has used HTCondor-G to
incorporate virtual machines from Amazon's Amazon’s Elastic Compute
Cloud (EC2) spot market into a scientific computation platform.
The ATLAS experiment is moving towards using commercial clouds
for computation as budget constraints make maintaining dedicated
data centers more difficult.
OSG computational power helps solve 30-year old protein puzzle March 2, 2016
This
Open Science Grid news article
discusses how the Baker Lab at the University of Washington has
used HTCondor and the OSG to successfully simulate the cylindrical
TIM-barrel (triosephosphate isomerase-barrel) protein fold, which
has been a challenge for nearly 30 years.
TIM-barrel protein folds occur widely in enzymes, meaning that
understanding them is important for applications such as the
development of new vaccines.
The Baker Lab performed about 2.4 million core hours of
computation on the OSG in 2015.
HTCondor helps to find gravitational waves February 22, 2016
This
Open Science Grid news article
discusses the role of HTCondor, Pegasus and the Open Science Grid in the
recently-announced discovery of gravitational waves by the Laser
Interferometer Gravitational-Wave Observatory (LIGO).
LIGO used a single HTCondor-based system to run computations across
LIGO Data Grid, OSG and Extreme Science and Engineering Discovery
Environment (XSEDE)-based resources, and consumed 3,956,910 compute
hours on OSG.
HTCondor 8.5.2 released! February 18, 2016
The HTCondor team is pleased to announce the release of HTCondor 8.5.2.
This development series release contains new features that are under
development. This release contains all of the bug fixes from the 8.4.4
stable release.
Enhancements in the release include:
condor_q now defaults to showing only the current user's jobs;
condor_q -batch produces a single line report for a batch of jobs;
Docker Universe jobs now report and update memory and network usage;
immutable and protected job attributes;
improved performance when querying a HTCondor daemon's location;
Added the ability to set ClassAd attributes within the DAG file;
DAGMan now provides event timestamps in dagman.out.
Further details can be found in the
Version History.
HTCondor 8.5.2 binaries and source code are available from our
Downloads page.
HTCondor 8.4.4 released! February 2, 2016
The HTCondor team is pleased to announce the release of HTCondor 8.4.4.
A stable series release contains significant bug fixes.
Highlights of this release are:
fixed a bug that could cause the collector to crash when DNS lookup fails;
fixed a bug that caused Condor-C jobs with short lease durations to fail;
fixed bugs that affected EC2 grid universe jobs;
fixed a bug that prevented startup if a prior version shared port file exists;
fixed a bug that could cause the condor_shadow to hang on Windows;
a few other bug fixes, consult the version history.
Further details can be found in the
Version History.
HTCondor 8.4.4 binaries and source code are available from our
Downloads page.
Registration open for Barcelona Workshop for HTCondor / ARC CE January 28, 2016
*REGISTRATION IS NOW OPEN* (until 22nd Feb.)!! The workshop fee is 80
EUROS (VAT included), which covers the lunches and all coffee breaks
along the event. The list of recommended hotels, instructions for fee
payment, and how to get to the venue is available in the workshop homepage.
Re-release of RPMs for HTCondor 8.4.3 and 8.5.1 January 8, 2016
The HTCondor team is re-releasing the RPMs for 8.4.3 and 8.5.1.
A recent change to correct problems with Standard Universe in the
RPM packaging resulted in unoptimized binaries to be packaged.
The new RPMs have optimized binaries.