Skip to main content.

Computing with HTCondor™

Our goal is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources. Guided by both the technological and sociological challenges of such a computing environment, the Center for High Throughput Computing at UW-Madison has been building the open source HTCondor distributed computing software (pronounced "aitch-tee-condor") and related technologies to enable scientists and engineers to increase their computing throughput.

Note: The HTCondor software was known as 'Condor' from 1988 until its name changed in 2012. If you are looking for Phoenix Software International's software development and library management system for z/VSE or z/OS, click here.

Latest News [RSS]

HTCondor-CE 4.4.0 released!

June 16, 2020

The HTCondor team is pleased to announce the release of HTCondor-CE 4.4.0. Highlights of this release are: Add plug-in interface to HTCondor-CE View and separate out OSG-specific code and configuration; Add configuration option (COMPLETED_JOB_EXPIRATION) for how many days completed jobs may stay in the queue; Replace APEL uploader SchedD cron with init and systemd services; Fix HTCondor-CE View SchedD query that caused "Info" tables to be blank; Add the CE registry web application to the Central Collector; Identify broken job routes upon startup; Add benchmarking parameters to the BDII provider via `HTCONDORCE_SPEC` in the configuration; Fix handling of unmapped GSI users in the Central Collector; Fix reference to old BDII configuration values; Drop vestigial Central Collector configuration generator script and service; Fix unmapped GSI/SSL regular expressions and allow unmapped entities to advertise to the Central Collector; Add SSL support for reporting to Central Collectors; GLUE2 validation improvements for the BDII provider. A complete list of new features and fixed bugs can be found in the version history. HTCondor-CE 4.4.0 binaries are available from our YUM Repository.
HTCondor-CE 3.4.2 released!

June 16, 2020

The HTCondor team is pleased to announce the release of HTCondor-CE 3.4.2. Highlights of this release are: Identify broken job routes upon startup; Add benchmarking parameters to the BDII provider via `HTCONDORCE_SPEC` in the configuration; Replace APEL uploader SchedD cron with init and systemd services; Fix reference to old BDII configuration values; Improvements to the GLUE2 validation for the BDII provider. A complete list of new features and fixed bugs can be found in the version history. HTCondor-CE 3.4.2 binaries are available from our YUM Repository.
HTCondor 8.9.7 released!

May 20, 2020

The HTCondor team is pleased to announce the release of HTCondor 8.9.7. This development series release contains new features that are under development. This release contains all of the bug fixes from the 8.8.9 stable release. Enhancements in the release include: Multiple enhancements in the file transfer code; Support for more regions in s3:// URLs; Much more flexible job router language; Jobs may now specify cuda_version to match equally-capable GPUs; TOKENS are now called IDTOKENS to differentiate from SCITOKENS; Added the ability to blacklist TOKENS via an expression; Can simultaneously handle Kerberos and OAUTH credentials; The getenv submit command now supports a blacklist and whitelist; The startd supports a remote history query similar to the schedd; condor_q -submitters now works with accounting groups; Fixed a bug reading service account credentials for Google Compute Engine. Further details can be found in the Development Version History and the Stable Version History. HTCondor 8.9.7 binaries and source code are available from our Downloads page.
HTCondor 8.8.9 released!

May 7, 2020

The HTCondor team is pleased to announce the release of HTCondor 8.8.9. A stable series release contains significant bug fixes. Highlights of this release are: Proper tracking of maximum memory used by Docker universe jobs Fixed preempting a GPU slot for a GPU job when all GPUs are in use; Fixed a Python crash when queue_item_data iterator raises an exception; Fixed a bug where slot attribute overrides were ignored; Calculates accounting group quota correctly when more than 1 CPU requested; Updated HTCondor Annex to accommodate API change for AWS Spot Fleet; Fixed a problem where HTCondor would not start on AWS Fargate; Fixed where the collector could wait forever for a partial message; Fixed streaming output to large files (>2Gb) when using the 32-bit shadow. More details about the fixes can be found in the Version History. HTCondor 8.8.9 binaries and source code are available from our Downloads page.
HTCondor Security Release: 8.8.8 and 8.9.6

April 7, 2020

The HTCondor team is pleased to announce the release of HTCondor 8.8.8 and HTCondor 8.9.6. These releases contain important fixes for security issues. Affected users should update as soon as possible. More details on the security issues are in the Vulnerability Reports: HTCondor binaries and source code are available from our Downloads page.
Re-release of 8.9.5 deb Packages for Debian and Ubuntu

February 25, 2020

The HTCondor team is re-releasing the HTCondor 8.9.5 deb packages for Debian and Ubuntu. An error caused the Python bindings to be placed in the wrong directory, rendering them nonfunctional.

Save the date!

The European HTCondor Workshop 2020 will take place from Monday Sept 21 until Friday Sept 25. It will be an online virtual event scheduled for convenient access for attendees in European time zones; we'll announce more detail in August about registration and times.

Software

Community

Research and Development