Skip to main content.

Computing with HTCondor™

Our goal is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources. Guided by both the technological and sociological challenges of such a computing environment, the Center for High Throughput Computing at UW-Madison has been building the open source HTCondor distributed computing software (pronounced "aitch-tee-condor") and related technologies to enable scientists and engineers to increase their computing throughput.

Note: The HTCondor software was known as 'Condor' from 1988 until its name changed in 2012. If you are looking for Phoenix Software International's software development and library management system for z/VSE or z/OS, click here.

Latest News [RSS]

Using 50k GPUs in one HTCondor cloud-based pool

December 6, 2019

Read about how at SC19 UCSD got over 50k GPUs from the three largest Cloud providers, and integrated them in a single a HTCondor pool to run production science jobs. At peak, this cloud-based dynamic HTCondor cluster provided more than 90% of the performance of the #1 TOP100 HPC supercomputer.
HTCondor 8.8.6 released!

November 13, 2019

The HTCondor team is pleased to announce the release of HTCondor 8.8.6. A stable series release contains significant bug fixes. Highlights of this release are: Initial support for CentOS 8; Fixed a memory leak in SSL authentication; Fixed a bug where "condor_submit -spool" would only submit the first job; Reduced encrypted file transfer CPU usage by a factor of six; "condor_config_val -summary" displays changes from a default configuration; Improved the ClassAd documentation, added many functions that were omitted. More details about the fixes can be found in the Version History. HTCondor 8.8.6 binaries and source code are available from our Downloads page.
HTCondor-CE 4.0.1 released!

November 7, 2019

The HTCondor team is pleased to announce the release of HTCondor-CE 4.0.1. HTCondor-CE is a gateway for grid jobs to be run on your local resources. HTCondor-CE was originally developed by the Open Science Grid (OSG). The Center for High-Throughput Computing (CHTC) now distributes and supports HTCondor-CE for use outside of the OSG. SciTokens are supported if using a recent version of HTCondor compiled with SciTokens. A complete list of new features and fixed bugs can be found in the version history. HTCondor-CE 4.0.1 binaries are available from our YUM Repository.
HTCondor 8.9.3 released!

September 17, 2019

The HTCondor team is pleased to announce the release of HTCondor 8.9.3. This development series release contains new features that are under development. This release contains all of the bug fixes from the 8.8.5 stable release. Enhancements in the release include: TOKEN and SSL authentication methods are now enabled by default; The job and global event logs use ISO 8601 formatted dates by default; Added Google Drive multifile transfer plugin; Added upload capability to Box multifile transfer plugin; Added Python bindings to submit a DAG; Python 'JobEventLog' can be pickled to facilitate intermittent readers; 2x matchmaking speed for partitionable slots with simple START expressions; Improved the performance of the condor_schedd under heavy load; Reduced the memory footprint of condor_dagman; Initial implementation to record the circumstances of a job's termination. Further details can be found in the Development Version History and the Stable Version History. HTCondor 8.9.3 binaries and source code are available from our Downloads page.
HTCondor 8.8.5 released!

September 4, 2019

The HTCondor team is pleased to announce the release of HTCondor 8.8.5. A stable series release contains significant bug fixes. Highlights of this release are: Fixed two performance problems on Windows; Fixed Java universe on Debian and Ubuntu systems; Added two knobs to improve performance on large scale pools; Fixed a bug where requesting zero GPUs would require a machine with GPUs; HTCondor can now recognize nVidia Volta and Turing GPUs. More details about the fixes can be found in the Version History. HTCondor 8.8.5 binaries and source code are available from our Downloads page.
HTCondor 8.8.4 released!

July 9, 2019

The HTCondor team is pleased to announce the release of HTCondor 8.8.4. A stable series release contains significant bug fixes. Highlights of this release are: Python 3 bindings - see version history for details (requires EPEL on EL7); Can configure DAGMan to dramatically reduce memory usage on some DAGs; Improved scalability when using the python bindings to qedit jobs; Fixed infrequent schedd crashes when removing scheduler universe jobs; The condor_master creates run and lock directories when systemd doesn't; The condor daemon obituary email now contains the last 200 lines of log. More details about the fixes can be found in the Version History. HTCondor 8.8.4 binaries and source code are available from our Downloads page.

Software

Community

Research and Development