This is an outdated version of the HTCondor Manual. You can find current documentation at http://htcondor.org/manual.

10.3 Development Release Series 8.1

This is the development release series of HTCondor. The details of each version are described below.

Version 8.1.1

Release Notes:

• HTCondor version 8.1.1 released on September 17, 2013. This release contains all bug fixes from the stable release version 8.0.2.

New Features:

• Reduced the number of calls to the service when managing EC2 jobs. This should increase the number of EC2 jobs HTCondor can manage on a given service without overloading it. (Ticket #3683).

• When configuration variable USE_SHARED_PORT is True, SHARED_PORT will now be automatically added to DAEMON_LIST . To disable this new behavior, set the new configuration variable:

    AUTO_INSERT_SHARED_PORT_IN_DAEMON_LIST = False
  

  (Ticket #3799).

• Floating point values in ClassAds are now printed as 64-bit double precision values when sent over the network, written to disk, and displayed using the -long or -autoformat options of condor_status and condor_q. (Ticket #3363).

• In the Pegasus/DAGMan workflow metrics, as documented in section 2.10.15, the two metrics dagman_id and parent_dagman_id are now reported as the ClusterId of the condor_dagman job. This eliminates any privacy concerns with reporting the condor_schedd daemon's address, which includes the submit machine's IP address.

• The python bindings now can perform the equivalent of condor_ping as a part of the SecMan object. (Ticket #3857).

• The condor_gridmanager and condor_ft-gahp now create dynamic security session for performing file transfers. Previously, the security configuration had to be set in a special way for file transfers with the condor_ft-gahp to work. (Ticket #3536).

Configuration Variable and ClassAd Attribute Additions and Changes:

• The new configuration variable USE_RESOURCE_REQUEST_COUNTS is a boolean value that defaults to True, reducing the latency of negotiation when there are many jobs next to each other in the queue with the same auto cluster, and many matches are being made. (Ticket #3585).

• Four new machine ClassAd attributes are advertised. TotalJobStarts is the total number of jobs started by this condor_startd daemon since it booted. RecentTotalJobStarts is the number of jobs started in the last twenty minutes. Similarly, TotalPreemptions is the number of jobs preempted since the condor_startd daemon started, and RecentTotalPreemptions is the number in the last 20 minutes. (Ticket #3712).

• FILE_TRANSFER_DISK_LOAD_THROTTLE now accepts tabs in addition to spaces as delimiters. (Ticket #3798).

• Configuration variable VALID_SPOOL_FILES has been expanded to accept a single asterisk wild card character in each listed file name. (Ticket #3764).

• The new configuration variable GAHP_DEBUG_HIDE_SENSITIVE_DATA is a boolean value that defaults to hiding sensitive data such as security keys and passwords when communication with a GAHP server is written to a daemon log. (Ticket #3536).

• The default value of configuration variable ENABLE_CLASSAD_CACHING has changed to True for all daemons other than the condor_shadow, condor_starter, and condor_master. (Ticket #3441).

Bugs Fixed:

• The condor_gridmanager now does proper failure recovery when submitting EC2 grid universe jobs to services that do not support the EC2 ClientToken parameter. Previously, if there was a failure when submitting jobs to OpenStack or Eucalyptus, the jobs could be submitted twice. (Ticket #3682).

• Fixed the printing of nested ClassAds, so that the nested ClassAds can be read back properly. (Ticket #3772).

• Fixed a bug between the condor_gridmanager and condor_ft-gahp that caused file transfers to fail if one of the two daemons was older than version 8.1.0. (Ticket #3856).

• Fixed a bug that caused substitution in configuration variable evaluation to ignore per-daemon overrides. This is a long standing bug that may result in subtle changes to the way your configuration files are processed. An example of how substitution works with the per-daemon overrides is in section 3.3.1. (Ticket #3822).

• Fixed a bug that caused the command

    condor_submit -
  

  to be interpreted as an interactive submit, rather than a request to read input from stdin. condor_qsub was also modified to be immune to this bug, such that it will still work with other versions of HTCondor containing the bug. (Ticket #3902).

Known Bugs:

• DAGMan recovery mode does not work for Pegasus-generated SUBDAGs. For SUBDAGs, doing condor_hold or condor_release on the condor_dagman job, or stopping and re-starting the condor_schedd with the DAGMan job in the queue will result in failure of the DAG. This can be avoided by doing a condor_rm of the DAGMan job, which produces a Rescue DAG, and re-submitting the DAG; the Rescue DAG is automatically run. This bug was introduced in HTCondor version 8.0.1, and it also appears in versions 8.0.2, 8.1.0, and 8.1.1. (Ticket #3882).

Additions and Changes to the Manual:

• None.

Version 8.1.0

Release Notes:

• HTCondor version 8.1.0 released on August 5, 2013. This release contains all bug fixes from the stable release version 8.0.1.

New Features:

• Added support for publishing information about an HTCondor pool to Ganglia^TM. See section 3.3.38 on page  for configuration variable details. (Ticket #3515).

• Improved the performance of the condor_collector daemon when running at sites that do not observe daylight savings time. (Ticket #2898).

• condor_q, condor_rm, condor_status and condor_qedit are now more consistent in the way they handle the -constraint option. (Ticket #1156).

• The new condor_dagman_metrics_reporter executable with manual page at , reports metrics for DAGMan workflows running under Pegasus. condor_dagman now generates an output file of the relevant metrics, as described at . (Ticket #3532).

Configuration Variable and ClassAd Attribute Additions and Changes:

• The default value of configuration variable COLLECTOR_MAX_FILE_DESCRIPTORS has changed to 10240, and the default value of configuration variable SCHEDD_MAX_FILE_DESCRIPTORS has changed to 4096. This increases the scalability of the default configuration. (Ticket #3626).

• The new configuration variable FILE_TRANSFER_DISK_LOAD_THROTTLE enables dynamic adjustment of the level of file transfer concurrency in order to keep the disk load generated by transfers below a specified level. Supporting this new feature are configuration variables FILE_TRANSFER_DISK_LOAD_THROTTLE_WAIT_BETWEEN_INCREMENTS , FILE_TRANSFER_DISK_LOAD_THROTTLE_SHORT_HORIZON , and FILE_TRANSFER_DISK_LOAD_THROTTLE_LONG_HORIZON . (Ticket #3613).

• The following new condor_schedd ClassAd attributes are for monitoring file transfer activity: TransferQueueMBWaitingToDownload, TransferQueueMBWaitingToUpload, FileTransferDiskThrottleLevel, FileTransferDiskThrottleHigh, and FileTransferDiskThrottleLow. (Ticket #3613).

• The default value for the configuration variable PASSWD_CACHE_REFRESH has been changed from 300 seconds to 72000 seconds (20 hours). (Ticket #3723).

• The new configuration variables DAGMAN_PEGASUS_REPORT_METRICS and DAGMAN_PEGASUS_REPORT_TIMEOUT set defaults used by the new condor_dagman_metrics_reporter executable, which reports metrics for DAGMan jobs running under Pegasus. (Ticket #3532).

Bugs Fixed:

• HTCondor version 8.0.0 had an unintended change in the Chirp wire protocol. This change caused condor_chirp with the put option to fail when the execute node was running HTCondor version 7.8.x or earlier versions. HTCondor 8.0.1 and later versions will now send the original wire protocol, and accept either the original protocol, or the variant that HTCondor version 8.0.0 sends. (Ticket #3735).

• Fixed a bug that could cause the daemons to crash on Unix platforms, if the operating system reported that a job owner's account did not exist, for example due to a temporary NIS or LDAP failure. (Ticket #3723).

• Fixed a bug that resulted in a misleading error message when condor_status with the -constraint option specified a constraint that could not be parsed. (Ticket #1319).

• Fixed a typo in the output of condor_q, where a period was erroneously present within a heading. (Ticket #3703).

Known Bugs:

• None.

Additions and Changes to the Manual:

• None.