This is the development release series of HTCondor.
The details of each version are described below.
Version 8.7.1
Release Notes:
HTCondor version 8.7.1 released on April 24, 2017.
New Features:
Previously, when the number of forked children processing Collector
queries surpassed the maximum set by the configuration knob COLLECTOR_QUERY_WORKERS, the
Collector handled all new incoming queries in-processes (i.e. without
forking). As processing a query and sending out the result to the network
could take a long time, the result of servicing such queries in-process in
the Collector is likely to drop a lot of updates. So now in v8.7.1, instead of
servicing such queries in-process, they are queued up for servicing as soon as
query worker child processes become available. The configuration knob
COLLECTOR_QUERY_WORKERS_PENDING was introduced; see
sectionrefparam:CollectorQueryWorkersPending.
(Ticket #6192).
Default value for COLLECTOR_QUERY_WORKERS changed from 2 to 4.
(Ticket #6192).
Introduced configuration macro
COLLECTOR_QUERY_WORKERS_RESERVE_FOR_HIGH_PRIO so that the
collector prioritizes queries that are important for the operation of the
pool (such as queries from the negotiator) ahead of servicing user
invocations of condor_status.
(Ticket #6192).
Introduced configuration macro COLLECTOR_QUERY_MAX_WORKTIME to
define the maximum amount of time the collector may service a query from a
client like condor_status. See sectionrefparam:CollectorQueryMaxWorktime.
(Ticket #6192).
Added several new statistics on collector query performance into the Collector
ClassAd, including ActiveQueryWorkers, ActiveQueryWokersPeak,
PendingQueries, PendingQueriesPeak, DroppedQueries,
and RecentDroppedQueries. See sectionrefsec:Collector-ClassAd-Attributes.
(Ticket #6192).
Docker universe jobs can now use condor_chirp command
(if it is in the image).
(Ticket #6162).
In the Job Router, when a candidate job matches multiple routes,
the first route is now always selected.
The old behavior of spreading jobs across all matching routes round-robin
style can be enabled by setting the new configuration parameter
JOB_ROUTER_ROUND_ROBIN_SELECTION to True.
(Ticket #6190).
The condor_schedd now keeps a count of jobs by state for each owner and submitter
and will report them to condor_q. Condorq will display these totals unless the new
configuration parameter CONDOR_Q_SHOW_OLD_SUMMARY is set to true. In 8.7.1
this parameter defaults to true.
(Ticket #6160).
Milestone 1 for late materialization in the condor_schedd was completed. This milestone adds the
undocumented option -factory to condor_q that can be used to submit a late materializing job cluster
to the condor_schedd. The condor_schedd will refuse the submission unless the configuration parameter
MacroSCHEDD_ALLOW_LATE_MATERIALIZATION is set to true.
(Ticket #6212).
Increased the default value for configuration parameter
NEGOTIATOR_SOCKET_CACHE_SIZE to 500.
(Ticket #6165).
Added new DaemonCore statistics UdpQueueDepth to measure the
number of bytes in the UDP receive queue for daemons with a UDP command port.
(Ticket #6183).
Improved speed of handling queries to the collector by caching the
the configuration knob SHARED_PORT_ADDRESS_REWRITING.
(Ticket #6187).
The condor_collector on Linux now handles some queries in process and some
by forking a child process. This allows it to avoid the overhead of forking to handle
queries that will take little time. The policy for deciding which queries to handle in process
is controlled by a new configuration parameter HANDLE_QUERY_IN_PROC_POLICY.
(Ticket #6191).
Added -limit option to condor_status and changed the condor_collector to honor it.
(Ticket #6198).
condor_submit was changed to use the same utility library that the submit python bindings use.
This should help insure that submit via python bindings will give the same results as using condor_submit.
(Ticket #6181)..
Bugs Fixed:
None.
Version 8.7.0
Release Notes:
HTCondor version 8.7.0 released on March 2, 2017.
New Features:
Optimized the code that reads reads ClassAds off the wire making the maximum possible update rate
for the Collector about 1.7 times higher than it was before.
(Ticket #6105).(Ticket #6130).
New statistics have been added to the Collector ad to show time spent handling queries.
(Ticket #6123).
Changed the formatting of the printing of ClassAd expressions with
parentheses. Now there is no space character after every open parenthesis, or
before every close parenthesis
This looks more natural, is somewhat faster for the condor to parse, and
saves space. That is, an expression that used to print like
Added -annex option to condor_status and condor_off. Requires
an argument; the request is constrained to match machines whose
AnnexName ClassAd attribute matches the argument.
(Ticket #6116).(Ticket #6117).
A refreshed X.509 proxy is now forwarded to the remote cluster
in Bosco.
(Ticket #5841).
Added several new statistics to the Negotiator ad, mainly
detailing how time is spent in the negotiation cycle.
(Ticket #6060).
Bugs Fixed:
Removed redundant updates to the job queue by the Job Router.
(Ticket #6102).
