Overview of upcoming enhancements in HTCondor v8.4.x and beyond. Note the opening video from the talk can also be found on YouTube at https://youtu.be/D-FnZJ8avsU

At CERN our batch system runs job submissions from physicists around the world, looking to analyze the LHC data. Currently, this represents around 65,000 cores running 400,000 jobs a day, at any one time over 60,000 jobs are executing. This has now become a matter of scaling, and when compared to other systems, HTCondor looks to be our best option to take us to 50,000 worker nodes and beyond. Therefore, CERN IT plans to move to HTCondor as their primary batch management software in the next few years. In this presentation we report about the status of the project and our future plans.

We examine the pros and cons of combining two technologies: Using BitTorrent for data transfer, and caching data on execute nodes using a pluggable cache replacement policy.

We present the HTCondor CacheD, a caching daemon that optimizes stage-in time for large shared input data through through novel transfer methods and proactive replication.

In our ATLAS pool, multicore jobs coexist with single core jobs of many different varieties, and ensuring that all types of jobs have access to the resources they require is a challenging problem. I will discuss how we partially solved the problem a combination of Hierarchical Group Quotas and Partitionable Slots, and then present work we did to allow automatic balancing between groups based on demand from PANDA, the ATLAS workload-management system -- balancing the effects of single vs. multicore jobs and queues with differing priorities.

The CMS experiment at CERN runs all distributed computing now through a single global HTCondor/glideInWMS pool. I will discuss the reasons for doing this, how it is constructed and our experience running with it.

Raytheon Company, with 2014 sales of $23 billion and 61,000 employees worldwide, is a technology and innovation leader specializing in defense, security, and civil markets throughout the world. Today's extensive High Performance Computing needs require Raytheon's Information Technology organization to continuously push the envelope to create leading-edge technical processing solutions for complex systems and program challenges. Beginning in late 2012, Michael Pelletier took on such a challenge, a 750+-thread compute cluster which was straining the limits of the existing infrastructure, as well as the capabilities of the IT support team and its engineering partners. By adopting HTCondor, and with the help of the CHTC development team, he was able to transform the performance of the existing hardware, and leverage HTCondor's unique capabilities simplify workflow and multiply the productivity of the modeling, simulation, and analysis tasks across multiple Raytheon programs. He will discuss Raytheon's adoption of HTCondor and the innovations and improvements which flowed from it.