Skip to content

[9.1] condor history missing only - #8859

Merged
fstagni merged 2 commits into
DIRACGrid:integrationfrom
aldbr:condor-history-missing-only
Oct 28, 2026
Merged

fstagni merged 2 commits into
DIRACGrid:integrationfrom
aldbr:condor-history-missing-only

Conversation

@aldbr

@aldbr aldbr commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

In HTCondor and Condor, we don't actually need to run condor_history on every jobID as it's currently done.
Providing the ID not returned by condor_q is enough and avoid any unnecessary operations.

BEGINRELEASENOTES
FIX: only query condor_history for jobs that are no longer in the queue
ENDRELEASENOTES

aldbr added 2 commits October 28, 2026 10:34
condor_history reads the whole history file for IDs it cannot find, and
getJobStatus asked it for every job, including those condor_q had just
returned. With tens of thousands of running pilots polled 100 at a time,
each poll scanned the full history file.

Assisted-by: Claude:claude-opus-5-5
…the queue

Since DIRACGrid#7069 getJobStatus built the condor_history command but executed
condor_q a second time, so jobs that had left the queue were reported
Unknown (then Aborted by the SiteDirector after an hour) instead of their
final status. Run the history command, only for the IDs condor_q did not
return, as in the Condor batch system. The tests now check what the
history call is asked for: they passed with the wrong command before.

Assisted-by: Claude:claude-opus-5-5
@aldbr
aldbr requested review from atsareg and fstagni as code owners October 28, 2026 09:43
@fstagni
fstagni merged commit f7f3fae into DIRACGrid:integration Oct 28, 2026
25 checks passed
@DIRACGridBot DIRACGridBot added the sweep:ignore Prevent sweeping from being ran for this PR label Oct 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sweep:ignore Prevent sweeping from being ran for this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants