Skip to main content

Client Polling Interval Tuning

Synopsis​

Intended end result: Set a stable polling interval that avoids overlap while keeping throughput high.

How this page gets you there: Verify current settings, update runtime config safely, restart targeted services, and persist changes in deployment params.

The client polling interval (CLIENT_POLL_SECONDS) controls how frequently the inference client checks for and processes new work. Adjust this based on processing performance analysis.

Verify current polling interval​

Before making changes, confirm the current setting:

grep '^POLL_SECONDS=' /mnt/datadisk/condor/client/.env

Update polling interval​

Edit the client environment file directly:

sudo nano /mnt/datadisk/condor/client/.env

Locate the line POLL_SECONDS=50 and change the value to your target (e.g., 30 or 35). Save and exit.

Verify the change was applied:

grep '^POLL_SECONDS=' /mnt/datadisk/condor/client/.env

Restart the client service​

Restart only the client container to pick up the new polling interval:

cd /mnt/datadisk/condor
sudo docker compose --project-name condor -f docker-compose.yaml restart condor_client

Confirm the restart completed successfully:

sudo docker compose --project-name condor -f docker-compose.yaml ps condor_client

Verify the change is active​

Check the client logs to confirm the new interval is in effect. Look for log entries with the updated polling interval in timestamps over the next few minutes:

sudo docker exec calfire_client sh -lc 'tail -n 50 /app/logs/calfire_inference.out.log | grep -i "poll\|sleep\|cycle"'

Update the persistent configuration (optional)​

If you want this change to persist across VM rebuilds, update the parameter in the Bicep deployment:

cd azure\infrastructure

Edit parameters.bicepparam and change:

param CLIENT_POLL_SECONDS = '50'

to your target value:

param CLIENT_POLL_SECONDS = '30'

Then republish the parameters to Key Vault:

.\scripts\publish-AICondorDeploymentParamSecret.ps1

On the next full infrastructure deployment, the VM will be provisioned with the new polling interval.