Async Multi-Endpoint Health Check Engine with Exponential Backoff

This concurrent health-checking script queries hundreds of distributed HTTP microservice endpoints simultaneously to measure service latency and availability metrics. Internally, it uses Python asyncio alongside httpx to dispatch asynchronous HTTP requests bounded by semaphores, handling transient network errors through exponential backoff and jitter timing algorithms.

Site Reliability Engineers use this tool as a lightweight synthetic monitoring suite deployed across global regions to track API endpoint availability and response latencies. It validates microservice network paths, canary release deployments, and ingress routing health without introducing agent footprint overhead.

Unbounded concurrency settings can accidentally overload downstream internal microservices, resulting in a self-inflicted service degradation. Network timeouts and TLS handshake failures must be caught explicitly within async task wrappers to avoid unhandled exception propagation that could crash the event loop.

> System.Execute()

import asyncio, httpx, random

ENDPOINTS = ["https://httpbin.org/status/200", "https://httpbin.org/status/500", "https://httpbin.org/delay/1"]
CONCURRENCY_LIMIT = 5

async def fetch_with_backoff(client, url, semaphore, retries=3):
    async with semaphore:
        for attempt in range(retries):
            try:
                response = await client.get(url, timeout=3.0)
                if response.status_code == 200:
                    print(f"[SUCCESS] {url} - Status: {response.status_code}")
                    return True
            except httpx.RequestError:
                pass
            backoff = (2 ** attempt) + random.uniform(0, 1)
            print(f"[RETRY] Retrying {url} in {backoff:.2f}s...")
            await asyncio.sleep(backoff)
        print(f"[FAILURE] Endpoint down: {url}")
        return False

async def main():
    semaphore = asyncio.Semaphore(CONCURRENCY_LIMIT)
    async with httpx.AsyncClient() as client:
        tasks = [fetch_with_backoff(client, url, semaphore) for url in ENDPOINTS]
        await asyncio.gather(*tasks)

asyncio.run(main())

> Architecture & Security Context

Verified for Valters IT Hub. When deploying this configuration in a production homelab or enterprise environment, ensure that you monitor system resources and implement strict access controls. Administrator privileges are required.

ID: VALTERSIT-4AD9D31CBF79