• LogParser v0.8.2, last updated at 2026-04-01 05:00:27, http://scrapyd-1:6800/logs/sourcing_v2/autorola.be/task_55_2026-04-01T05_00_00.json

PROJECT (sourcing_v2), SPIDER (autorola.be)

  • Log analysis
  • Log categorization
  • View log
  • Crawler.stats
  • projectsourcing_v2
    spiderautorola.be
    jobtask_55_2026-04-01T05_00_00
    first_log_time2026-04-01 05:00:06
    latest_log_time2026-04-01 05:00:24
    runtime0:00:18
    crawled_pages 3
    scraped_items 0
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count2
    log_warning_count0
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A

    • WARNING+

    • error_logs
      2 in total 

      2026-04-01 05:00:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f525704d490>
      2026-04-01 05:00:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f525704dc90>

      INFO

      DEBUG

    • scrapy_version

      2.11.2

    • telnet_console

      127.0.0.1:6023

    • telnet_password

      b2bdd43ed4aa3fa5

    • latest_crawl

      2026-04-01 05:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=0&country=BE> (referer: https://mobilebidding.mp.autorolaapis.com/rest/users/login?locale=en_GB_d11) ['zyte-api']

    • latest_stat

      2026-04-01 05:00:11 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

    • Head

      2026-04-01 05:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-04-01 05:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-04-01 05:00:06 [autorola.be] INFO: Starting spider autorola.be
2026-04-01 05:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alx-prod-supplier-kv.vault.azure.net:443
2026-04-01 05:00:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 401 108

2026-04-01 05:00:06 [azure.identity._credentials.default] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-04-01 05:00:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 200 7025
2026-04-01 05:00:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdE5EQkZSRVZHUlVZdFFVSXpOUzAwTXpVMUxUazNPVVl0UWpVNVJURXdOVGs0TnpVNUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdFJVWkZSVGN6TVRNdE1EWXpSaTAwUkVKRUxUZzJNVGN0TkRrNVJFSkVSak0wTVRVM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpORFU1TlRnME5UZzFOMEUwUlRZeU9VRkRSVVE0UTBNek5FSTRNamRDTmkwdE1rRXdRekpFUkRrdFJUVTJOUzAwTVVRM0xUazBSRFl0UVVFeVJrWXlRMEUxTTBaR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpOek5HUWpBME9UY3dNa00wTjBNNU9ERkJRamxCTXpORVJqaEVOamt4UVMwdE5VRTFSa0pHTlVRdFFqWTFRaTAwUkRkRUxUaERORVV0TWpoRE1UQkVRalF5TXpnM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFOalF3TmpsRk5VTTROVFUwUXpORk9USkZNa015TWtKR1JFRkRSak5ETlMwdFEwSXpOME5HTnpVdFJFTkdNUzAwTWpZekxUZzVSRVV0TmtRd1JrVTJPVFUyUmpnd0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFSVGt4TURGQk9UazJSRGMwTmpBeFFqVkVSVUk0T1VFMk56UTFNVFl5T1MwdFFUUTROREk0UWprdFJUSTBPUzAwTmprMkxVRkJORFF0TmpjNE1rWXdPVEpCTkRNMElUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDVNVE5DTXpjMFJrWkVNVU0wTWpRMVFUTkVORUkyT0RjMk5ETTNNVUpHUWkwdE1qSkNRa1JEUVVJdE1VRkJReTAwTTBRMExUaERSREV0UVRSRk9FSTVNelZDUVVaQ0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 6760
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMUNPRE5DUlRJd1F6YzBOMFUwUkRRNFFURTNSVVUxTVVJd1FUSTNNMEl5UmkwdE0wRkJOMFF6UWtZdFFrUkdSaTAwUXpReExUbENRelV0T0RVM05UZzFPVFE1UmtGR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdE5FVkdPVGt6TURjdE9FTTJNUzAwTWpkRUxUaENSRUV0TjBSQ05rTTFNamcwTWpJd0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdFJVWTFRamd5UVRNdFJrWTFSUzAwUWtRMkxUZ3hNREV0TXpJNFFqRkRRa1F6T1RjMUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 2942
2026-04-01 05:00:09 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Found 32 secrets matching prefix 'supplier-34595845857a4e629aced8cc34b827b6'
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--049ac44f-883a-4f6a-99ef-8c7163dd0039/?api-version=7.4 HTTP/1.1" 200 362
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0c71dde0-a341-4fb0-9da3-592ba8e64bc5/?api-version=7.4 HTTP/1.1" 200 359
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0cac73f8-4a36-4bd6-a9cd-84fc809d250b/?api-version=7.4 HTTP/1.1" 200 378
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1007d598-dcb8-4e2c-bb67-46005eeb2e33/?api-version=7.4 HTTP/1.1" 200 376
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--10ad0a56-ff18-4514-897f-7694eca264d9/?api-version=7.4 HTTP/1.1" 200 372
2026-04-01 05:00:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--18a19b8b-bd50-401a-b495-173bfa476be8/?api-version=7.4 HTTP/1.1" 200 374
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1d7dd170-abc0-4364-95dd-e034a8fdad79/?api-version=7.4 HTTP/1.1" 200 379
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--22bbdcab-1aac-43d4-8cd1-a4e8b935bafb/?api-version=7.4 HTTP/1.1" 200 373
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2a0c2dd9-e565-41d7-94d6-aa2ff2ca53ff/?api-version=7.4 HTTP/1.1" 200 384
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2bcd417e-2bed-444a-89fc-968c561d5bb6/?api-version=7.4 HTTP/1.1" 200 382
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--3df06c9e-a1a7-4540-9fdc-21437026350a/?api-version=7.4 HTTP/1.1" 200 376
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--43fba682-1974-47e0-83e2-1a3b7ee779e6/?api-version=7.4 HTTP/1.1" 200 385
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4438b5c9-a031-4ef8-82ab-a266f5530b7e/?api-version=7.4 HTTP/1.1" 200 385
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4b2b6c1d-3a5a-4755-b1bc-ea7958a7945e/?api-version=7.4 HTTP/1.1" 200 375
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5c68eaa9-f96e-42ae-8216-d82663279262/?api-version=7.4 HTTP/1.1" 200 384
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5f737a37-75da-44ad-a2b6-a48c62fadbc1/?api-version=7.4 HTTP/1.1" 200 363
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72077223-a76f-4725-93a5-6ac88e8b83cc/?api-version=7.4 HTTP/1.1" 200 390
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72f99394-abfe-48d3-81bf-3d0f17d2f73e/?api-version=7.4 HTTP/1.1" 200 362
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--846d9461-cf8f-4a26-a2d0-dbc368748685/?api-version=7.4 HTTP/1.1" 200 385
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--86134377-e487-46da-bd8a-b801bf6d1330/?api-version=7.4 HTTP/1.1" 200 374
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--8716adb9-9f0f-42e0-93a8-1f484f5645f1/?api-version=7.4 HTTP/1.1" 200 379
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--9c556c27-4949-4575-bfed-5c2824c32e76/?api-version=7.4 HTTP/1.1" 200 378
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--a68716de-e747-41de-b415-2cf76644906d/?api-version=7.4 HTTP/1.1" 200 382
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--aaa3e65e-ab19-4523-92a3-c74c27c52b74/?api-version=7.4 HTTP/1.1" 200 377
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ac2e2209-4b0f-465e-bf2c-1beab246f412/?api-version=7.4 HTTP/1.1" 200 360
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--bcce0ba1-00f7-4b4a-b89e-eb41dd71987c/?api-version=7.4 HTTP/1.1" 200 381
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c7564b14-e84f-423b-983f-1c56459860bb/?api-version=7.4 HTTP/1.1" 200 395
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c900b3f0-b90a-4dc6-a453-2691c3d42678/?api-version=7.4 HTTP/1.1" 200 369
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d2711035-d463-4d98-86c0-4e152597d0dd/?api-version=7.4 HTTP/1.1" 200 380
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d5102885-a6d7-40ee-b697-b94712725108/?api-version=7.4 HTTP/1.1" 200 386
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--e26d41d5-d812-4e6c-a488-95d7cc51811b/?api-version=7.4 HTTP/1.1" 200 382
2026-04-01 05:00:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ef5b82a3-ff5e-4bd6-8101-328b1cbd3975/?api-version=7.4 HTTP/1.1" 200 395
2026-04-01 05:00:10 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Successfully decrypted 32 credentials
2026-04-01 05:00:10 [autorola.be] INFO: Using credential [vault:5c68eaa9-f96e-42ae-8216-d82663279262] (32 remaining in queue)
2026-04-01 05:00:10 [scrapy.addons] INFO: Enabled addons:
[]
2026-04-01 05:00:10 [asyncio] DEBUG: Using selector: EpollSelector
2026-04-01 05:00:10 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-04-01 05:00:10 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-04-01 05:00:10 [scrapy.extensions.telnet] INFO: Telnet Password: b2bdd43ed4aa3fa5
2026-04-01 05:00:10 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-04-01 05:00:10 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/autorola.be/task_55_2026-04-01T05_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-04-01 05:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-01 05:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-01 05:00:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-04-01 05:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-04-01 05:00:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',

    • Tail

      2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25506951: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725544206%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25544206: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546463%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25546463: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725537353%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25537353: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725534892%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25534892: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506952%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25506952: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506953%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25506953: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725544159%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25544159: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725537332%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25537332: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543443%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25543443: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506954%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25506954: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546519%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25546519: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543585%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25543585: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546602%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25546602: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543563%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25543563: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546522%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25546522: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506965%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25506965: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542649%27 HTTP/1.1" 200 None
2026-04-01 05:00:22 [autorola.be] INFO: Scrape type for 25542649: 0
2026-04-01 05:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725537245%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25537245: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725521516%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25521516: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542697%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25542697: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542859%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25542859: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506967%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25506967: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543449%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543449: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725535066%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25535066: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542795%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25542795: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506955%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25506955: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725521570%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25521570: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725537569%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25537569: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546525%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25546525: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542864%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25542864: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543512%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543512: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546461%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25546461: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543573%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543573: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725522898%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25522898: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725546460%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25546460: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725521556%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25521556: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725537321%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25537321: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543445%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543445: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725521547%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25521547: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725522965%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25522965: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725506939%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25506939: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542886%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25542886: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543775%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543775: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725542717%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25542717: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543462%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543462: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543110%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543110: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725521528%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25521528: 0
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20RowKey%20eq%20%2725543578%27 HTTP/1.1" 200 None
2026-04-01 05:00:23 [autorola.be] INFO: Scrape type for 25543578: 0
2026-04-01 05:00:23 [autorola.be] INFO: Stopping pagination at page 0: all 100 listings on this page were already scraped
2026-04-01 05:00:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-04-01 05:00:23 [autorola.be] INFO: autorola.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 100, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-04-01 05:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-04-01 05:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.be%27%20and%20last_price_update_time%20lt%201774587623 HTTP/1.1" 200 None
2026-04-01 05:00:24 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (0 items) in: file:///var/lib/scrapyd/items/sourcing_v2/autorola.be/task_55_2026-04-01T05_00_00.jl
2026-04-01 05:00:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 983,
 'downloader/request_count': 3,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 844181,
 'downloader/response_count': 3,
 'downloader/response_status_count/200': 3,
 'elapsed_time_seconds': 12.660964,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 4, 1, 5, 0, 24, 182445, tzinfo=datetime.timezone.utc),
 'log_count/DEBUG': 216,
 'log_count/INFO': 143,
 'memusage/max': 151175168,
 'memusage/startup': 151175168,
 'request_depth_max': 2,
 'response_received_count': 3,
 'scheduler/dequeued': 3,
 'scheduler/dequeued/memory': 3,
 'scheduler/enqueued': 3,
 'scheduler/enqueued/memory': 3,
 'scrape_type/skipped': 100,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 3,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 1.4637004123069346,
 'scrapy-zyte-api/mean_response_seconds': 1.581891653438409,
 'scrapy-zyte-api/processed': 3,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 1,
 'scrapy-zyte-api/request_args/httpRequestBody': 1,
 'scrapy-zyte-api/request_args/httpRequestMethod': 1,
 'scrapy-zyte-api/request_args/httpResponseBody': 3,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
 'scrapy-zyte-api/request_args/sessionContext': 1,
 'scrapy-zyte-api/request_args/url': 3,
 'scrapy-zyte-api/status_codes/200': 3,
 'scrapy-zyte-api/success': 3,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 4, 1, 5, 0, 11, 521481, tzinfo=datetime.timezone.utc)}
2026-04-01 05:00:24 [scrapy.core.engine] INFO: Spider closed (finished)
2026-04-01 05:00:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f525704d490>
2026-04-01 05:00:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f525704dc90>

    • Log

      /2/log/utf8/sourcing_v2/autorola.be/task_55_2026-04-01T05_00_00/?job_finished=True

    • Source

      http://scrapyd-1:6800/logs/sourcing_v2/autorola.be/task_55_2026-04-01T05_00_00.log

  • sourcelog
    last_update_time2026-04-01 05:00:24
    last_update_timestamp1775019624
    downloader/request_bytes983
    downloader/request_count3
    downloader/request_method_count/GET2
    downloader/request_method_count/POST1
    downloader/response_bytes844181
    downloader/response_count3
    downloader/response_status_count/2003
    elapsed_time_seconds12.660964
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2026, 4, 1, 5, 0, 24, 182445, tzinfo=datetime.timezone.utc)
    log_count/DEBUG216
    log_count/INFO143
    memusage/max151175168
    memusage/startup151175168
    request_depth_max2
    response_received_count3
    scheduler/dequeued3
    scheduler/dequeued/memory3
    scheduler/enqueued3
    scheduler/enqueued/memory3
    scrape_type/skipped100
    scrapy-zyte-api/4290
    scrapy-zyte-api/attempts3
    scrapy-zyte-api/error_ratio0.0
    scrapy-zyte-api/errors0
    scrapy-zyte-api/fatal_errors0
    scrapy-zyte-api/mean_connection_seconds1.4637004123069346
    scrapy-zyte-api/mean_response_seconds1.581891653438409
    scrapy-zyte-api/processed3
    scrapy-zyte-api/request_args/customHttpRequestHeaders3
    scrapy-zyte-api/request_args/experimental.responseCookies1
    scrapy-zyte-api/request_args/httpRequestBody1
    scrapy-zyte-api/request_args/httpRequestMethod1
    scrapy-zyte-api/request_args/httpResponseBody3
    scrapy-zyte-api/request_args/httpResponseHeaders3
    scrapy-zyte-api/request_args/sessionContext1
    scrapy-zyte-api/request_args/url3
    scrapy-zyte-api/status_codes/2003
    scrapy-zyte-api/success3
    scrapy-zyte-api/success_ratio1.0
    scrapy-zyte-api/throttle_ratio0.0
    start_timedatetime.datetime(2026, 4, 1, 5, 0, 11, 521481, tzinfo=datetime.timezone.utc)