Desktop version Jobs
  • Analysis
  • Categories
  • Charts
  • Logs
  • projectsourcing_v2
    spiderautorola.fr
    job2026-03-30T10_38_44
    first_log_time2026-03-30 10:38:51
    latest_log_time2026-03-30 10:51:13
    runtime0:12:22
    crawled_pages 463
    scraped_items 0
    shutdown_reasonReceived SIGTERM
    finish_reasonN/A
    log_critical_count0
    log_error_count230
    log_warning_count1
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A

    • WARNING+

    • error_logs
      last 10 of 230 

      2026-03-30 10:50:53 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:50:54 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:50:54 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:50:56 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:51:04 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:51:07 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:51:08 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:51:09 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:51:10 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
      2026-03-30 10:51:13 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]

    • warning_logs
      1 in total 

      2026-03-30 10:39:13 [autorola.fr] WARNING: Login returned 401 for credential [vault:d5102885-a6d7-40ee-b697-b94712725108]

      INFO

      DEBUG

    • scrapy_version

      2.11.2

    • telnet_console

      127.0.0.1:6023

    • telnet_password

      9917d498031db044

    • latest_duplicate

      2026-03-30 10:39:21 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530757?locale=en_GB_d11> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)

    • latest_crawl

      2026-03-30 10:51:13 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25529724?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25529724?locale=en_GB_d11) ['zyte-api']

    • latest_stat

      2026-03-30 10:50:56 [scrapy.extensions.logstats] INFO: Crawled 463 pages (at 25 pages/min), scraped 0 items (at 0 items/min)

    • Head

      2026-03-30 10:38:51 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 10:38:51 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 10:38:51 [autorola.fr] INFO: Starting spider autorola.fr
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alx-prod-supplier-kv.vault.azure.net:443
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 401 108
2026-03-30 10:38:51 [azure.identity._credentials.default] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 10:38:51 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 200 7025
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdE5EQkZSRVZHUlVZdFFVSXpOUzAwTXpVMUxUazNPVVl0UWpVNVJURXdOVGs0TnpVNUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdFJVWkZSVGN6TVRNdE1EWXpSaTAwUkVKRUxUZzJNVGN0TkRrNVJFSkVSak0wTVRVM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:52 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpORFU1TlRnME5UZzFOMEUwUlRZeU9VRkRSVVE0UTBNek5FSTRNamRDTmkwdE1rRXdRekpFUkRrdFJUVTJOUzAwTVVRM0xUazBSRFl0UVVFeVJrWXlRMEUxTTBaR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpOek5HUWpBME9UY3dNa00wTjBNNU9ERkJRamxCTXpORVJqaEVOamt4UVMwdE9EazNOVFU1TkVNdE5EY3lOaTAwUkRJeUxUaERNakV0TkVWR09EUkRORFU0TkRZeklUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFRelZHTjBWQ09UaEdNRGcwTkVJd1FqTkdSalZFTlVaR1FrVTFOVGs0UVMwdE5ETkdRa0UyT0RJdE1UazNOQzAwTjBVd0xUZ3pSVEl0TVVFelFqZEZSVGMzT1VVMklUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:53 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFSVGt4TURGQk9UazJSRGMwTmpBeFFqVkVSVUk0T1VFMk56UTFNVFl5T1MwdFEwVXhOVUpHT1RJdFJUQkdNeTAwT1VOQkxUZzFNRVl0TjBaQk9EaEROakE0TVVGRElUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDVNVE5DTXpjMFJrWkVNVU0wTWpRMVFUTkVORUkyT0RjMk5ETTNNVUpHUWkwdE5ERkRNMFF5UlVZdE9UUXdOaTAwUmtSRUxUazBSVU10T1VWRFFrWTVRME0xTkRBeklUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 6760
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMUNPRE5DUlRJd1F6YzBOMFUwUkRRNFFURTNSVVUxTVVJd1FUSTNNMEl5UmkwdFJrUTBRell6TURBdE1qQTVRaTAwTlRBeExUaENORE10TkVJME5UUXpSREEzTVRjMElUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdE5rRXdPVFV4TVRndE5UVkZOeTAwTnpFMkxUZzJSVGN0T1RVelJEVkVPRVUyUkRSRUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMUVNa05ETjBKQ056azNRakUwUVRReFFqQXpPRVZHTWtFMk5VVkVOelZGTmkwdFJESTNNVEV3TXpVdFJEUTJNeTAwUkRrNExUZzJRekF0TkVVeE5USTFPVGRFTUVSRUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 1617
2026-03-30 10:38:54 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Found 32 secrets matching prefix 'supplier-34595845857a4e629aced8cc34b827b6'
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--049ac44f-883a-4f6a-99ef-8c7163dd0039/?api-version=7.4 HTTP/1.1" 200 362
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0c71dde0-a341-4fb0-9da3-592ba8e64bc5/?api-version=7.4 HTTP/1.1" 200 359
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0cac73f8-4a36-4bd6-a9cd-84fc809d250b/?api-version=7.4 HTTP/1.1" 200 378
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1007d598-dcb8-4e2c-bb67-46005eeb2e33/?api-version=7.4 HTTP/1.1" 200 376
2026-03-30 10:38:54 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--10ad0a56-ff18-4514-897f-7694eca264d9/?api-version=7.4 HTTP/1.1" 200 372
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--18a19b8b-bd50-401a-b495-173bfa476be8/?api-version=7.4 HTTP/1.1" 200 374
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1d7dd170-abc0-4364-95dd-e034a8fdad79/?api-version=7.4 HTTP/1.1" 200 379
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--22bbdcab-1aac-43d4-8cd1-a4e8b935bafb/?api-version=7.4 HTTP/1.1" 200 373
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2a0c2dd9-e565-41d7-94d6-aa2ff2ca53ff/?api-version=7.4 HTTP/1.1" 200 384
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2bcd417e-2bed-444a-89fc-968c561d5bb6/?api-version=7.4 HTTP/1.1" 200 382
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--3df06c9e-a1a7-4540-9fdc-21437026350a/?api-version=7.4 HTTP/1.1" 200 376
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--43fba682-1974-47e0-83e2-1a3b7ee779e6/?api-version=7.4 HTTP/1.1" 200 385
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4438b5c9-a031-4ef8-82ab-a266f5530b7e/?api-version=7.4 HTTP/1.1" 200 385
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4b2b6c1d-3a5a-4755-b1bc-ea7958a7945e/?api-version=7.4 HTTP/1.1" 200 375
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5c68eaa9-f96e-42ae-8216-d82663279262/?api-version=7.4 HTTP/1.1" 200 384
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5f737a37-75da-44ad-a2b6-a48c62fadbc1/?api-version=7.4 HTTP/1.1" 200 363
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72077223-a76f-4725-93a5-6ac88e8b83cc/?api-version=7.4 HTTP/1.1" 200 390
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72f99394-abfe-48d3-81bf-3d0f17d2f73e/?api-version=7.4 HTTP/1.1" 200 362
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--846d9461-cf8f-4a26-a2d0-dbc368748685/?api-version=7.4 HTTP/1.1" 200 385
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--86134377-e487-46da-bd8a-b801bf6d1330/?api-version=7.4 HTTP/1.1" 200 374
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--8716adb9-9f0f-42e0-93a8-1f484f5645f1/?api-version=7.4 HTTP/1.1" 200 379
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--9c556c27-4949-4575-bfed-5c2824c32e76/?api-version=7.4 HTTP/1.1" 200 378
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--a68716de-e747-41de-b415-2cf76644906d/?api-version=7.4 HTTP/1.1" 200 382
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--aaa3e65e-ab19-4523-92a3-c74c27c52b74/?api-version=7.4 HTTP/1.1" 200 377
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ac2e2209-4b0f-465e-bf2c-1beab246f412/?api-version=7.4 HTTP/1.1" 200 360
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--bcce0ba1-00f7-4b4a-b89e-eb41dd71987c/?api-version=7.4 HTTP/1.1" 200 381
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c7564b14-e84f-423b-983f-1c56459860bb/?api-version=7.4 HTTP/1.1" 200 395
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c900b3f0-b90a-4dc6-a453-2691c3d42678/?api-version=7.4 HTTP/1.1" 200 369
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d2711035-d463-4d98-86c0-4e152597d0dd/?api-version=7.4 HTTP/1.1" 200 380
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d5102885-a6d7-40ee-b697-b94712725108/?api-version=7.4 HTTP/1.1" 200 386
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--e26d41d5-d812-4e6c-a488-95d7cc51811b/?api-version=7.4 HTTP/1.1" 200 382
2026-03-30 10:38:55 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ef5b82a3-ff5e-4bd6-8101-328b1cbd3975/?api-version=7.4 HTTP/1.1" 200 395
2026-03-30 10:38:55 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Successfully decrypted 32 credentials
2026-03-30 10:38:55 [autorola.fr] INFO: Using credential [vault:d5102885-a6d7-40ee-b697-b94712725108] (32 remaining in queue)
2026-03-30 10:38:55 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 10:38:55 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 10:38:55 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 10:38:55 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 10:38:55 [scrapy.extensions.telnet] INFO: Telnet Password: 9917d498031db044
2026-03-30 10:38:55 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 10:38:55 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/autorola.fr/2026-03-30T10_38_44.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 10:38:55 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 10:38:55 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 10:38:56 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 10:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 10:38:56 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',

    • Tail

      /usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530667?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:38 [autorola.fr] INFO: Getting auth token for ad 25530667
2026-03-30 10:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535254?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.

2026-03-30 10:50:41 [autorola.fr] INFO: Getting auth token for ad 25535254
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535378?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535378?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530773?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:42 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:42 [autorola.fr] INFO: Getting auth token for ad 25530773
2026-03-30 10:50:43 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535291?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535291?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:43 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.428(s), this was the 1st time calling it.
2026-03-30 10:50:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.335885096578114 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 10:50:48 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25530097?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530097?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:48 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535409?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:49 [autorola.fr] INFO: Getting auth token for ad 25535409
2026-03-30 10:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535341?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:50 [autorola.fr] INFO: Getting auth token for ad 25535341
2026-03-30 10:50:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535350?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=1&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.

2026-03-30 10:50:52 [autorola.fr] INFO: Getting auth token for ad 25535350
2026-03-30 10:50:52 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25530155?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530155?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:52 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:53 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25530667?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530667?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:53 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:54 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535254?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535254?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:54 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:54 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25529825?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25529825?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:54 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25529724?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:56 [autorola.fr] INFO: Getting auth token for ad 25529724
2026-03-30 10:50:56 [scrapy.extensions.logstats] INFO: Crawled 463 pages (at 25 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 10:50:56 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 10:50:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535226?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535226?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:50:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:56 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535323?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:50:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:50:58 [autorola.fr] INFO: Getting auth token for ad 25535323
2026-03-30 10:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530978?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:51:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:00 [autorola.fr] INFO: Getting auth token for ad 25530978
2026-03-30 10:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25527822?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:51:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.

2026-03-30 10:51:01 [autorola.fr] INFO: Getting auth token for ad 25527822
2026-03-30 10:51:04 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535262?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535262?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:51:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:04 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25527829?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=2&country=FR&price_category=16) ['zyte-api']
2026-03-30 10:51:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:06 [autorola.fr] INFO: Getting auth token for ad 25527829
2026-03-30 10:51:07 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535409?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535409?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:51:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:07 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:51:08 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25530773?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25530773?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:51:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:08 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:51:09 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535350?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535350?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:51:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:09 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:51:10 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25535341?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25535341?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:51:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:10 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]
2026-03-30 10:51:12 [scrapy.crawler] INFO: Received SIGTERM, shutting down gracefully. Send again to force 

2026-03-30 10:51:12 [scrapy.core.engine] INFO: Closing spider (shutdown)
2026-03-30 10:51:13 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://mobilebidding.mp.autorolaapis.com/rest/vehicledescription/jwt/25529724?locale=en_GB_d11> (referer: https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25529724?locale=en_GB_d11) ['zyte-api']
2026-03-30 10:51:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 10:51:13 [autorola.fr] ERROR: Error getting auth token: [Failure instance: Traceback: <class 'scrapy.spidermiddlewares.httperror.HttpError'>: Ignoring non-200 response
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:182:_scrape
/usr/local/lib/python3.11/dist-packages/scrapy/core/scraper.py:196:_scrape2
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:303:scrape_response
/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py:81:mustbe_deferred
--- <exception caught here> ---
/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py:83:_process_spider_input
/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py:46:process_spider_input
]

    • Log

      /5/log/utf8/sourcing_v2/autorola.fr/2026-03-30T10_38_44/?job_finished=True&ui=mobile

    • Source

      http://scrapyd-4:6800/logs/sourcing_v2/autorola.fr/2026-03-30T10_38_44.log