• LogParser v0.8.2, last updated at 2026-03-31 23:26:19, http://scrapyd-1:6800/logs/sourcing_v2/autorola.it/task_56_2026-03-31T23_15_00.json

PROJECT (sourcing_v2), SPIDER (autorola.it)

  • Log analysis
  • Log categorization
  • Progress visualization
  • View log
  • Crawler.stats
  • projectsourcing_v2
    spiderautorola.it
    jobtask_56_2026-03-31T23_15_00
    first_log_time2026-03-31 23:15:06
    latest_log_time2026-03-31 23:26:13
    runtime0:11:07
    crawled_pages 443
    scraped_items 393
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count2
    log_warning_count2
    log_redirect_count3940
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A
    • WARNING+

    • error_logs
      2 in total

      2026-03-31 23:26:13 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f0f9d450910>
      2026-03-31 23:26:13 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f0f9d451110>
    • warning_logs
      2 in total

      2026-03-31 23:15:18 [autorola.it] WARNING: Login returned 401 for credential [vault:9c556c27-4949-4575-bfed-5c2824c32e76]
      2026-03-31 23:23:31 [autorola.it] WARNING: Error getting enrollment for ad 25540315: [Failure instance: Traceback: <class 'zyte_api._errors.RequestError'>: RequestError: 421, message=, headers=<CIMultiDictProxy('Date': 'Tue, 31 Mar 2026 23:23:30 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '277', 'Connection': 'keep-alive', 'Request-Id': '7885985dd532fc4f7a31a6f06479372d', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/website/connection-error","title":"Website Connection Error","status":421,"detail":"Failed to establish a network connection to the website. This could be due to the server being down or network connectivity issues. Verify the website is operational and accessible."}', request_id=7885985dd532fc4f7a31a6f06479372d
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:916:errback
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:984:_startRunCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1078:_runCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1949:_gotResultInlineCallbacks
      --- <exception caught here> ---
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1999:_inlineCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/python/failure.py:519:throwExceptionIntoGenerator
      /usr/local/lib/python3.11/dist-packages/scrapy/core/downloader/middleware.py:54:process_request
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1251:adapt
      /usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/handler.py:257:_download_request
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:54:get
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:168:get
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:142:async_wrapped
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:58:__call__
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:110:iter
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:78:inner
      /usr/local/lib/python3.11/dist-packages/tenacity/__init__.py:390:<lambda>
      /usr/lib/python3.11/concurrent/futures/_base.py:449:result
      /usr/lib/python3.11/concurrent/futures/_base.py:401:__get_result
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:61:__call__
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:142:request
      ]

      INFO

    • redirect_logs
      last 10 of 3940

      2026-03-31 23:26:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvZGFlOWNkNTItMzIzNC00ZDQwLWFmZGEtNzE2ZmY0ODE2NjcyLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=824641fc-36d1-462b-97f5-b37a8e95084e>
      2026-03-31 23:26:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvMWQ3NjQ1OTctN2FhNi00YmI4LWFlZjUtOWI4NGRjZjVmNGI2LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=f94bc75d-1185-4627-b895-bbe62432bd0c>
      2026-03-31 23:26:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGNiZDUwNDktMTE0NC00YTA1LWI2ZWUtMzQxODIzNzQ2YjQwLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=96cb6a47-9ce3-4e42-8cf7-de5b958efd24>
      2026-03-31 23:26:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvZjIwNmZmZjktZDBhNC00Yjc4LThhODQtNjM5MmQ5NTI4YTYwLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=cea939e9-7515-48a0-9477-cf93f30a202c>
      2026-03-31 23:26:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNmU5ZDVjY2EtYWU1Ny00MjMzLTgxNWItMTE4ZWFiYWU3MWI5LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=1974a169-d4f5-4979-98b2-d16ca7532a25>
      2026-03-31 23:26:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvY2Y5N2VjNDMtN2Q4My00YTE2LWFjNWUtNTZiZmEyNTI5Y2ZjLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=46c621cf-e160-4164-b9c0-7dffc2568f53>
      2026-03-31 23:26:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNWQwODdiMzAtMDI2YS00MTZlLWJhNWMtMWQxYmI2YTkzYTg0LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=ce334552-0905-4e79-af69-12e7953f9e08>
      2026-03-31 23:26:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvMmU5MWEzNWEtNzk0ZS00MDg2LTk3MWEtMWY2OTUxNDIzMmFjLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=12f6a4bb-884d-40a0-b441-0c0e7199bf1e>
      2026-03-31 23:26:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvY2NlOGFiOTItMzc5YS00YmZjLTk1YzUtMWIwODgxMGUyMjk3LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=7010e8d7-8063-412f-b090-4dc004ec25f2>
      2026-03-31 23:26:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z> from <GET https://g.autorola.com/g/i/show.carpicture?t=1080&guid=5b8a08cf-0180-4401-a567-3789bf0a500a>

      DEBUG

    • scrapy_version

      2.11.2
    • telnet_console

      127.0.0.1:6023
    • telnet_password

      570014fda46b86d9
    • latest_crawl

      2026-03-31 23:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z> (referer: https://g.autorola.com/g/i/show.carpicture?t=b&guid=9c7c5f0d-c64a-443d-a00e-e4607945ca3a)
    • latest_scrape

      2026-03-31 23:26:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z>
    • latest_stat

      2026-03-31 23:26:11 [scrapy.extensions.logstats] INFO: Crawled 443 pages (at 0 pages/min), scraped 391 items (at 51 items/min)
    • Head

      2026-03-31 23:15:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
      2026-03-31 23:15:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
      2026-03-31 23:15:06 [autorola.it] INFO: Starting spider autorola.it
      2026-03-31 23:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alx-prod-supplier-kv.vault.azure.net:443
      2026-03-31 23:15:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 401 108
      2026-03-31 23:15:06 [azure.identity._credentials.default] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
      2026-03-31 23:15:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 200 7025
      2026-03-31 23:15:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdE5EQkZSRVZHUlVZdFFVSXpOUzAwTXpVMUxUazNPVVl0UWpVNVJURXdOVGs0TnpVNUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdFJVWkZSVGN6TVRNdE1EWXpSaTAwUkVKRUxUZzJNVGN0TkRrNVJFSkVSak0wTVRVM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpORFU1TlRnME5UZzFOMEUwUlRZeU9VRkRSVVE0UTBNek5FSTRNamRDTmkwdE1rRXdRekpFUkRrdFJUVTJOUzAwTVVRM0xUazBSRFl0UVVFeVJrWXlRMEUxTTBaR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpOek5HUWpBME9UY3dNa00wTjBNNU9ERkJRamxCTXpORVJqaEVOamt4UVMwdE5VRTFSa0pHTlVRdFFqWTFRaTAwUkRkRUxUaERORVV0TWpoRE1UQkVRalF5TXpnM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFOalF3TmpsRk5VTTROVFUwUXpORk9USkZNa015TWtKR1JFRkRSak5ETlMwdFEwSXpOME5HTnpVdFJFTkdNUzAwTWpZekxUZzVSRVV0TmtRd1JrVTJPVFUyUmpnd0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFSVGt4TURGQk9UazJSRGMwTmpBeFFqVkVSVUk0T1VFMk56UTFNVFl5T1MwdFFUUTROREk0UWprdFJUSTBPUzAwTmprMkxVRkJORFF0TmpjNE1rWXdPVEpCTkRNMElUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDVNVE5DTXpjMFJrWkVNVU0wTWpRMVFUTkVORUkyT0RjMk5ETTNNVUpHUWkwdE1qSkNRa1JEUVVJdE1VRkJReTAwTTBRMExUaERSREV0UVRSRk9FSTVNelZDUVVaQ0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 6760
      2026-03-31 23:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMUNPRE5DUlRJd1F6YzBOMFUwUkRRNFFURTNSVVUxTVVJd1FUSTNNMEl5UmkwdE0wRkJOMFF6UWtZdFFrUkdSaTAwUXpReExUbENRelV0T0RVM05UZzFPVFE1UmtGR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdE5FVkdPVGt6TURjdE9FTTJNUzAwTWpkRUxUaENSRUV0TjBSQ05rTTFNamcwTWpJd0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdFJVWTFRamd5UVRNdFJrWTFSUzAwUWtRMkxUZ3hNREV0TXpJNFFqRkRRa1F6T1RjMUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 2942
      2026-03-31 23:15:09 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Found 32 secrets matching prefix 'supplier-34595845857a4e629aced8cc34b827b6'
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--049ac44f-883a-4f6a-99ef-8c7163dd0039/?api-version=7.4 HTTP/1.1" 200 362
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0c71dde0-a341-4fb0-9da3-592ba8e64bc5/?api-version=7.4 HTTP/1.1" 200 359
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0cac73f8-4a36-4bd6-a9cd-84fc809d250b/?api-version=7.4 HTTP/1.1" 200 378
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1007d598-dcb8-4e2c-bb67-46005eeb2e33/?api-version=7.4 HTTP/1.1" 200 376
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--10ad0a56-ff18-4514-897f-7694eca264d9/?api-version=7.4 HTTP/1.1" 200 372
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--18a19b8b-bd50-401a-b495-173bfa476be8/?api-version=7.4 HTTP/1.1" 200 374
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1d7dd170-abc0-4364-95dd-e034a8fdad79/?api-version=7.4 HTTP/1.1" 200 379
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--22bbdcab-1aac-43d4-8cd1-a4e8b935bafb/?api-version=7.4 HTTP/1.1" 200 373
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2a0c2dd9-e565-41d7-94d6-aa2ff2ca53ff/?api-version=7.4 HTTP/1.1" 200 384
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2bcd417e-2bed-444a-89fc-968c561d5bb6/?api-version=7.4 HTTP/1.1" 200 382
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--3df06c9e-a1a7-4540-9fdc-21437026350a/?api-version=7.4 HTTP/1.1" 200 376
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--43fba682-1974-47e0-83e2-1a3b7ee779e6/?api-version=7.4 HTTP/1.1" 200 385
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4438b5c9-a031-4ef8-82ab-a266f5530b7e/?api-version=7.4 HTTP/1.1" 200 385
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4b2b6c1d-3a5a-4755-b1bc-ea7958a7945e/?api-version=7.4 HTTP/1.1" 200 375
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5c68eaa9-f96e-42ae-8216-d82663279262/?api-version=7.4 HTTP/1.1" 200 384
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5f737a37-75da-44ad-a2b6-a48c62fadbc1/?api-version=7.4 HTTP/1.1" 200 363
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72077223-a76f-4725-93a5-6ac88e8b83cc/?api-version=7.4 HTTP/1.1" 200 390
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72f99394-abfe-48d3-81bf-3d0f17d2f73e/?api-version=7.4 HTTP/1.1" 200 362
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--846d9461-cf8f-4a26-a2d0-dbc368748685/?api-version=7.4 HTTP/1.1" 200 385
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--86134377-e487-46da-bd8a-b801bf6d1330/?api-version=7.4 HTTP/1.1" 200 374
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--8716adb9-9f0f-42e0-93a8-1f484f5645f1/?api-version=7.4 HTTP/1.1" 200 379
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--9c556c27-4949-4575-bfed-5c2824c32e76/?api-version=7.4 HTTP/1.1" 200 378
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--a68716de-e747-41de-b415-2cf76644906d/?api-version=7.4 HTTP/1.1" 200 382
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--aaa3e65e-ab19-4523-92a3-c74c27c52b74/?api-version=7.4 HTTP/1.1" 200 377
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ac2e2209-4b0f-465e-bf2c-1beab246f412/?api-version=7.4 HTTP/1.1" 200 360
      2026-03-31 23:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--bcce0ba1-00f7-4b4a-b89e-eb41dd71987c/?api-version=7.4 HTTP/1.1" 200 381
      2026-03-31 23:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c7564b14-e84f-423b-983f-1c56459860bb/?api-version=7.4 HTTP/1.1" 200 395
      2026-03-31 23:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c900b3f0-b90a-4dc6-a453-2691c3d42678/?api-version=7.4 HTTP/1.1" 200 369
      2026-03-31 23:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d2711035-d463-4d98-86c0-4e152597d0dd/?api-version=7.4 HTTP/1.1" 200 380
      2026-03-31 23:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d5102885-a6d7-40ee-b697-b94712725108/?api-version=7.4 HTTP/1.1" 200 386
      2026-03-31 23:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--e26d41d5-d812-4e6c-a488-95d7cc51811b/?api-version=7.4 HTTP/1.1" 200 382
      2026-03-31 23:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ef5b82a3-ff5e-4bd6-8101-328b1cbd3975/?api-version=7.4 HTTP/1.1" 200 395
      2026-03-31 23:15:10 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Successfully decrypted 32 credentials
      2026-03-31 23:15:10 [autorola.it] INFO: Using credential [vault:9c556c27-4949-4575-bfed-5c2824c32e76] (32 remaining in queue)
      2026-03-31 23:15:10 [scrapy.addons] INFO: Enabled addons:
      []
      2026-03-31 23:15:10 [asyncio] DEBUG: Using selector: EpollSelector
      2026-03-31 23:15:10 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-03-31 23:15:10 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-03-31 23:15:10 [scrapy.extensions.telnet] INFO: Telnet Password: 570014fda46b86d9
      2026-03-31 23:15:10 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats',
       'scrapy.extensions.closespider.CloseSpider']
      2026-03-31 23:15:10 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'SourcingV2',
       'CLOSESPIDER_TIMEOUT': 7200,
       'DOWNLOAD_MAXSIZE': 52428800,
       'DOWNLOAD_WARNSIZE': 10485760,
       'FEED_EXPORT_ENCODING': 'utf-8',
       'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/autorola.it/task_56_2026-03-31T23_15_00.log',
       'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
       'MEMUSAGE_LIMIT_MB': 2048,
       'MEMUSAGE_WARNING_MB': 1536,
       'NEWSPIDER_MODULE': 'spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
       'SPIDER_MODULES': ['spiders', 'auth_check'],
       'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
       'USER_AGENT': ''}
      2026-03-31 23:15:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-03-31 23:15:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-03-31 23:15:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-03-31 23:15:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
      2026-03-31 23:15:10 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
    • Tail

      2026-03-31 23:26:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
      2026-03-31 23:26:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
      2026-03-31 23:26:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
      2026-03-31 23:26:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
      2026-03-31 23:26:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
      2026-03-31 23:26:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'f\x00\x00\x00'
      2026-03-31 23:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
      2026-03-31 23:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0f97206810>
      2026-03-31 23:26:12 [common.azure_blobstore] INFO: Creating container if not exists
      2026-03-31 23:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
      2026-03-31 23:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
      2026-03-31 23:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_8.jpg HTTP/1.1" 201 0
      2026-03-31 23:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-31 23:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='autorola.it',RowKey='https%3A%252F%252Fawis7.autorola.com%252FeyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19%253Fexpires%3D20260402T232612Z') HTTP/1.1" 204 0
      2026-03-31 23:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z saved to cache
      2026-03-31 23:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff0011e7-e2df-563b-bb33-0da7e7e6dbdd
      2026-03-31 23:26:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff0011e7-e2df-563b-bb33-0da7e7e6dbdd, skipping ID generation
      2026-03-31 23:26:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff0011e7-e2df-563b-bb33-0da7e7e6dbdd sending to next pipeline
      2026-03-31 23:26:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: autorola.it, Processed item id: ff0011e7-e2df-563b-bb33-0da7e7e6dbdd, identifier: 25543645
      2026-03-31 23:26:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: autorola.it, Translating item: ff0011e7-e2df-563b-bb33-0da7e7e6dbdd with identifier: 25543645
      2026-03-31 23:26:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: autorola.it, Applying rules to item: ff0011e7-e2df-563b-bb33-0da7e7e6dbdd with identifier: 25543645
      2026-03-31 23:26:13 [crawlers.pipelines.post_to_api] INFO: Spider: autorola.it, Posting item: ff0011e7-e2df-563b-bb33-0da7e7e6dbdd with identifier: 25543645 to the API
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
      2026-03-31 23:26:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z>
      {'auction_title': 'Santander Consumer Renting',
       'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_expert_report_file_8f2852b4-d399-48ec-bd2f-3c5f34f1c28c.pdf',
       'car_expert_report_source_url': 'https://g.autorola.com/g/i/show.carpicture?t=b&guid=9c7c5f0d-c64a-443d-a00e-e4607945ca3a',
       'color': 'Unknown',
       'currency': 'EUR',
       'doors_number': 5,
       'engine': '1.5L',
       'engine_horse_power': 150,
       'expiration_date': '2026-04-02T08:32:00.000+00:00',
       'fuel_type': 'Hybrid (Petrol)',
       'id': 'ff0011e7-e2df-563b-bb33-0da7e7e6dbdd',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'GV***PF',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25543645&aid=662685',
       'listing': 'auction',
       'location': 'IT, Lombardia',
       'make': 'Cupra',
       'model': 'Leon Sportstourer 1.5 Hybrid 150 CV DSG',
       'odometer': 24784,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 40,
       'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_0.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 214167,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvZGFlOWNkNTItMzIzNC00ZDQwLWFmZGEtNzE2ZmY0ODE2NjcyLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_1.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 145396,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvMWQ3NjQ1OTctN2FhNi00YmI4LWFlZjUtOWI4NGRjZjVmNGI2LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_2.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 212790,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGNiZDUwNDktMTE0NC00YTA1LWI2ZWUtMzQxODIzNzQ2YjQwLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_3.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 197244,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNmU5ZDVjY2EtYWU1Ny00MjMzLTgxNWItMTE4ZWFiYWU3MWI5LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_4.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 205724,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvZjIwNmZmZjktZDBhNC00Yjc4LThhODQtNjM5MmQ5NTI4YTYwLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232611Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_5.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 233384,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvY2Y5N2VjNDMtN2Q4My00YTE2LWFjNWUtNTZiZmEyNTI5Y2ZjLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_6.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 147872,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNWQwODdiMzAtMDI2YS00MTZlLWJhNWMtMWQxYmI2YTkzYTg0LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_7.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 269789,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvMmU5MWEzNWEtNzk0ZS00MDg2LTk3MWEtMWY2OTUxNDIzMmFjLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_8.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 399769,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvNGQ1ZDBhMmYtYjEwMi00Njk4LTkyNjUtN2M2YWM5ZjIxN2ExLmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z',
                   'Width': 1440},
                  {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0011e7-e2df-563b-bb33-0da7e7e6dbdd/ff0011e7-e2df-563b-bb33-0da7e7e6dbdd_image_9.jpg',
                   'Extension': 'jpg',
                   'FileSizeInBytes': 188705,
                   'Height': 1080,
                   'OriginUrl': 'https://awis7.autorola.com/eyJidWNrZXQiOiJhd2lzLWltYWdlLWJ1Y2tldC1wcm9kMSIsImtleSI6IjIwMjYvMDMvMzEvY2NlOGFiOTItMzc5YS00YmZjLTk1YzUtMWIwODgxMGUyMjk3LmpwZyIsImVkaXRzIjp7InJlc2l6ZSI6eyJ3aWR0aCI6MTQ0MCwiaGVpZ2h0IjoxMDgwLCJmaXQiOiJpbnNpZGUiLCJ3aXRob3V0RW5sYXJnZW1lbnQiOmZhbHNlfX19?expires=20260402T232612Z',
                   'Width': 1440}],
       'price': 15300,
       'price_includes_vat': False,
       'registration_date': '2024-05-31',
       'seller_name': None,
       'title': 'Cupra Leon Sportstourer 1.5 Hybrid 150 CV DSG',
       'transmission': 'automatic',
       'trim': 'Cupra Leon Sportstourer 1.5 Hybrid 150 CV DSG',
       'vin': None,
       'year': 2024}
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20RowKey%20eq%20%2725543645%27 HTTP/1.1" 200 None
      2026-03-31 23:26:13 [autorola.it] INFO: Saving data for 25543645: {'created_time': 1774999573.447134, 'last_price_update_time': 1774999573.447146, 'auction_closing_time': 1775118720.0}
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='autorola.it',RowKey='25543645') HTTP/1.1" 204 0
      2026-03-31 23:26:13 [scrapy.core.engine] INFO: Closing spider (finished)
      2026-03-31 23:26:13 [autorola.it] INFO: autorola.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20RowKey%20eq%20%2725540315%27 HTTP/1.1" 200 None
      2026-03-31 23:26:13 [autorola.it] INFO: Saving data for 25540315: {'created_time': 1774999573.568953}
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='autorola.it',RowKey='25540315') HTTP/1.1" 204 0
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-31 23:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20last_price_update_time%20lt%201774567573 HTTP/1.1" 200 None
      2026-03-31 23:26:13 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (393 items) in: file:///var/lib/scrapyd/items/sourcing_v2/autorola.it/task_56_2026-03-31T23_15_00.jl
      2026-03-31 23:26:13 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
      {'downloader/exception_count': 1,
       'downloader/exception_type_count/zyte_api._errors.RequestError': 1,
       'downloader/request_bytes': 5350597,
       'downloader/request_count': 8324,
       'downloader/request_method_count/GET': 8322,
       'downloader/request_method_count/POST': 2,
       'downloader/response_bytes': 691086572,
       'downloader/response_count': 8323,
       'downloader/response_status_count/200': 4382,
       'downloader/response_status_count/301': 3934,
       'downloader/response_status_count/307': 6,
       'downloader/response_status_count/401': 1,
       'elapsed_time_seconds': 662.898658,
       'feedexport/success_count/FileFeedStorage': 1,
       'finish_reason': 'finished',
       'finish_time': datetime.datetime(2026, 3, 31, 23, 26, 13, 692467, tzinfo=datetime.timezone.utc),
       'item_dropped_count': 1,
       'item_dropped_reasons_count/DropItem': 1,
       'item_scraped_count': 393,
       'log_count/DEBUG': 62402,
       'log_count/INFO': 33953,
       'log_count/WARNING': 2,
       'memusage/max': 190173184,
       'memusage/startup': 151126016,
       'photo_download_count': 3940,
       'pipeline/dropped_missing_fields': 1,
       'request_depth_max': 12,
       'response_received_count': 443,
       'scheduler/dequeued': 8324,
       'scheduler/dequeued/memory': 8324,
       'scheduler/enqueued': 8324,
       'scheduler/enqueued/memory': 8324,
       'scrape_type/new': 395,
       'scrape_type/skipped': 392,
       'scrapy-zyte-api/429': 0,
       'scrapy-zyte-api/attempts': 421,
       'scrapy-zyte-api/error_ratio': 0.035629453681710214,
       'scrapy-zyte-api/error_types/download/website-ban': 14,
       'scrapy-zyte-api/error_types/website/connection-error': 1,
       'scrapy-zyte-api/errors': 15,
       'scrapy-zyte-api/fatal_errors': 1,
       'scrapy-zyte-api/mean_connection_seconds': 2.8755496348831775,
       'scrapy-zyte-api/mean_response_seconds': 2.798113294838115,
       'scrapy-zyte-api/processed': 407,
       'scrapy-zyte-api/request_args/customHttpRequestHeaders': 407,
       'scrapy-zyte-api/request_args/experimental.requestCookies': 396,
       'scrapy-zyte-api/request_args/experimental.responseCookies': 397,
       'scrapy-zyte-api/request_args/httpRequestBody': 2,
       'scrapy-zyte-api/request_args/httpRequestMethod': 2,
       'scrapy-zyte-api/request_args/httpResponseBody': 407,
       'scrapy-zyte-api/request_args/httpResponseHeaders': 407,
       'scrapy-zyte-api/request_args/sessionContext': 397,
       'scrapy-zyte-api/request_args/url': 407,
       'scrapy-zyte-api/status_codes/200': 406,
       'scrapy-zyte-api/status_codes/421': 1,
       'scrapy-zyte-api/status_codes/520': 14,
       'scrapy-zyte-api/success': 406,
       'scrapy-zyte-api/success_ratio': 0.9975429975429976,
       'scrapy-zyte-api/throttle_ratio': 0.0,
       'start_time': datetime.datetime(2026, 3, 31, 23, 15, 10, 793809, tzinfo=datetime.timezone.utc)}
      2026-03-31 23:26:13 [scrapy.core.engine] INFO: Spider closed (finished)
      2026-03-31 23:26:13 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f0f9d450910>
      2026-03-31 23:26:13 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f0f9d451110>
    • Log

      /2/log/utf8/sourcing_v2/autorola.it/task_56_2026-03-31T23_15_00/?job_finished=True

    • Source

      http://scrapyd-1:6800/logs/sourcing_v2/autorola.it/task_56_2026-03-31T23_15_00.log

  • sourcelog
    last_update_time2026-03-31 23:26:13
    last_update_timestamp1774999573
    downloader/exception_count1
    downloader/exception_type_count/zyte_api._errors.RequestError1
    downloader/request_bytes5350597
    downloader/request_count8324
    downloader/request_method_count/GET8322
    downloader/request_method_count/POST2
    downloader/response_bytes691086572
    downloader/response_count8323
    downloader/response_status_count/2004382
    downloader/response_status_count/3013934
    downloader/response_status_count/3076
    downloader/response_status_count/4011
    elapsed_time_seconds662.898658
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2026, 3, 31, 23, 26, 13, 692467, tzinfo=datetime.timezone.utc)
    item_dropped_count1
    item_dropped_reasons_count/DropItem1
    item_scraped_count393
    log_count/DEBUG62402
    log_count/INFO33953
    log_count/WARNING2
    memusage/max190173184
    memusage/startup151126016
    photo_download_count3940
    pipeline/dropped_missing_fields1
    request_depth_max12
    response_received_count443
    scheduler/dequeued8324
    scheduler/dequeued/memory8324
    scheduler/enqueued8324
    scheduler/enqueued/memory8324
    scrape_type/new395
    scrape_type/skipped392
    scrapy-zyte-api/4290
    scrapy-zyte-api/attempts421
    scrapy-zyte-api/error_ratio0.035629453681710214
    scrapy-zyte-api/error_types/download/website-ban14
    scrapy-zyte-api/error_types/website/connection-error1
    scrapy-zyte-api/errors15
    scrapy-zyte-api/fatal_errors1
    scrapy-zyte-api/mean_connection_seconds2.8755496348831775
    scrapy-zyte-api/mean_response_seconds2.798113294838115
    scrapy-zyte-api/processed407
    scrapy-zyte-api/request_args/customHttpRequestHeaders407
    scrapy-zyte-api/request_args/experimental.requestCookies396
    scrapy-zyte-api/request_args/experimental.responseCookies397
    scrapy-zyte-api/request_args/httpRequestBody2
    scrapy-zyte-api/request_args/httpRequestMethod2
    scrapy-zyte-api/request_args/httpResponseBody407
    scrapy-zyte-api/request_args/httpResponseHeaders407
    scrapy-zyte-api/request_args/sessionContext397
    scrapy-zyte-api/request_args/url407
    scrapy-zyte-api/status_codes/200406
    scrapy-zyte-api/status_codes/4211
    scrapy-zyte-api/status_codes/52014
    scrapy-zyte-api/success406
    scrapy-zyte-api/success_ratio0.9975429975429976
    scrapy-zyte-api/throttle_ratio0.0
    start_timedatetime.datetime(2026, 3, 31, 23, 15, 10, 793809, tzinfo=datetime.timezone.utc)