• LogParser v0.8.2, last updated at 2026-04-01 09:20:55, http://scrapyd-1:6800/logs/sourcing_v2/autorola.it/task_56_2026-04-01T09_15_00.json

PROJECT (sourcing_v2), SPIDER (autorola.it)

  • Log analysis
  • Log categorization
  • Progress visualization
  • View log
  • Crawler.stats
  • projectsourcing_v2
    spiderautorola.it
    jobtask_56_2026-04-01T09_15_00
    first_log_time2026-04-01 09:15:06
    latest_log_time2026-04-01 09:20:52
    runtime0:05:46
    crawled_pages 327
    scraped_items 136
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count463
    log_warning_count2
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A
    • WARNING+

    • error_logs
      last 10 of 463

      2026-04-01 09:18:49 [crawlers.pipelines.post_to_api] ERROR: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      Traceback (most recent call last):
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-01 09:18:49 [scrapy.core.scraper] ERROR: Error processing {'auction_title': 'Arval Damaged Cars',
       'color': 'PN',
       'currency': 'EUR',
       'doors_number': 2,
       'engine': '2.0L',
       'engine_horse_power': 125,
       'expiration_date': '2026-04-01T13:11:30.000+00:00',
       'fuel_type': 'Diesel',
       'id': 'b8e8e938-dc15-5c6f-ad1f-c52697ad79d4',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'GD***BH',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25539729&aid=662588',
       'listing': 'auction',
       'location': 'IT, Emilia-Romagna',
       'make': 'Ford',
       'model': 'Ranger',
       'odometer': 90853,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 0,
       'price': 10000,
       'price_includes_vat': False,
       'registration_date': '2020-11-25',
       'seller_name': None,
       'title': 'Ford Ranger',
       'transmission': 'manual',
       'trim': '2019 / 2P / PICKUP XL 4WD 2.0 TDCI 170CV',
       'vin': None,
       'year': 2020}
      Traceback (most recent call last):
        File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
          current.result = callback(  # type: ignore[misc]
        File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
          return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
          raise e
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-01 09:18:50 [crawlers.pipelines.post_to_api] ERROR: autorola.it, item_id 2ddea035-053d-587b-b9af-8f3a657f83a8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
       | Status Code: 503
       | Response Content: Service Unavailable
       | Response Headers: {'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Date': 'Wed, 01 Apr 2026 09:18:50 GMT', 'Content-Length': '19', 'Content-Type': 'text/plain; charset=utf-8'}
      
      2026-04-01 09:18:50 [crawlers.pipelines.post_to_api] ERROR: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      Traceback (most recent call last):
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-01 09:18:50 [scrapy.core.scraper] ERROR: Error processing {'auction_title': 'Guidi Car',
       'car_expert_report_source_url': 'https://g.autorola.com/g/i/show.carpicture?t=b&guid=1e882362-b67e-4572-ae35-5afa2e1097d8',
       'color': 'Bianco',
       'currency': 'EUR',
       'engine': '',
       'engine_horse_power': 85,
       'expiration_date': '2026-04-02T09:35:30.000+00:00',
       'fuel_type': 'Diesel',
       'id': '2ddea035-053d-587b-b9af-8f3a657f83a8',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'FV***KH',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25539186&aid=662586',
       'listing': 'auction',
       'location': 'IT, Toscana',
       'make': 'BMW',
       'model': 'Serie 3 316d Touring Business Advantage auto',
       'odometer': 90453,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 0,
       'price': 9600,
       'price_includes_vat': False,
       'registration_date': '2019-02-27',
       'seller_name': None,
       'title': 'BMW Serie 3 316d Touring Business Advantage auto',
       'transmission': 'automatic',
       'trim': 'BMW Serie 3 316d Touring Business Advantage auto',
       'vin': None,
       'year': 2019}
      Traceback (most recent call last):
        File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
          current.result = callback(  # type: ignore[misc]
        File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
          return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
          raise e
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-01 09:18:50 [crawlers.pipelines.post_to_api] ERROR: autorola.it, item_id aa25fc0f-a490-5cc9-894c-b6c9e098c4b9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
       | Status Code: 503
       | Response Content: Service Unavailable
       | Response Headers: {'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Date': 'Wed, 01 Apr 2026 09:18:50 GMT', 'Content-Length': '19', 'Content-Type': 'text/plain; charset=utf-8'}
      
      2026-04-01 09:18:50 [crawlers.pipelines.post_to_api] ERROR: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      Traceback (most recent call last):
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-01 09:18:50 [scrapy.core.scraper] ERROR: Error processing {'auction_title': 'ARVAL HYBRID AND ELECTRIC',
       'color': 'Unknown',
       'currency': 'EUR',
       'doors_number': 5,
       'engine': '1.5L',
       'engine_horse_power': 192,
       'expiration_date': '2026-04-02T08:01:00.000+00:00',
       'fuel_type': 'Hybrid (Petrol)',
       'id': 'aa25fc0f-a490-5cc9-894c-b6c9e098c4b9',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'GE***CZ',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25540411&aid=662590',
       'listing': 'auction',
       'location': 'IT, Emilia-Romagna',
       'make': 'Volvo',
       'model': 'XC40',
       'odometer': 88362,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 0,
       'price': 11400,
       'price_includes_vat': False,
       'registration_date': '2021-02-18',
       'seller_name': None,
       'title': 'Volvo XC40',
       'transmission': 'automatic',
       'trim': '2017 / 5P / FUORISTRADA T4 PLUG-IN HYBRID AUTO RECH INSC EXPR N1',
       'vin': None,
       'year': 2021}
      Traceback (most recent call last):
        File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
          current.result = callback(  # type: ignore[misc]
        File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 340, in f
          return deferred_from_coro(coro_f(*coro_args, **coro_kwargs))
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 114, in process_item
          raise e
        File "/usr/src/app/crawlers/pipelines/post_to_api.py", line 94, in process_item
          response.raise_for_status()
        File "/usr/local/lib/python3.11/dist-packages/requests/models.py", line 1021, in raise_for_status
          raise HTTPError(http_error_msg, response=self)
      requests.exceptions.HTTPError: 503 Server Error: Service Unavailable for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-04-01 09:20:52 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f24c2976e10>
      2026-04-01 09:20:52 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f24c2977690>
    • warning_logs
      2 in total

      2026-04-01 09:16:22 [autorola.it] WARNING: Error getting enrollment for ad 25528596: [Failure instance: Traceback: <class 'zyte_api._errors.RequestError'>: RequestError: 421, message=, headers=<CIMultiDictProxy('Date': 'Wed, 01 Apr 2026 09:16:17 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '277', 'Connection': 'keep-alive', 'Request-Id': '791b698528dac888ce0d90b2ed87d689', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/website/connection-error","title":"Website Connection Error","status":421,"detail":"Failed to establish a network connection to the website. This could be due to the server being down or network connectivity issues. Verify the website is operational and accessible."}', request_id=791b698528dac888ce0d90b2ed87d689
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:916:errback
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:984:_startRunCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1078:_runCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1949:_gotResultInlineCallbacks
      --- <exception caught here> ---
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1999:_inlineCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/python/failure.py:519:throwExceptionIntoGenerator
      /usr/local/lib/python3.11/dist-packages/scrapy/core/downloader/middleware.py:54:process_request
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1251:adapt
      /usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/handler.py:257:_download_request
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:54:get
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:168:get
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:142:async_wrapped
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:58:__call__
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:110:iter
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:78:inner
      /usr/local/lib/python3.11/dist-packages/tenacity/__init__.py:390:<lambda>
      /usr/lib/python3.11/concurrent/futures/_base.py:449:result
      /usr/lib/python3.11/concurrent/futures/_base.py:401:__get_result
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:61:__call__
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:142:request
      ]
      2026-04-01 09:16:51 [autorola.it] WARNING: Error getting enrollment for ad 25535910: [Failure instance: Traceback: <class 'zyte_api._errors.RequestError'>: RequestError: 421, message=, headers=<CIMultiDictProxy('Date': 'Wed, 01 Apr 2026 09:16:50 GMT', 'Content-Type': 'application/problem+json', 'Content-Length': '277', 'Connection': 'keep-alive', 'Request-Id': '2c312aff51b6f6ab473911b4902f69af', 'Vary': 'Accept-Encoding', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Access-Control-Allow-Credentials': 'true', 'Access-Control-Expose-Headers': '*, X-Project-Key', 'Access-Control-Allow-Methods': 'GET, PUT, POST, DELETE, PATCH, OPTIONS', 'Access-Control-Allow-Headers': 'DNT, Keep-Alive, User-Agent, X-Requested-With, If-Modified-Since, Cache-Control, Content-Type, Range, Authorization, X-Project-Key', 'Access-Control-Max-Age': '1728000')>, body=b'{"type":"/website/connection-error","title":"Website Connection Error","status":421,"detail":"Failed to establish a network connection to the website. This could be due to the server being down or network connectivity issues. Verify the website is operational and accessible."}', request_id=2c312aff51b6f6ab473911b4902f69af
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:916:errback
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:984:_startRunCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1078:_runCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1949:_gotResultInlineCallbacks
      --- <exception caught here> ---
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1999:_inlineCallbacks
      /usr/local/lib/python3.11/dist-packages/twisted/python/failure.py:519:throwExceptionIntoGenerator
      /usr/local/lib/python3.11/dist-packages/scrapy/core/downloader/middleware.py:54:process_request
      /usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py:1251:adapt
      /usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/handler.py:257:_download_request
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:54:get
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:168:get
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:142:async_wrapped
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:58:__call__
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:110:iter
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:78:inner
      /usr/local/lib/python3.11/dist-packages/tenacity/__init__.py:390:<lambda>
      /usr/lib/python3.11/concurrent/futures/_base.py:449:result
      /usr/lib/python3.11/concurrent/futures/_base.py:401:__get_result
      /usr/local/lib/python3.11/dist-packages/tenacity/_asyncio.py:61:__call__
      /usr/local/lib/python3.11/dist-packages/zyte_api/_async.py:142:request
      ]

      INFO

      DEBUG

    • scrapy_version

      2.11.2
    • telnet_console

      127.0.0.1:6023
    • telnet_password

      acb9f069565480d0
    • latest_crawl

      2026-04-01 09:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25539160?locale=en_GB_d11> (referer: https://www.autorola.fr/en/dealer/search?tnoipp=100&tsri=3&tsd=UP&tcsp=3&country=IT) ['zyte-api']
    • latest_scrape

      2026-04-01 09:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25539160?locale=en_GB_d11>
    • latest_stat

      2026-04-01 09:20:12 [scrapy.extensions.logstats] INFO: Crawled 283 pages (at 71 pages/min), scraped 99 items (at 56 items/min)
    • Head

      2026-04-01 09:15:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
      2026-04-01 09:15:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
      2026-04-01 09:15:06 [autorola.it] INFO: Starting spider autorola.it
      2026-04-01 09:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alx-prod-supplier-kv.vault.azure.net:443
      2026-04-01 09:15:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 401 108
      2026-04-01 09:15:06 [azure.identity._credentials.default] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
      2026-04-01 09:15:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4 HTTP/1.1" 200 7025
      2026-04-01 09:15:06 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdE5EQkZSRVZHUlVZdFFVSXpOUzAwTXpVMUxUazNPVVl0UWpVNVJURXdOVGs0TnpVNUlUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHhNVGswUmpWR1F6ZzFOekkwTXpKRFFqQkZRVVl4UVVORE5UVTRPRFU1UXkwdFJVWkZSVGN6TVRNdE1EWXpSaTAwUkVKRUxUZzJNVGN0TkRrNVJFSkVSak0wTVRVM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpORFU1TlRnME5UZzFOMEUwUlRZeU9VRkRSVVE0UTBNek5FSTRNamRDTmkwdE1rRXdRekpFUkRrdFJUVTJOUzAwTVVRM0xUazBSRFl0UVVFeVJrWXlRMEUxTTBaR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:07 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMHpOek5HUWpBME9UY3dNa00wTjBNNU9ERkJRamxCTXpORVJqaEVOamt4UVMwdE5VRTFSa0pHTlVRdFFqWTFRaTAwUkRkRUxUaERORVV0TWpoRE1UQkVRalF5TXpnM0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFOalF3TmpsRk5VTTROVFUwUXpORk9USkZNa015TWtKR1JFRkRSak5ETlMwdFEwSXpOME5HTnpVdFJFTkdNUzAwTWpZekxUZzVSRVV0TmtRd1JrVTJPVFUyUmpnd0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDFSVGt4TURGQk9UazJSRGMwTmpBeFFqVkVSVUk0T1VFMk56UTFNVFl5T1MwdFFUUTROREk0UWprdFJUSTBPUzAwTmprMkxVRkJORFF0TmpjNE1rWXdPVEpCTkRNMElUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:08 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMDVNVE5DTXpjMFJrWkVNVU0wTWpRMVFUTkVORUkyT0RjMk5ETTNNVUpHUWkwdE1qSkNRa1JEUVVJdE1VRkJReTAwTTBRMExUaERSREV0UVRSRk9FSTVNelZDUVVaQ0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 6760
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMUNPRE5DUlRJd1F6YzBOMFUwUkRRNFFURTNSVVUxTVVJd1FUSTNNMEl5UmkwdE1USTJRa001UWpFdFJESkROUzAwT0RGRExUbEZRMFV0UmtKRlFrVXhNVGRGTnpJNElUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdE5FSXlRalpETVVRdE0wRTFRUzAwTnpVMUxVSXhRa010UlVFM09UVTRRVGM1TkRWRklUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 7025
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets?api-version=7.4&$skiptoken=eyJOZXh0TWFya2VyIjoiMiExNzYhTURBd01EZzJJWE5sWTNKbGRDOVRWVkJRVEVsRlVpMURNVGt6TjBaQlEwTTNPVEkwT0RWRFFqYzBNVEZFUmtJek5EZ3hRalUwT0MwdFJFRTFRa0V5TVRRdE1VTTRNeTAwT0VRNExUa3lNVGd0T1RjelFUWkNNMEZETWtGR0lUQXdNREF5T0NFNU9UazVMVEV5TFRNeFZESXpPalU1T2pVNUxqazVPVGs1T1RsYUlRLS0iLCJUYXJnZXRMb2NhdGlvbiI6MH0 HTTP/1.1" 200 3207
      2026-04-01 09:15:09 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Found 32 secrets matching prefix 'supplier-34595845857a4e629aced8cc34b827b6'
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--049ac44f-883a-4f6a-99ef-8c7163dd0039/?api-version=7.4 HTTP/1.1" 200 362
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0c71dde0-a341-4fb0-9da3-592ba8e64bc5/?api-version=7.4 HTTP/1.1" 200 359
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--0cac73f8-4a36-4bd6-a9cd-84fc809d250b/?api-version=7.4 HTTP/1.1" 200 378
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1007d598-dcb8-4e2c-bb67-46005eeb2e33/?api-version=7.4 HTTP/1.1" 200 376
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--10ad0a56-ff18-4514-897f-7694eca264d9/?api-version=7.4 HTTP/1.1" 200 372
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--18a19b8b-bd50-401a-b495-173bfa476be8/?api-version=7.4 HTTP/1.1" 200 374
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--1d7dd170-abc0-4364-95dd-e034a8fdad79/?api-version=7.4 HTTP/1.1" 200 379
      2026-04-01 09:15:09 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--22bbdcab-1aac-43d4-8cd1-a4e8b935bafb/?api-version=7.4 HTTP/1.1" 200 373
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2a0c2dd9-e565-41d7-94d6-aa2ff2ca53ff/?api-version=7.4 HTTP/1.1" 200 384
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--2bcd417e-2bed-444a-89fc-968c561d5bb6/?api-version=7.4 HTTP/1.1" 200 382
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--3df06c9e-a1a7-4540-9fdc-21437026350a/?api-version=7.4 HTTP/1.1" 200 376
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--43fba682-1974-47e0-83e2-1a3b7ee779e6/?api-version=7.4 HTTP/1.1" 200 385
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4438b5c9-a031-4ef8-82ab-a266f5530b7e/?api-version=7.4 HTTP/1.1" 200 385
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--4b2b6c1d-3a5a-4755-b1bc-ea7958a7945e/?api-version=7.4 HTTP/1.1" 200 375
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5c68eaa9-f96e-42ae-8216-d82663279262/?api-version=7.4 HTTP/1.1" 200 384
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--5f737a37-75da-44ad-a2b6-a48c62fadbc1/?api-version=7.4 HTTP/1.1" 200 363
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72077223-a76f-4725-93a5-6ac88e8b83cc/?api-version=7.4 HTTP/1.1" 200 390
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--72f99394-abfe-48d3-81bf-3d0f17d2f73e/?api-version=7.4 HTTP/1.1" 200 362
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--846d9461-cf8f-4a26-a2d0-dbc368748685/?api-version=7.4 HTTP/1.1" 200 385
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--86134377-e487-46da-bd8a-b801bf6d1330/?api-version=7.4 HTTP/1.1" 200 374
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--8716adb9-9f0f-42e0-93a8-1f484f5645f1/?api-version=7.4 HTTP/1.1" 200 379
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--9c556c27-4949-4575-bfed-5c2824c32e76/?api-version=7.4 HTTP/1.1" 200 378
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--a68716de-e747-41de-b415-2cf76644906d/?api-version=7.4 HTTP/1.1" 200 382
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--aaa3e65e-ab19-4523-92a3-c74c27c52b74/?api-version=7.4 HTTP/1.1" 200 377
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ac2e2209-4b0f-465e-bf2c-1beab246f412/?api-version=7.4 HTTP/1.1" 200 360
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--bcce0ba1-00f7-4b4a-b89e-eb41dd71987c/?api-version=7.4 HTTP/1.1" 200 381
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c7564b14-e84f-423b-983f-1c56459860bb/?api-version=7.4 HTTP/1.1" 200 395
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--c900b3f0-b90a-4dc6-a453-2691c3d42678/?api-version=7.4 HTTP/1.1" 200 369
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d2711035-d463-4d98-86c0-4e152597d0dd/?api-version=7.4 HTTP/1.1" 200 380
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--d5102885-a6d7-40ee-b697-b94712725108/?api-version=7.4 HTTP/1.1" 200 386
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--e26d41d5-d812-4e6c-a488-95d7cc51811b/?api-version=7.4 HTTP/1.1" 200 382
      2026-04-01 09:15:10 [urllib3.connectionpool] DEBUG: https://alx-prod-supplier-kv.vault.azure.net:443 "GET /secrets/supplier-34595845857a4e629aced8cc34b827b6--ef5b82a3-ff5e-4bd6-8101-328b1cbd3975/?api-version=7.4 HTTP/1.1" 200 395
      2026-04-01 09:15:10 [common.supplier_credentials.credential_service] INFO: [SupplierCredentials] Successfully decrypted 32 credentials
      2026-04-01 09:15:10 [autorola.it] INFO: Using credential [vault:18a19b8b-bd50-401a-b495-173bfa476be8] (32 remaining in queue)
      2026-04-01 09:15:10 [scrapy.addons] INFO: Enabled addons:
      []
      2026-04-01 09:15:10 [asyncio] DEBUG: Using selector: EpollSelector
      2026-04-01 09:15:10 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-04-01 09:15:10 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-04-01 09:15:10 [scrapy.extensions.telnet] INFO: Telnet Password: acb9f069565480d0
      2026-04-01 09:15:11 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats',
       'scrapy.extensions.closespider.CloseSpider']
      2026-04-01 09:15:11 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'SourcingV2',
       'CLOSESPIDER_TIMEOUT': 7200,
       'DOWNLOAD_MAXSIZE': 52428800,
       'DOWNLOAD_WARNSIZE': 10485760,
       'FEED_EXPORT_ENCODING': 'utf-8',
       'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/autorola.it/task_56_2026-04-01T09_15_00.log',
       'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
       'MEMUSAGE_LIMIT_MB': 2048,
       'MEMUSAGE_WARNING_MB': 1536,
       'NEWSPIDER_MODULE': 'spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
       'SPIDER_MODULES': ['spiders', 'auth_check'],
       'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
       'USER_AGENT': ''}
      2026-04-01 09:15:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-04-01 09:15:11 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-04-01 09:15:11 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-04-01 09:15:11 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
      2026-04-01 09:15:11 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
    • Tail

      2026-04-01 09:20:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: autorola.it, Translating item: 2199b0b7-d4d9-5889-92df-b47b088b416f with identifier: 25539716
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=fr&q=- HTTP/1.1" 200 None
      2026-04-01 09:20:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='fr',RowKey='fr') HTTP/1.1" 204 0
      2026-04-01 09:20:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: autorola.it, Applying rules to item: 2199b0b7-d4d9-5889-92df-b47b088b416f with identifier: 25539716
      2026-04-01 09:20:50 [crawlers.pipelines.post_to_api] INFO: Spider: autorola.it, Posting item: 2199b0b7-d4d9-5889-92df-b47b088b416f with identifier: 25539716 to the API
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
      2026-04-01 09:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25539716?locale=en_GB_d11>
      {'auction_title': 'Arval Damaged Cars',
       'color': None,
       'currency': 'EUR',
       'doors_number': 4,
       'engine': '1.2L',
       'engine_horse_power': 70,
       'expiration_date': '2026-04-01T13:05:00.000+00:00',
       'fuel_type': 'Diesel',
       'id': '2199b0b7-d4d9-5889-92df-b47b088b416f',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'FS***DN',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25539716&aid=662588',
       'listing': 'auction',
       'location': 'IT, Lombardia',
       'make': 'Fiat',
       'model': 'Doblo Cargo',
       'odometer': 110507,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 0,
       'price': 2400,
       'price_includes_vat': False,
       'registration_date': '2018-07-17',
       'seller_name': None,
       'title': 'Fiat Doblo Cargo',
       'transmission': 'manual',
       'trim': '2014 / 4P / VETT. FURGONATA MAXI 1.3 MULTIJET 16V 95CV SX EURO 6',
       'vin': None,
       'year': 2018}
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20RowKey%20eq%20%2725539716%27 HTTP/1.1" 200 None
      2026-04-01 09:20:50 [autorola.it] INFO: Saving data for 25539716: {'auction_closing_time': 1775048700.0, 'created_time': 1774946753.545108, 'last_price_update_time': 1775035250.848298}
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='autorola.it',RowKey='25539716') HTTP/1.1" 204 0
      2026-04-01 09:20:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: autorola.it, Translating item: bdccc2ce-10f2-525f-b92e-eec2d4c98456 with identifier: 25506872
      2026-04-01 09:20:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: autorola.it, Applying rules to item: bdccc2ce-10f2-525f-b92e-eec2d4c98456 with identifier: 25506872
      2026-04-01 09:20:50 [crawlers.pipelines.post_to_api] INFO: Spider: autorola.it, Posting item: bdccc2ce-10f2-525f-b92e-eec2d4c98456 with identifier: 25506872 to the API
      2026-04-01 09:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
      2026-04-01 09:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25506872?locale=en_GB_d11>
      {'auction_title': 'Autorola Mix - Più di 150.000 km',
       'color': 'Unknown',
       'currency': 'EUR',
       'engine': '1.2L',
       'engine_horse_power': 69,
       'expiration_date': '2026-04-01T14:01:00.000+00:00',
       'fuel_type': 'LPG',
       'id': 'bdccc2ce-10f2-525f-b92e-eec2d4c98456',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'FA***BZ',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25506872&aid=661896',
       'listing': 'auction',
       'location': 'IT, Campania',
       'make': 'Fiat',
       'model': '500',
       'odometer': 108763,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 0,
       'price': 5100,
       'price_includes_vat': False,
       'registration_date': '2015-06-26',
       'seller_name': None,
       'title': 'Fiat 500',
       'transmission': 'manual',
       'trim': '1.2 benzina / gpl',
       'vin': None,
       'year': 2015}
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20RowKey%20eq%20%2725506872%27 HTTP/1.1" 200 None
      2026-04-01 09:20:51 [autorola.it] INFO: Saving data for 25506872: {'auction_closing_time': 1775052060.0, 'created_time': 1774946747.948656, 'last_price_update_time': 1775035251.144846}
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='autorola.it',RowKey='25506872') HTTP/1.1" 204 0
      2026-04-01 09:20:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: autorola.it, Translating item: 02b331d1-3b3b-5469-9c53-c02e80326671 with identifier: 25539160
      2026-04-01 09:20:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: autorola.it, Applying rules to item: 02b331d1-3b3b-5469-9c53-c02e80326671 with identifier: 25539160
      2026-04-01 09:20:51 [crawlers.pipelines.post_to_api] INFO: Spider: autorola.it, Posting item: 02b331d1-3b3b-5469-9c53-c02e80326671 with identifier: 25539160 to the API
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
      2026-04-01 09:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://mobilebidding.mp.autorolaapis.com/rest/enrollments/25539160?locale=en_GB_d11>
      {'auction_title': 'Guidi Car',
       'car_expert_report_source_url': 'https://g.autorola.com/g/i/show.carpicture?t=b&guid=fc5ebffd-5ef5-4172-bc54-4d1cc2c5fea7',
       'color': 'Bianco',
       'currency': 'EUR',
       'doors_number': 4,
       'engine': '',
       'engine_horse_power': 51,
       'expiration_date': '2026-04-02T09:53:00.000+00:00',
       'fuel_type': 'LPG',
       'id': '02b331d1-3b3b-5469-9c53-c02e80326671',
       'is_damaged': False,
       'is_operable': True,
       'is_vat_deductible': False,
       'is_vat_included': False,
       'license_plate': 'FB***MC',
       'link_to_web_offer': 'https://www.autorola.fr/en/dealer/bid?zz=1&cameFrom=SEARCH&eid=25539160&aid=662586',
       'listing': 'auction',
       'location': 'IT, Toscana',
       'make': 'Fiat',
       'model': 'Qubo 1.4 8v Natural Power Dynamic 70cv E6 Metano',
       'odometer': 111160,
       'odometer_reading_unit': 'mi',
       'origin_country_code': 'IT',
       'original_photo_count': 0,
       'price': 2300,
       'price_includes_vat': False,
       'registration_date': '2015-12-18',
       'seller_name': None,
       'title': 'Fiat Qubo 1.4 8v Natural Power Dynamic 70cv E6 Metano',
       'transmission': 'manual',
       'trim': 'Fiat Qubo 1.4 8v Natural Power Dynamic 70cv E6 Metano',
       'vin': None,
       'year': 2015}
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20RowKey%20eq%20%2725539160%27 HTTP/1.1" 200 None
      2026-04-01 09:20:51 [autorola.it] INFO: Saving data for 25539160: {'auction_closing_time': 1775123580.0, 'created_time': 1774947171.996723, 'last_price_update_time': 1775035251.496497}
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='autorola.it',RowKey='25539160') HTTP/1.1" 204 0
      2026-04-01 09:20:51 [scrapy.core.engine] INFO: Closing spider (finished)
      2026-04-01 09:20:51 [autorola.it] INFO: autorola.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 8, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-04-01 09:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27autorola.it%27%20and%20last_price_update_time%20lt%201774603251 HTTP/1.1" 200 None
      2026-04-01 09:20:51 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (136 items) in: file:///var/lib/scrapyd/items/sourcing_v2/autorola.it/task_56_2026-04-01T09_15_00.jl
      2026-04-01 09:20:51 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
      {'downloader/exception_count': 2,
       'downloader/exception_type_count/zyte_api._errors.RequestError': 2,
       'downloader/request_bytes': 524913,
       'downloader/request_count': 329,
       'downloader/request_method_count/GET': 328,
       'downloader/request_method_count/POST': 1,
       'downloader/response_bytes': 6822246,
       'downloader/response_count': 327,
       'downloader/response_status_count/200': 327,
       'elapsed_time_seconds': 340.328888,
       'feedexport/success_count/FileFeedStorage': 1,
       'finish_reason': 'finished',
       'finish_time': datetime.datetime(2026, 4, 1, 9, 20, 51, 865947, tzinfo=datetime.timezone.utc),
       'item_dropped_count': 30,
       'item_dropped_reasons_count/DropItem': 30,
       'item_scraped_count': 136,
       'log_count/DEBUG': 4193,
       'log_count/ERROR': 463,
       'log_count/INFO': 4136,
       'log_count/WARNING': 2,
       'memusage/max': 176607232,
       'memusage/startup': 149123072,
       'pipeline/dropped_expired': 10,
       'pipeline/dropped_missing_fields': 20,
       'request_depth_max': 6,
       'response_received_count': 327,
       'scheduler/dequeued': 329,
       'scheduler/dequeued/memory': 329,
       'scheduler/enqueued': 329,
       'scheduler/enqueued/memory': 329,
       'scrape_type/price_update': 322,
       'scrape_type/skipped': 77,
       'scrapy-zyte-api/429': 0,
       'scrapy-zyte-api/attempts': 329,
       'scrapy-zyte-api/error_ratio': 0.0060790273556231,
       'scrapy-zyte-api/error_types/website/connection-error': 2,
       'scrapy-zyte-api/errors': 2,
       'scrapy-zyte-api/fatal_errors': 2,
       'scrapy-zyte-api/mean_connection_seconds': 7.790392927565021,
       'scrapy-zyte-api/mean_response_seconds': 7.684533925721317,
       'scrapy-zyte-api/processed': 329,
       'scrapy-zyte-api/request_args/customHttpRequestHeaders': 329,
       'scrapy-zyte-api/request_args/experimental.requestCookies': 322,
       'scrapy-zyte-api/request_args/experimental.responseCookies': 323,
       'scrapy-zyte-api/request_args/httpRequestBody': 1,
       'scrapy-zyte-api/request_args/httpRequestMethod': 1,
       'scrapy-zyte-api/request_args/httpResponseBody': 329,
       'scrapy-zyte-api/request_args/httpResponseHeaders': 329,
       'scrapy-zyte-api/request_args/sessionContext': 323,
       'scrapy-zyte-api/request_args/url': 329,
       'scrapy-zyte-api/status_codes/200': 327,
       'scrapy-zyte-api/status_codes/421': 2,
       'scrapy-zyte-api/success': 327,
       'scrapy-zyte-api/success_ratio': 0.993920972644377,
       'scrapy-zyte-api/throttle_ratio': 0.0,
       'start_time': datetime.datetime(2026, 4, 1, 9, 15, 11, 537059, tzinfo=datetime.timezone.utc)}
      2026-04-01 09:20:51 [scrapy.core.engine] INFO: Spider closed (finished)
      2026-04-01 09:20:52 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f24c2976e10>
      2026-04-01 09:20:52 [asyncio] ERROR: Unclosed client session
      client_session: <aiohttp.client.ClientSession object at 0x7f24c2977690>
    • Log

      /2/log/utf8/sourcing_v2/autorola.it/task_56_2026-04-01T09_15_00/?job_finished=True

    • Source

      http://scrapyd-1:6800/logs/sourcing_v2/autorola.it/task_56_2026-04-01T09_15_00.log

  • sourcelog
    last_update_time2026-04-01 09:20:51
    last_update_timestamp1775035251
    downloader/exception_count2
    downloader/exception_type_count/zyte_api._errors.RequestError2
    downloader/request_bytes524913
    downloader/request_count329
    downloader/request_method_count/GET328
    downloader/request_method_count/POST1
    downloader/response_bytes6822246
    downloader/response_count327
    downloader/response_status_count/200327
    elapsed_time_seconds340.328888
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2026, 4, 1, 9, 20, 51, 865947, tzinfo=datetime.timezone.utc)
    item_dropped_count30
    item_dropped_reasons_count/DropItem30
    item_scraped_count136
    log_count/DEBUG4193
    log_count/ERROR463
    log_count/INFO4136
    log_count/WARNING2
    memusage/max176607232
    memusage/startup149123072
    pipeline/dropped_expired10
    pipeline/dropped_missing_fields20
    request_depth_max6
    response_received_count327
    scheduler/dequeued329
    scheduler/dequeued/memory329
    scheduler/enqueued329
    scheduler/enqueued/memory329
    scrape_type/price_update322
    scrape_type/skipped77
    scrapy-zyte-api/4290
    scrapy-zyte-api/attempts329
    scrapy-zyte-api/error_ratio0.0060790273556231
    scrapy-zyte-api/error_types/website/connection-error2
    scrapy-zyte-api/errors2
    scrapy-zyte-api/fatal_errors2
    scrapy-zyte-api/mean_connection_seconds7.790392927565021
    scrapy-zyte-api/mean_response_seconds7.684533925721317
    scrapy-zyte-api/processed329
    scrapy-zyte-api/request_args/customHttpRequestHeaders329
    scrapy-zyte-api/request_args/experimental.requestCookies322
    scrapy-zyte-api/request_args/experimental.responseCookies323
    scrapy-zyte-api/request_args/httpRequestBody1
    scrapy-zyte-api/request_args/httpRequestMethod1
    scrapy-zyte-api/request_args/httpResponseBody329
    scrapy-zyte-api/request_args/httpResponseHeaders329
    scrapy-zyte-api/request_args/sessionContext323
    scrapy-zyte-api/request_args/url329
    scrapy-zyte-api/status_codes/200327
    scrapy-zyte-api/status_codes/4212
    scrapy-zyte-api/success327
    scrapy-zyte-api/success_ratio0.993920972644377
    scrapy-zyte-api/throttle_ratio0.0
    start_timedatetime.datetime(2026, 4, 1, 9, 15, 11, 537059, tzinfo=datetime.timezone.utc)