• LogParser v0.8.2, last updated at 2026-03-13 08:49:23, http://scrapyd-4:6800/logs/sourcing_v2/arval.fr/2026-03-13T07_39_13.json

PROJECT (sourcing_v2), SPIDER (arval.fr)

Click to refresh Realtime version
  • Log analysis
  • Log categorization
  • Progress visualization
  • View log
  • projectsourcing_v2
    spiderarval.fr
    job2026-03-13T07_39_13
    first_log_time2026-03-13 07:39:19
    latest_log_time2026-03-13 08:49:20
    runtime1:10:01
    crawled_pages 85
    scraped_items 13
    shutdown_reasonN/A
    finish_reasonN/A
    log_critical_count0
    log_error_count0
    log_warning_count0
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A
    • WARNING+

      INFO

      DEBUG

    • scrapy_version

      2.11.2
    • telnet_console

      127.0.0.1:6024
    • telnet_password

      8cd015149dccaaa0
    • latest_crawl

      2026-03-13 08:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/5/113502> (referer: https://autoselect.arval.fr) ['zyte-api']
    • latest_stat

      2026-03-13 08:49:20 [scrapy.extensions.logstats] INFO: Crawled 85 pages (at 3 pages/min), scraped 13 items (at 1 items/min)
    • Head

      2026-03-13 07:39:19 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
      2026-03-13 07:39:19 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
      2026-03-13 07:39:19 [arval.fr] INFO: Starting spider arval.fr [deploy-check: 2026-03-12T15:10]
      2026-03-13 07:39:19 [scrapy.addons] INFO: Enabled addons:
      []
      2026-03-13 07:39:19 [asyncio] DEBUG: Using selector: EpollSelector
      2026-03-13 07:39:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-03-13 07:39:19 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      
      2026-03-13 07:39:19 [scrapy.extensions.telnet] INFO: Telnet Password: 8cd015149dccaaa0
      2026-03-13 07:39:19 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats',
       'scrapy.extensions.closespider.CloseSpider']
      2026-03-13 07:39:19 [scrapy.crawler] INFO: Overridden settings:
      {'BOT_NAME': 'SourcingV2',
       'CLOSESPIDER_TIMEOUT': 7200,
       'DOWNLOAD_DELAY': 1,
       'DOWNLOAD_MAXSIZE': 52428800,
       'DOWNLOAD_WARNSIZE': 10485760,
       'FEED_EXPORT_ENCODING': 'utf-8',
       'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/arval.fr/2026-03-13T07_39_13.log',
       'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
       'MEMUSAGE_LIMIT_MB': 2048,
       'MEMUSAGE_WARNING_MB': 1536,
       'NEWSPIDER_MODULE': 'spiders',
       'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
       'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
       'SPIDER_MODULES': ['spiders', 'auth_check'],
       'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
       'USER_AGENT': ''}
      2026-03-13 07:39:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-03-13 07:39:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
      2026-03-13 07:39:19 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-03-13 07:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
      2026-03-13 07:39:19 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
       'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
       'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
       'scrapy.spidermiddlewares.referer.RefererMiddleware',
       'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
       'scrapy.spidermiddlewares.depth.DepthMiddleware',
       'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
       'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
       'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
      2026-03-13 07:39:19 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
      2026-03-13 07:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
      2026-03-13 07:39:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
      2026-03-13 07:39:19 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
      2026-03-13 07:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
      2026-03-13 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 07:39:20 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: fr
      2026-03-13 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27fr%27%20and%20RowKey%20eq%20%27fr%27 HTTP/1.1" 200 None
      2026-03-13 07:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
      2026-03-13 07:39:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
      2026-03-13 07:39:20 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
      2026-03-13 07:39:20 [scrapy.middleware] INFO: Enabled item pipelines:
      ['crawlers.pipelines.translation_pipeline.TranslationPipeline',
       'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
       'crawlers.pipelines.post_to_api.PostToApiPipeline']
      2026-03-13 07:39:20 [scrapy.core.engine] INFO: Spider opened
      2026-03-13 07:39:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
      2026-03-13 07:39:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
      2026-03-13 07:39:20 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
      2026-03-13 07:39:20 [scrapy-playwright] INFO: Starting download handler
      2026-03-13 07:39:20 [scrapy-playwright] INFO: Starting download handler
      2026-03-13 07:39:25 [scrapy-playwright] INFO: Launching browser firefox
      2026-03-13 07:39:25 [scrapy-playwright] INFO: Browser firefox launched
    • Tail

                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112595/8.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112595/9.jpeg'],
       'photos': [],
       'price': 19190.0,
       'price_includes_vat': True,
       'registration_date': '2022-06-27',
       'seats_number': 0,
       'seller_name': None,
       'title': 'Hyundai Kona Business Electrique 2WD 64kWh BVA',
       'transmission': 'automatic',
       'trim': 'Business Electrique 2WD 64kWh BVA',
       'vin': 'TMAK381GFNJ056881',
       'year': 2022}
      2026-03-13 08:45:37 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
      2026-03-13 08:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27112595%27 HTTP/1.1" 200 None
      2026-03-13 08:45:37 [arval.fr] INFO: Saving data for 112595: {'created_time': 1773391537.32773, 'last_price_update_time': 1773391537.327741}
      2026-03-13 08:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='arval.fr',RowKey='112595') HTTP/1.1" 204 0
      2026-03-13 08:45:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a09ecebd-dc8a-5870-96ff-9b254346134a due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112595/0.jpeg took longer than 180.0 seconds..
      2026-03-13 08:45:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/8.jpeg took longer than 180.0 seconds..
      2026-03-13 08:45:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/7.jpeg took longer than 180.0 seconds..
      
      2026-03-13 08:45:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/6.jpeg took longer than 180.0 seconds..
      2026-03-13 08:45:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/5.jpeg took longer than 180.0 seconds..
      2026-03-13 08:45:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/4.jpeg took longer than 180.0 seconds..
      
      2026-03-13 08:45:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/3.jpeg took longer than 180.0 seconds..
      2026-03-13 08:46:20 [scrapy.extensions.logstats] INFO: Crawled 82 pages (at 0 pages/min), scraped 12 items (at 1 items/min)
      
      2026-03-13 08:46:20 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
      2026-03-13 08:47:20 [scrapy.extensions.logstats] INFO: Crawled 82 pages (at 0 pages/min), scraped 12 items (at 0 items/min)
      
      2026-03-13 08:47:20 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
      2026-03-13 08:48:20 [scrapy.extensions.logstats] INFO: Crawled 82 pages (at 0 pages/min), scraped 12 items (at 0 items/min)
      
      2026-03-13 08:48:20 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
      2026-03-13 08:48:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/2.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/1.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: arval.fr, Translating item: 42a9646c-873f-51ab-9165-998740608b18 with identifier: 112585
      2026-03-13 08:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: arval.fr, Applying rules to item: 42a9646c-873f-51ab-9165-998740608b18 with identifier: 112585
      2026-03-13 08:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: arval.fr, Posting item: 42a9646c-873f-51ab-9165-998740608b18 with identifier: 112585 to the API
      2026-03-13 08:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
      2026-03-13 08:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
      2026-03-13 08:48:38 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/0.jpeg took longer than 180.0 seconds..
      {'auction_title': '',
       'category': 'Véhicule Particulier',
       'color': 'black',
       'currency': 'EUR',
       'doors_number': 5,
       'engine': '1.2L',
       'engine_horse_power': 131,
       'expiration_date': None,
       'fuel_type': 'Petrol',
       'id': '42a9646c-873f-51ab-9165-998740608b18',
       'is_damaged': False,
       'is_operable': True,
       'license_plate': 'GS974WB',
       'link_to_web_offer': 'https://autoselect.arval.fr/voitures-occasion/offer/peugeot-308-308-gt-12-puretech-130cv-bva8-112585',
       'listing': 'directbuy',
       'location': 'Exclu web',
       'make': 'Peugeot',
       'model': '308',
       'odometer': 22423,
       'odometer_reading_unit': 'km',
       'origin_country_code': 'FR',
       'original_photo_count': 20,
       'photo_urls': ['https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/0.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/1.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/2.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/3.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/4.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/5.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/6.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/7.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/8.jpeg',
                      'https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/9.jpeg'],
       'photos': [],
       'price': 20990.0,
       'price_includes_vat': True,
       'registration_date': '2023-12-05',
       'seats_number': 0,
       'seller_name': None,
       'title': 'Peugeot 308 308 GT 1.2 PureTech 130CV BVA8',
       'transmission': 'automatic',
       'trim': '308 GT 1.2 PureTech 130CV BVA8',
       'vin': 'VR3FPHNSTPY643556',
       'year': 2023}
      2026-03-13 08:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27112585%27 HTTP/1.1" 200 None
      2026-03-13 08:48:38 [arval.fr] INFO: Saving data for 112585: {'created_time': 1773391718.730994, 'last_price_update_time': 1773391718.731005}
      2026-03-13 08:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='arval.fr',RowKey='112585') HTTP/1.1" 204 0
      2026-03-13 08:48:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 42a9646c-873f-51ab-9165-998740608b18 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/112585/0.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 04be8bde-f11a-5119-8072-c4364ca14463 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116129/8.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 04be8bde-f11a-5119-8072-c4364ca14463 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116129/7.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
      
      2026-03-13 08:48:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 04be8bde-f11a-5119-8072-c4364ca14463 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116129/6.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/5/116235> (referer: https://autoselect.arval.fr) ['zyte-api']
      2026-03-13 08:48:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
      2026-03-13 08:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1359b8a-e2e1-5c3a-bf68-d63c7cf11457 with identifier: 116235
      2026-03-13 08:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1359b8a-e2e1-5c3a-bf68-d63c7cf11457 with scrape type 1
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1359b8a-e2e1-5c3a-bf68-d63c7cf11457
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F0.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/0.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F1.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/1.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F2.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/2.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F3.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/3.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F4.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/4.jpeg not downloaded yet
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 04be8bde-f11a-5119-8072-c4364ca14463 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116129/5.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F5.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/5.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F6.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/6.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F7.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/7.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F8.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/8.jpeg not downloaded yet
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116235%252F9.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116235/9.jpeg not downloaded yet
      2026-03-13 08:48:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
      2026-03-13 08:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/5/116715> (referer: https://autoselect.arval.fr) ['zyte-api']
      2026-03-13 08:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e690e0a-7eb2-5da5-a9c4-97c1b129b3ed with identifier: 116715
      2026-03-13 08:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e690e0a-7eb2-5da5-a9c4-97c1b129b3ed with scrape type 1
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e690e0a-7eb2-5da5-a9c4-97c1b129b3ed
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F0.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/0.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F1.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/1.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F2.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/2.jpeg not downloaded yet
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 04be8bde-f11a-5119-8072-c4364ca14463 due to User timeout caused connection failure: Getting https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116129/4.jpeg took longer than 180.0 seconds..
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F3.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/3.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F4.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/4.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F5.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/5.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F6.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/6.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F7.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/7.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F8.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/8.jpeg not downloaded yet
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F116715%252F9.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/116715/9.jpeg not downloaded yet
      2026-03-13 08:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://arval-prod-euw-appservice-portalapi.azurewebsites.net/api/Announcements/5/113502> (referer: https://autoselect.arval.fr) ['zyte-api']
      2026-03-13 08:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae492a0a-5ae3-534d-aa6d-87cb18aaf734 with identifier: 113502
      2026-03-13 08:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae492a0a-5ae3-534d-aa6d-87cb18aaf734 with scrape type 1
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae492a0a-5ae3-534d-aa6d-87cb18aaf734
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F0.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/0.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F1.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/1.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F2.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/2.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F3.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/3.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F4.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/4.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F5.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/5.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F6.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/6.jpeg not downloaded yet
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F7.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/7.jpeg not downloaded yet
      2026-03-13 08:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F8.jpeg%27 HTTP/1.1" 200 None
      2026-03-13 08:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/8.jpeg not downloaded yet
      2026-03-13 08:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
      2026-03-13 08:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27arval.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Farvalprodeuwsa.blob.core.windows.net%252Farval-prod-euw-blobcontainer-images%252FPortalsAnnouncementsImages%252F5%252F736%252F113502%252F9.jpeg%27 HTTP/1.1" 200 None
      
      2026-03-13 08:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://arvalprodeuwsa.blob.core.windows.net/arval-prod-euw-blobcontainer-images/PortalsAnnouncementsImages/5/736/113502/9.jpeg not downloaded yet
      2026-03-13 08:49:20 [scrapy.extensions.logstats] INFO: Crawled 85 pages (at 3 pages/min), scraped 13 items (at 1 items/min)
      
    • Log

      /5/log/utf8/sourcing_v2/arval.fr/2026-03-13T07_39_13/

    • Source

      http://scrapyd-4:6800/logs/sourcing_v2/arval.fr/2026-03-13T07_39_13.log